igt@xe_pat@pt-caching on shard-bmg@xe-pw-166161v1 Test details

Detail	Value
Duration	unknown
Hostname	shard-bmg-10
Igt-Version	IGT-Version: 2.4-g3e5747e53 (x86_64) (Linux: 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ x86_64)
Out	Using IGT_SRANDOM=1778222722 for randomisation Opened device: /dev/dri/card0 Test requirement not met in function __igt_unique____real_main2210, file ../tests/intel/xe_pat.c:2298: Test requirement: intel_graphics_ver(dev_id) == IP_VER(35, 10) Last errno: 2, No such file or directory Starting subtest: pt-caching va_bits: 48, num_objs: 16384, spread over pt levels: [0]: 16384 [1]: 512 [2]: 16 Subtest pt-caching: SUCCESS (11.612s) This test caused an abort condition: Kernel badly tainted (0x40244, 0x200) (check dmesg for details): TAINT_WARN: WARN_ON has happened.
Err	Starting subtest: pt-caching Subtest pt-caching: SUCCESS (11.612s)
Dmesg Scroll to first warning	<6> [561.952247] Console: switching to colour dummy device 80x25 <6> [561.952600] [IGT] xe_pat: executing <6> [561.973782] [IGT] xe_pat: starting subtest pt-caching <6> [563.641517] xe 0000:03:00.0: [drm] Tile0: GT0: ASID: 0 Faulted Address: 0x0000000001790000 FaultType: 0 AccessType: 0 FaultLevel: 0 EngineClass: 3 bcs EngineInstance: 8 <6> [563.641532] xe 0000:03:00.0: [drm] Tile0: GT0: Fault response: Unsuccessful -EINVAL <6> [563.641574] xe 0000:03:00.0: [drm] Tile0: GT0: Engine memory CAT error [18]: class=bcs, logical_mask: 0x2, guc_id=0 <7> [563.641940] xe 0000:03:00.0: [drm:xe_hw_engine_snapshot_capture [xe]] Tile0: GT0: Proceeding with manual engine snapshot <5> [563.642199] xe 0000:03:00.0: [drm] Tile0: GT0: log buffer overflow <7> [563.714183] xe 0000:03:00.0: [drm:intel_power_well_enable [xe]] enabling AUX_TC2 <7> [563.824397] xe 0000:03:00.0: [drm:intel_power_well_disable [xe]] disabling AUX_TC2 <7> [564.165649] xe 0000:03:00.0: [drm:xe_guc_capture_process [xe]] Tile0: GT0: Capture extraction failed:-5 <6> [564.165873] xe 0000:03:00.0: [drm] Tile0: GT0: Engine reset: engine_class=bcs, logical_mask: 0x2, guc_id=0, state=0x249 <5> [564.165923] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175468, lrc_seqno=175468, guc_id=0, flags=0x73 in no process [-1] <6> [564.345806] xe 0000:03:00.0: [drm] Xe device coredump has been created <6> [564.345831] xe 0000:03:00.0: [drm] Check your /sys/class/drm/card0/device/devcoredump/data <4> [564.345833] ------------[ cut here ]------------ <4> [564.345835] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.345837] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:751/11645 <4> [564.345925] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.346044] [last unloaded: xe] <4> [564.346048] CPU: 5 UID: 0 PID: 11645 Comm: kworker/u64:751 Tainted: G S U N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.346051] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [N]=TEST <4> [564.346052] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.346054] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.346060] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.346133] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.346135] RSP: 0018:ffffc900253b7ca0 EFLAGS: 00010246 <4> [564.346137] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.346138] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.346139] RBP: ffffc900253b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.346140] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.346141] R13: ffff888103a35790 R14: ffff888158fa8000 R15: 00000000fffffffb <4> [564.346143] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [564.346144] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.346145] CR2: 000062466a74b198 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [564.346147] PKRU: 55555554 <4> [564.346148] Call Trace: <4> [564.346149] <TASK> <4> [564.346153] ? lock_acquire+0xa0/0x300 <4> [564.346158] ? __pfx_autoremove_wake_function+0x10/0x10 <4> [564.346163] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.346169] process_one_work+0x239/0x740 <4> [564.346176] worker_thread+0x200/0x3f0 <4> [564.346179] ? __pfx_worker_thread+0x10/0x10 <4> [564.346181] kthread+0x10d/0x150 <4> [564.346184] ? __pfx_kthread+0x10/0x10 <4> [564.346186] ret_from_fork+0x3bd/0x470 <4> [564.346189] ? __pfx_kthread+0x10/0x10 <4> [564.346192] ret_from_fork_asm+0x1a/0x30 <4> [564.346199] </TASK> <4> [564.346200] irq event stamp: 1314197 <4> [564.346201] hardirqs last enabled at (1314203): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.346203] hardirqs last disabled at (1314208): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.346205] softirqs last enabled at (1313246): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.346208] softirqs last disabled at (1313241): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.346210] ---[ end trace 0000000000000000 ]--- <6> [564.346212] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.346283] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.346701] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.347201] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.347729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.347825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.347920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.348026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.348115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.348203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.348289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.348408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.348497] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.348593] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.348686] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.349850] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.360645] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.360921] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.362714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.362806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.362889] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.362971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.363050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.363129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.363207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.363287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.363371] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.363459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.363541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.363619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.363697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.363775] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.363853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.363934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.364014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.364094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.364173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.364259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.364347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.364452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.364534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.364615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.364695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.364774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.364853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.364933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.365012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.365093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.365177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.365262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.365526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.365613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.365702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.365790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.365879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.365968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.366056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.366139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.366220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.366304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.366395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.366486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.366575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.366666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.366757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.366846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.366934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.367023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.367113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.367200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.367288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.367387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.367480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.367571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.367660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.367747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.367835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.367928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.368021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.368113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.368203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.368292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.368392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.368488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.368580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.368668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.368758] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.370273] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.370280] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175468, lrc_seqno=175468, guc_id=0, flags=0x73 in no process [-1] <7> [564.370283] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.370568] ------------[ cut here ]------------ <4> [564.370570] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.370571] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:751/11645 <4> [564.370662] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.370733] [last unloaded: xe] <4> [564.370737] CPU: 5 UID: 0 PID: 11645 Comm: kworker/u64:751 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.370741] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.370742] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.370744] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.370751] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.370835] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.370837] RSP: 0018:ffffc900253b7ca0 EFLAGS: 00010246 <4> [564.370840] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.370841] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.370843] RBP: ffffc900253b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.370844] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.370845] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.370846] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [564.370848] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.370849] CR2: 000062466a74b198 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [564.370851] PKRU: 55555554 <4> [564.370852] Call Trace: <4> [564.370853] <TASK> <4> [564.370857] ? lock_acquire+0xa0/0x300 <4> [564.370864] ? lock_release+0xd0/0x2b0 <4> [564.370868] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.370875] process_one_work+0x239/0x740 <4> [564.370882] worker_thread+0x200/0x3f0 <4> [564.370885] ? __pfx_worker_thread+0x10/0x10 <4> [564.370888] kthread+0x10d/0x150 <4> [564.370891] ? __pfx_kthread+0x10/0x10 <4> [564.370894] ret_from_fork+0x3bd/0x470 <4> [564.370897] ? __pfx_kthread+0x10/0x10 <4> [564.370899] ret_from_fork_asm+0x1a/0x30 <4> [564.370907] </TASK> <4> [564.370909] irq event stamp: 1317401 <4> [564.370910] hardirqs last enabled at (1317407): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.370912] hardirqs last disabled at (1317412): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.370914] softirqs last enabled at (1316592): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.370917] softirqs last disabled at (1316585): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.370920] ---[ end trace 0000000000000000 ]--- <6> [564.370922] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.371009] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.371015] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.371564] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [564.371684] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [564.371801] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.372021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.372126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.372232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.372333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.372443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.372541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.372638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.372737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.372831] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.372940] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.373043] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.374084] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.384356] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.384619] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.385883] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.385968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.386048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.386129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.386210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.386290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.386372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.386460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.386550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.386638] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.386726] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.386811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.386897] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.386983] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.387070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.387162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.387250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.387337] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.387434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.387529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.387623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.387719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.387812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.387906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.387998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.388086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.388174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.388263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.388353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.388444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.388535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.388631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.388725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.388817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.388915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.389011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.389108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.389201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.389292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.389389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.389478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.389567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.389654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.389742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.389832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.389921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.390015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.390110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.390202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.390289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.390383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.390469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.390554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.390641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.390729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.390817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.390905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.390990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.391074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.391160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.391245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.391334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.391431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.391517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.391602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.391688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.391781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.391877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.391967] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.393101] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.393106] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175468, lrc_seqno=175468, guc_id=0, flags=0x73 in no process [-1] <7> [564.393110] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.393195] ------------[ cut here ]------------ <4> [564.393196] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.393198] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:751/11645 <4> [564.393276] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.393345] [last unloaded: xe] <4> [564.393531] CPU: 5 UID: 0 PID: 11645 Comm: kworker/u64:751 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.393534] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.393536] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.393537] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.393544] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.393626] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.393628] RSP: 0018:ffffc900253b7ca0 EFLAGS: 00010246 <4> [564.393631] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.393632] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.393633] RBP: ffffc900253b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.393635] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.393636] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.393637] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [564.393639] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.393640] CR2: 000062466a74b198 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [564.393641] PKRU: 55555554 <4> [564.393643] Call Trace: <4> [564.393644] <TASK> <4> [564.393648] ? lock_acquire+0xa0/0x300 <4> [564.393654] ? lock_release+0xd0/0x2b0 <4> [564.393659] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.393666] process_one_work+0x239/0x740 <4> [564.393673] worker_thread+0x200/0x3f0 <4> [564.393676] ? __pfx_worker_thread+0x10/0x10 <4> [564.393679] kthread+0x10d/0x150 <4> [564.393681] ? __pfx_kthread+0x10/0x10 <4> [564.393684] ret_from_fork+0x3bd/0x470 <4> [564.393687] ? __pfx_kthread+0x10/0x10 <4> [564.393689] ret_from_fork_asm+0x1a/0x30 <4> [564.393697] </TASK> <4> [564.393698] irq event stamp: 1320601 <4> [564.393700] hardirqs last enabled at (1320607): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.393702] hardirqs last disabled at (1320612): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.393704] softirqs last enabled at (1319698): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.393707] softirqs last disabled at (1319687): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.393710] ---[ end trace 0000000000000000 ]--- <7> [564.393726] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [564.393837] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [564.394778] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175523, lrc_seqno=175523, guc_id=0, flags=0x73 in no process [-1] <7> [564.394783] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.394854] ------------[ cut here ]------------ <4> [564.394855] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.394856] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:257/11151 <4> [564.394937] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.395008] [last unloaded: xe] <4> [564.395011] CPU: 4 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.395014] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.395015] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.395017] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.395022] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.395101] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.395102] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [564.395104] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.395106] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.395107] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.395108] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.395109] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.395111] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [564.395112] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.395113] CR2: 00006523d19dc038 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [564.395115] PKRU: 55555554 <4> [564.395116] Call Trace: <4> [564.395117] <TASK> <4> [564.395121] ? lock_acquire+0xa0/0x300 <4> [564.395127] ? lock_release+0xd0/0x2b0 <4> [564.395132] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.395138] process_one_work+0x239/0x740 <4> [564.395145] worker_thread+0x200/0x3f0 <4> [564.395148] ? __pfx_worker_thread+0x10/0x10 <4> [564.395151] kthread+0x10d/0x150 <4> [564.395153] ? __pfx_kthread+0x10/0x10 <4> [564.395156] ret_from_fork+0x3bd/0x470 <4> [564.395158] ? __pfx_kthread+0x10/0x10 <4> [564.395161] ret_from_fork_asm+0x1a/0x30 <4> [564.395169] </TASK> <4> [564.395170] irq event stamp: 62059 <4> [564.395171] hardirqs last enabled at (62065): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.395174] hardirqs last disabled at (62070): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.395175] softirqs last enabled at (60054): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.395178] softirqs last disabled at (60013): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.395181] ---[ end trace 0000000000000000 ]--- <6> [564.395183] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.395263] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.395271] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.395405] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.395719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.395823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.395926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.396022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.396114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.396206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.396298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.396404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.396493] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.396597] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.396693] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.397728] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.408357] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.408618] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.409683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.409770] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.409852] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.409935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.410018] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.410102] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.410186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.410269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.410356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.410442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.410524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.410604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.410683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.410764] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.410843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.410922] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.411002] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.411080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.411160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.411247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.411338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.411441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.411531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.411617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.411701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.411783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.411865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.411948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.412033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.412122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.412210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.412294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.412387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.412477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.412568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.412658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.412748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.412834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.412919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.413002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.413087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.413173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.413259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.413345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.413450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.413537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.413623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.413709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.413794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.413878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.413963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.414046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.414129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.414210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.414292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.414388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.414476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.414561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.414645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.414731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.414819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.414907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.414991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.415073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.415157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.415241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.415323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.415415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.415505] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.415861] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.415866] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175523, lrc_seqno=175523, guc_id=0, flags=0x73 in no process [-1] <7> [564.415869] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.415938] ------------[ cut here ]------------ <4> [564.415940] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.415941] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:257/11151 <4> [564.416022] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.416089] [last unloaded: xe] <4> [564.416092] CPU: 0 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.416095] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.416096] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.416098] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.416104] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.416182] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.416184] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [564.416186] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.416188] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.416189] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.416190] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.416191] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.416192] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [564.416194] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.416195] CR2: 00007b37b3102000 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [564.416197] PKRU: 55555554 <4> [564.416198] Call Trace: <4> [564.416199] <TASK> <4> [564.416203] ? lock_acquire+0xa0/0x300 <4> [564.416209] ? lock_release+0xd0/0x2b0 <4> [564.416214] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.416220] process_one_work+0x239/0x740 <4> [564.416227] worker_thread+0x200/0x3f0 <4> [564.416230] ? __pfx_worker_thread+0x10/0x10 <4> [564.416233] kthread+0x10d/0x150 <4> [564.416235] ? __pfx_kthread+0x10/0x10 <4> [564.416238] ret_from_fork+0x3bd/0x470 <4> [564.416240] ? __pfx_kthread+0x10/0x10 <4> [564.416243] ret_from_fork_asm+0x1a/0x30 <4> [564.416251] </TASK> <4> [564.416252] irq event stamp: 65217 <4> [564.416253] hardirqs last enabled at (65223): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.416255] hardirqs last disabled at (65228): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.416257] softirqs last enabled at (63942): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.416260] softirqs last disabled at (63937): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.416263] ---[ end trace 0000000000000000 ]--- <6> [564.416264] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.416342] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.417797] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.417813] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [564.417929] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [564.418132] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.418375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.418475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.418577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.418672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.418768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.418860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.418952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.419046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.419136] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.419242] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.419354] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.420409] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.431142] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.431407] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.432438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.432520] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.432596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.432672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.432750] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.432828] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.432904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.432980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.433055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.433129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.433203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.433276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.433355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.433435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.433516] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.433596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.433677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.433762] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.433844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.433933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.434021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.434108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.434191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.434277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.434373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.434461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.434546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.434629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.434711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.434797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.434883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.434971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.435061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.435149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.435241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.435331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.435436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.435523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.435609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.435693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.435777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.435860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.435942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.436030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.436121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.436207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.436297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.436402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.436488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.436573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.436659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.436743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.436829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.436915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.436999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.437083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.437166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.437247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.437328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.437423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.437508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.437596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.437680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.437759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.437835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.437911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.437984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.438059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.438137] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.438250] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.438256] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175523, lrc_seqno=175523, guc_id=0, flags=0x73 in no process [-1] <7> [564.438259] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.438327] ------------[ cut here ]------------ <4> [564.438328] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.438330] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:766/11660 <4> [564.438422] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.438485] [last unloaded: xe] <4> [564.438488] CPU: 10 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.438491] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.438492] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.438494] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.438499] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.438571] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.438572] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [564.438575] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.438576] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.438577] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.438578] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.438579] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.438581] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [564.438582] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.438583] CR2: 00007ffd308f1a88 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [564.438585] PKRU: 55555554 <4> [564.438586] Call Trace: <4> [564.438587] <TASK> <4> [564.438591] ? lock_acquire+0xa0/0x300 <4> [564.438596] ? lock_release+0xd0/0x2b0 <4> [564.438600] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.438606] process_one_work+0x239/0x740 <4> [564.438612] worker_thread+0x200/0x3f0 <4> [564.438615] ? __pfx_worker_thread+0x10/0x10 <4> [564.438617] kthread+0x10d/0x150 <4> [564.438619] ? __pfx_kthread+0x10/0x10 <4> [564.438622] ret_from_fork+0x3bd/0x470 <4> [564.438624] ? __pfx_kthread+0x10/0x10 <4> [564.438627] ret_from_fork_asm+0x1a/0x30 <4> [564.438634] </TASK> <4> [564.438635] irq event stamp: 811899 <4> [564.438636] hardirqs last enabled at (811905): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.438638] hardirqs last disabled at (811910): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.438640] softirqs last enabled at (810908): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.438643] softirqs last disabled at (810901): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.438645] ---[ end trace 0000000000000000 ]--- <5> [564.440046] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175578, lrc_seqno=175578, guc_id=0, flags=0x73 in no process [-1] <7> [564.440051] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [564.440054] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [564.440136] ------------[ cut here ]------------ <4> [564.440137] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.440138] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:19/2441 <7> [564.440167] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [564.440227] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.440297] [last unloaded: xe] <4> [564.440301] CPU: 8 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.440304] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.440305] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.440306] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.440312] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.440410] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.440412] RSP: 0018:ffffc9000405bca0 EFLAGS: 00010246 <4> [564.440415] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.440416] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.440418] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.440419] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.440420] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.440422] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [564.440424] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.440425] CR2: 0000796064a5e058 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [564.440427] PKRU: 55555554 <4> [564.440428] Call Trace: <4> [564.440429] <TASK> <4> [564.440434] ? lock_acquire+0xa0/0x300 <4> [564.440439] ? lock_release+0xd0/0x2b0 <4> [564.440444] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.440451] process_one_work+0x239/0x740 <4> [564.440458] worker_thread+0x200/0x3f0 <4> [564.440461] ? __pfx_worker_thread+0x10/0x10 <4> [564.440464] kthread+0x10d/0x150 <4> [564.440466] ? __pfx_kthread+0x10/0x10 <4> [564.440469] ret_from_fork+0x3bd/0x470 <4> [564.440472] ? __pfx_kthread+0x10/0x10 <4> [564.440474] ret_from_fork_asm+0x1a/0x30 <4> [564.440482] </TASK> <4> [564.440483] irq event stamp: 2086133 <4> [564.440485] hardirqs last enabled at (2086139): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.440487] hardirqs last disabled at (2086144): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.440489] softirqs last enabled at (2085972): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.440492] softirqs last disabled at (2085967): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.440495] ---[ end trace 0000000000000000 ]--- <6> [564.440496] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.440581] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.440587] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.440827] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.441044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.441148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.441255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.441363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.441467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.441566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.441662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.441761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.441854] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.441961] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.442062] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.443102] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.453355] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.453620] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.454790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.454891] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.454976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.455059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.455142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.455221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.455301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.455392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.455478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.455563] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.455649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.455733] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.455818] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.455906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.455994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.456082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.456168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.456254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.456339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.456447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.456545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.456640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.456731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.456822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.456913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.457000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.457088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.457179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.457270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.457364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.457457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.457547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.457638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.457729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.457824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.457920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.458015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.458107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.458198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.458286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.458381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.458469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.458561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.458654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.458746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.458835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.458924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.459013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.459100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.459193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.459290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.459388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.459480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.459569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.459657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.459746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.459834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.459922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.460009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.460098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.460185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.460273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.460363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.460452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.460541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.460629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.460716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.460805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.460895] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.461021] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.461026] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175578, lrc_seqno=175578, guc_id=0, flags=0x73 in no process [-1] <7> [564.461029] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.461101] ------------[ cut here ]------------ <4> [564.461103] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.461104] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:19/2441 <4> [564.461190] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.461255] [last unloaded: xe] <4> [564.461259] CPU: 8 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.461262] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.461263] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.461264] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.461270] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.461354] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.461356] RSP: 0018:ffffc9000405bca0 EFLAGS: 00010246 <4> [564.461359] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.461361] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.461362] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.461363] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.461365] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.461366] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [564.461368] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.461370] CR2: 0000796064a5e058 CR3: 00000001424a0003 CR4: 0000000000f72ef0 <4> [564.461371] PKRU: 55555554 <4> [564.461373] Call Trace: <4> [564.461374] <TASK> <4> [564.461378] ? lock_acquire+0xa0/0x300 <4> [564.461383] ? lock_release+0xd0/0x2b0 <4> [564.461388] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.461394] process_one_work+0x239/0x740 <4> [564.461401] worker_thread+0x200/0x3f0 <4> [564.461405] ? __pfx_worker_thread+0x10/0x10 <4> [564.461407] kthread+0x10d/0x150 <4> [564.461410] ? __pfx_kthread+0x10/0x10 <4> [564.461413] ret_from_fork+0x3bd/0x470 <4> [564.461415] ? __pfx_kthread+0x10/0x10 <4> [564.461418] ret_from_fork_asm+0x1a/0x30 <4> [564.461426] </TASK> <4> [564.461427] irq event stamp: 2089301 <4> [564.461428] hardirqs last enabled at (2089307): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.461431] hardirqs last disabled at (2089312): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.461433] softirqs last enabled at (2088338): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.461436] softirqs last disabled at (2088331): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.461438] ---[ end trace 0000000000000000 ]--- <6> [564.462361] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.462502] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.462514] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.462712] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [564.462824] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [564.463075] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.463293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.463409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.463511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.463612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.463708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.463801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.463893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.463986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.464074] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.464175] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.464271] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.465323] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.476067] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.476322] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.477319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.477416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.477497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.477573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.477647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.477721] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.477795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.477872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.477948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.478022] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.478096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.478170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.478243] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.478316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.478400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.478480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.478559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.478639] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.478717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.478803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.478892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.478981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.479068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.479153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.479237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.479319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.479410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.479491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.479572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.479655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.479740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.479823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.479906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.479989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.480078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.480171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.480266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.480361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.480450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.480533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.480617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.480700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.480787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.480875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.480962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.481046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.481129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.481211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.481293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.481405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.481497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.481584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.481670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.481752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.481833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.481917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.481999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.482080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.482161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.482245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.482327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.482423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.482505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.482587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.482672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.482757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.482844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.482936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.483023] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.483144] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.483148] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175578, lrc_seqno=175578, guc_id=0, flags=0x73 in no process [-1] <7> [564.483151] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.484378] ------------[ cut here ]------------ <4> [564.484380] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.484383] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:766/11660 <4> [564.484476] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel <7> [564.484507] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [564.484579] intel_vsec <4> [564.484581] mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe] <4> [564.484597] CPU: 11 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.484601] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.484603] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.484604] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.484613] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.484742] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <7> [564.484664] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [564.484745] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [564.484748] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.484750] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.484752] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.484754] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.484756] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.484757] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [564.484760] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.484761] CR2: 00006523d19d8318 CR3: 000000000344a003 CR4: 0000000000f72ef0 <4> [564.484763] PKRU: 55555554 <4> [564.484765] Call Trace: <4> [564.484766] <TASK> <4> [564.484772] ? lock_acquire+0xa0/0x300 <4> [564.484780] ? lock_release+0xd0/0x2b0 <4> [564.484788] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.484799] process_one_work+0x239/0x740 <4> [564.484810] worker_thread+0x200/0x3f0 <4> [564.484815] ? __pfx_worker_thread+0x10/0x10 <4> [564.484825] kthread+0x10d/0x150 <4> [564.484828] ? __pfx_kthread+0x10/0x10 <4> [564.484831] ret_from_fork+0x3bd/0x470 <4> [564.484834] ? __pfx_kthread+0x10/0x10 <4> [564.484837] ret_from_fork_asm+0x1a/0x30 <4> [564.484845] </TASK> <4> [564.484846] irq event stamp: 816263 <4> [564.484847] hardirqs last enabled at (816269): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.484850] hardirqs last disabled at (816274): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.484851] softirqs last enabled at (815284): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.484855] softirqs last disabled at (815277): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.484857] ---[ end trace 0000000000000000 ]--- <5> [564.485309] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175633, lrc_seqno=175633, guc_id=0, flags=0x73 in no process [-1] <7> [564.485313] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.485398] ------------[ cut here ]------------ <4> [564.485399] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.485400] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:766/11660 <4> [564.485481] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.485548] [last unloaded: xe] <4> [564.485551] CPU: 11 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.485555] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.485556] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.485557] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.485563] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.485641] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.485643] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [564.485645] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.485647] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.485648] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.485649] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.485650] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.485652] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [564.485653] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.485655] CR2: 00006523d19d8318 CR3: 000000000344a003 CR4: 0000000000f72ef0 <4> [564.485656] PKRU: 55555554 <4> [564.485657] Call Trace: <4> [564.485658] <TASK> <4> [564.485662] ? lock_acquire+0xa0/0x300 <4> [564.485667] ? lock_release+0xd0/0x2b0 <4> [564.485671] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.485678] process_one_work+0x239/0x740 <4> [564.485684] worker_thread+0x200/0x3f0 <4> [564.485687] ? __pfx_worker_thread+0x10/0x10 <4> [564.485690] kthread+0x10d/0x150 <4> [564.485692] ? __pfx_kthread+0x10/0x10 <4> [564.485695] ret_from_fork+0x3bd/0x470 <4> [564.485697] ? __pfx_kthread+0x10/0x10 <4> [564.485700] ret_from_fork_asm+0x1a/0x30 <4> [564.485707] </TASK> <4> [564.485708] irq event stamp: 818185 <4> [564.485709] hardirqs last enabled at (818191): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.485711] hardirqs last disabled at (818196): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.485713] softirqs last enabled at (817418): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.485716] softirqs last disabled at (817411): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.485718] ---[ end trace 0000000000000000 ]--- <6> [564.485720] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.485798] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.485804] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.485865] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.486163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.486263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.486370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.486465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.486558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.486650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.486742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.486834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.486923] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.487025] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.487121] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.488159] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.498358] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.498617] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.499570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.499652] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.499729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.499808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.499886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.499962] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.500037] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.500111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.500186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.500260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.500337] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.500437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.500513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.500588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.500663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.500736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.500808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.500881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.500957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.501038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.501118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.501196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.501274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.501357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.501436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.501512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.501587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.501665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.501742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.501819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.501897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.501972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.502048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.502123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.502206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.502292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.502385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.502466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.502545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.502620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.502697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.502776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.502852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.502930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.503010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.503088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.503165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.503239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.503313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.503396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.503473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.503548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.503623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.503698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.503773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.503848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.503923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.503996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.504073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.504153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.504229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.504306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.504397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.504475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.504553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.504629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.504703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.504776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.504852] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.504966] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.504970] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175633, lrc_seqno=175633, guc_id=0, flags=0x73 in no process [-1] <7> [564.504973] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.505040] ------------[ cut here ]------------ <4> [564.505041] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.505042] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:766/11660 <4> [564.505115] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.505175] [last unloaded: xe] <4> [564.505405] CPU: 0 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.505409] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.505410] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.505411] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.505418] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.505491] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.505492] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [564.505495] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.505496] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.505497] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.505498] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.505499] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.505501] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [564.505502] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.505503] CR2: 00007b37b3102000 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [564.505505] PKRU: 55555554 <4> [564.505506] Call Trace: <4> [564.505507] <TASK> <4> [564.505510] ? lock_acquire+0xa0/0x300 <4> [564.505516] ? lock_release+0xd0/0x2b0 <4> [564.505520] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.505526] process_one_work+0x239/0x740 <4> [564.505532] worker_thread+0x200/0x3f0 <4> [564.505535] ? __pfx_worker_thread+0x10/0x10 <4> [564.505537] kthread+0x10d/0x150 <4> [564.505539] ? __pfx_kthread+0x10/0x10 <4> [564.505542] ret_from_fork+0x3bd/0x470 <4> [564.505544] ? __pfx_kthread+0x10/0x10 <4> [564.505546] ret_from_fork_asm+0x1a/0x30 <4> [564.505553] </TASK> <4> [564.505554] irq event stamp: 821359 <4> [564.505555] hardirqs last enabled at (821365): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.505557] hardirqs last disabled at (821370): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.505559] softirqs last enabled at (820470): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.505562] softirqs last disabled at (820465): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.505564] ---[ end trace 0000000000000000 ]--- <6> [564.506107] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.506230] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.506240] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.506853] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [564.506964] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [564.507078] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.507288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.507393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.507487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.507572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.507656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.507741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.507828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.507916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.507997] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.508089] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.508177] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.509195] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.519366] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.519624] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.520727] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.520815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.520898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.520976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.521054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.521130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.521206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.521281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.521358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.521438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.521519] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.521600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.521681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.521763] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.521844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.521925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.522006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.522101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.522186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.522277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.522379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.522467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.522554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.522642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.522728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.522812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.522896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.522982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.523067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.523155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.523241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.523325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.523420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.523512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.523606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.523698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.523790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.523878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.523964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.524048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.524132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.524219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.524304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.524398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.524485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.524570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.524655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.524737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.524821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.524905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.524991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.525076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.525160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.525243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.525329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.525428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.525514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.525597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.525679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.525766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.525849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.525934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.526017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.526099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.526184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.526268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.526361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.526446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.526532] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.526654] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.526658] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175633, lrc_seqno=175633, guc_id=0, flags=0x73 in no process [-1] <7> [564.526661] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.526728] ------------[ cut here ]------------ <4> [564.526729] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.526730] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:766/11660 <4> [564.526808] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.526874] [last unloaded: xe] <4> [564.526877] CPU: 11 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.526880] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.526881] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.526883] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.526889] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.526968] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.526970] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [564.526972] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.526973] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.526975] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.526976] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.526977] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.526978] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [564.526980] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.526981] CR2: 00006523d19d8318 CR3: 000000000344a003 CR4: 0000000000f72ef0 <4> [564.526983] PKRU: 55555554 <4> [564.526984] Call Trace: <4> [564.526985] <TASK> <4> [564.526989] ? lock_acquire+0xa0/0x300 <4> [564.526995] ? lock_release+0xd0/0x2b0 <4> [564.526999] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.527006] process_one_work+0x239/0x740 <4> [564.527012] worker_thread+0x200/0x3f0 <4> [564.527015] ? __pfx_worker_thread+0x10/0x10 <4> [564.527018] kthread+0x10d/0x150 <4> [564.527020] ? __pfx_kthread+0x10/0x10 <4> [564.527023] ret_from_fork+0x3bd/0x470 <4> [564.527025] ? __pfx_kthread+0x10/0x10 <4> [564.527028] ret_from_fork_asm+0x1a/0x30 <4> [564.527036] </TASK> <4> [564.527037] irq event stamp: 824613 <4> [564.527038] hardirqs last enabled at (824619): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.527040] hardirqs last disabled at (824624): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.527042] softirqs last enabled at (823752): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.527045] softirqs last disabled at (823731): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.527047] ---[ end trace 0000000000000000 ]--- <7> [564.528457] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <5> [564.528588] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175688, lrc_seqno=175688, guc_id=0, flags=0x73 in no process [-1] <7> [564.528572] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [564.528593] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.528674] ------------[ cut here ]------------ <4> [564.528675] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.528678] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:257/11151 <4> [564.528767] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.528835] [last unloaded: xe] <4> [564.528838] CPU: 8 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.528841] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.528843] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.528844] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.528850] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.528934] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.528936] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [564.528938] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.528940] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.528941] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.528942] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.528944] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.528945] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [564.528946] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.528948] CR2: 0000796064a5e058 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [564.528949] PKRU: 55555554 <4> [564.528951] Call Trace: <4> [564.528952] <TASK> <4> [564.528956] ? lock_acquire+0xa0/0x300 <4> [564.528961] ? lock_release+0xd0/0x2b0 <4> [564.528966] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.528972] process_one_work+0x239/0x740 <4> [564.528979] worker_thread+0x200/0x3f0 <4> [564.528982] ? __pfx_worker_thread+0x10/0x10 <4> [564.528985] kthread+0x10d/0x150 <4> [564.528987] ? __pfx_kthread+0x10/0x10 <4> [564.528990] ret_from_fork+0x3bd/0x470 <4> [564.528992] ? __pfx_kthread+0x10/0x10 <4> [564.528995] ret_from_fork_asm+0x1a/0x30 <4> [564.529003] </TASK> <4> [564.529004] irq event stamp: 69189 <4> [564.529005] hardirqs last enabled at (69195): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.529007] hardirqs last disabled at (69200): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.529009] softirqs last enabled at (67728): [<ffffffff8133abd3>] kernel_fpu_end+0x53/0x70 <4> [564.529011] softirqs last disabled at (67726): [<ffffffff8133b2e4>] kernel_fpu_begin_mask+0xc4/0x120 <4> [564.529014] ---[ end trace 0000000000000000 ]--- <6> [564.529016] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.529100] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.529106] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.529321] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.529548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.529645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.529747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.529846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.529939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.530032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.530124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.530219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.530308] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.530424] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.530522] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.531559] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.541355] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.541614] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.542603] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.542689] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.542771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.542856] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.542940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.543022] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.543104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.543183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.543261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.543341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.543436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.543519] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.543600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.543682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.543762] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.543842] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.543922] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.544001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.544081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.544168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.544256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.544342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.544440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.544530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.544618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.544703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.544789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.544873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.544957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.545042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.545127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.545211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.545295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.545386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.545477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.545566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.545658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.545748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.545836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.545920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.546005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.546089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.546173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.546259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.546662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.546753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.546840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.546928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.547013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.547099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.547187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.547272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.547359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.547443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.547526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.547615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.547701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.547784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.547868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.547955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.548040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.548123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.548206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.548287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.548374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.548457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.548537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.548617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.548701] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.548822] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.548826] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175688, lrc_seqno=175688, guc_id=0, flags=0x73 in no process [-1] <7> [564.548828] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.548896] ------------[ cut here ]------------ <4> [564.548897] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.548899] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:766/11660 <4> [564.548976] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.549042] [last unloaded: xe] <4> [564.549045] CPU: 10 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.549049] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.549050] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.549051] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.549057] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.549135] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.549137] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [564.549139] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.549141] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.549142] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.549143] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.549144] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.549146] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [564.549147] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.549149] CR2: 00007ffd308f1a88 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [564.549150] PKRU: 55555554 <4> [564.549151] Call Trace: <4> [564.549152] <TASK> <4> [564.549157] ? lock_acquire+0xa0/0x300 <4> [564.549162] ? lock_release+0xd0/0x2b0 <4> [564.549166] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.549173] process_one_work+0x239/0x740 <4> [564.549179] worker_thread+0x200/0x3f0 <4> [564.549182] ? __pfx_worker_thread+0x10/0x10 <4> [564.549185] kthread+0x10d/0x150 <4> [564.549187] ? __pfx_kthread+0x10/0x10 <4> [564.549190] ret_from_fork+0x3bd/0x470 <4> [564.549192] ? __pfx_kthread+0x10/0x10 <4> [564.549195] ret_from_fork_asm+0x1a/0x30 <4> [564.549203] </TASK> <4> [564.549204] irq event stamp: 828265 <4> [564.549205] hardirqs last enabled at (828271): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.549207] hardirqs last disabled at (828276): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.549209] softirqs last enabled at (827392): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.549212] softirqs last disabled at (827387): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.549214] ---[ end trace 0000000000000000 ]--- <6> [564.549216] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.549293] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.549299] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.550884] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [564.550998] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [564.551112] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.551333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.551451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.551555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.551652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.551747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.551841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.551935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.552033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.552128] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.552231] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.552327] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.553403] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.563358] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.563623] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.564626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.564715] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.564799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.564883] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.564966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.565049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.565133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.565215] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.565296] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.565388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.565469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.565548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.565631] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.565711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.565791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.565870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.565950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.566029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.566108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.566197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.566286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.566383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.566472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.566560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.566645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.566729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.566811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.566892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.566973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.567057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.567143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.567226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.567310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.567404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.567493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.567587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.567681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.567770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.567856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.567940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.568022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.568105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.568187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.568274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.568369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.568481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.568634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.568767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.568893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.569021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.569152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.569279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.569427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.569556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.569666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.569753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.569839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.569921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.570007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.570096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.570181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.570266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.570357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.570440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.570522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.570606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.570689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.570770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.570855] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.570977] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.570982] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175688, lrc_seqno=175688, guc_id=0, flags=0x73 in no process [-1] <7> [564.570985] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.571053] ------------[ cut here ]------------ <4> [564.571054] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.571055] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:19/2441 <4> [564.571135] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.571202] [last unloaded: xe] <4> [564.571205] CPU: 4 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.571208] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.571209] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.571211] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.571217] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.571294] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.571296] RSP: 0018:ffffc9000405bca0 EFLAGS: 00010246 <4> [564.571298] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.571300] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.571301] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.571302] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.571303] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.571305] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [564.571306] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.571308] CR2: 00006523d19dc038 CR3: 000000012a5e2003 CR4: 0000000000f72ef0 <4> [564.571309] PKRU: 55555554 <4> [564.571310] Call Trace: <4> [564.571312] <TASK> <4> [564.571316] ? lock_acquire+0xa0/0x300 <4> [564.571321] ? lock_release+0xd0/0x2b0 <4> [564.571326] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.571332] process_one_work+0x239/0x740 <4> [564.571339] worker_thread+0x200/0x3f0 <4> [564.571342] ? __pfx_worker_thread+0x10/0x10 <4> [564.571344] kthread+0x10d/0x150 <4> [564.571352] ? __pfx_kthread+0x10/0x10 <4> [564.571356] ret_from_fork+0x3bd/0x470 <4> [564.571358] ? __pfx_kthread+0x10/0x10 <4> [564.571361] ret_from_fork_asm+0x1a/0x30 <4> [564.571369] </TASK> <4> [564.571370] irq event stamp: 2094665 <4> [564.571371] hardirqs last enabled at (2094671): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.571374] hardirqs last disabled at (2094676): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.571375] softirqs last enabled at (2093778): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.571378] softirqs last disabled at (2093771): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.571381] ---[ end trace 0000000000000000 ]--- <5> [564.572358] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175743, lrc_seqno=175743, guc_id=0, flags=0x73 in no process [-1] <7> [564.572364] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.572492] ------------[ cut here ]------------ <4> [564.572494] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.572495] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:19/2441 <4> [564.572584] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.572654] [last unloaded: xe] <4> [564.572659] CPU: 8 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.572661] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.572663] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.572664] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.572673] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.572759] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.572761] RSP: 0018:ffffc9000405bca0 EFLAGS: 00010246 <4> [564.572763] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.572765] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.572766] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.572767] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.572768] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.572770] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [564.572771] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.572773] CR2: 0000796064a5e058 CR3: 000000012a5e2004 CR4: 0000000000f72ef0 <4> [564.572774] PKRU: 55555554 <4> [564.572775] Call Trace: <4> [564.572777] <TASK> <4> [564.572780] ? lock_acquire+0xa0/0x300 <4> [564.572785] ? lock_release+0xd0/0x2b0 <4> [564.572790] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.572796] process_one_work+0x239/0x740 <4> [564.572803] worker_thread+0x200/0x3f0 <4> [564.572806] ? __pfx_worker_thread+0x10/0x10 <4> [564.572809] kthread+0x10d/0x150 <4> [564.572811] ? __pfx_kthread+0x10/0x10 <4> [564.572814] ret_from_fork+0x3bd/0x470 <4> [564.572817] ? __pfx_kthread+0x10/0x10 <4> [564.572819] ret_from_fork_asm+0x1a/0x30 <4> [564.572827] </TASK> <4> [564.572828] irq event stamp: 2096601 <4> [564.572829] hardirqs last enabled at (2096607): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.572831] hardirqs last disabled at (2096612): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.572833] softirqs last enabled at (2093778): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.572836] softirqs last disabled at (2093771): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.572839] ---[ end trace 0000000000000000 ]--- <6> [564.572840] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [564.572858] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [564.572923] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.572929] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.572972] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [564.573149] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.573373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.573475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.573581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.573682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.573781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.573876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.573971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.574062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.574149] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.574248] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.574344] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.575393] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.585354] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.585632] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.586691] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.586777] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.586860] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.586943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.587026] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.587108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.587192] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.587274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.587383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.587464] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.587545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.587625] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.587704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.587784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.587867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.587952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.588034] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.588114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.588195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.588282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.588375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.588460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.588547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.588636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.588723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.588807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.588891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.588973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.589055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.589140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.589225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.589309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.589401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.589486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.589576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.589665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.589755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.589840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.589925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.590012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.590101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.590187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.590270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.590356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.590441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.590526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.590611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.590693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.590779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.590868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.590956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.591040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.591125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.591210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.591298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.591397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.591484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.591568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.591650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.591735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.591823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.591913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.592000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.592083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.592167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.592252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.592334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.592427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.592513] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.592635] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.592639] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175743, lrc_seqno=175743, guc_id=0, flags=0x73 in no process [-1] <7> [564.592642] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.592709] ------------[ cut here ]------------ <4> [564.592710] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.592712] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:19/2441 <4> [564.592791] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.592855] [last unloaded: xe] <4> [564.592858] CPU: 8 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.592861] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.592862] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.592863] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.592868] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.592946] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.592947] RSP: 0018:ffffc9000405bca0 EFLAGS: 00010246 <4> [564.592949] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.592951] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.592952] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.592953] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.592954] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.592956] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [564.592957] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.592959] CR2: 0000796064a5e058 CR3: 000000012a5e2004 CR4: 0000000000f72ef0 <4> [564.592960] PKRU: 55555554 <4> [564.592961] Call Trace: <4> [564.592962] <TASK> <4> [564.592966] ? lock_acquire+0xa0/0x300 <4> [564.592971] ? lock_release+0xd0/0x2b0 <4> [564.592976] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.592982] process_one_work+0x239/0x740 <4> [564.592988] worker_thread+0x200/0x3f0 <4> [564.592991] ? __pfx_worker_thread+0x10/0x10 <4> [564.592994] kthread+0x10d/0x150 <4> [564.592996] ? __pfx_kthread+0x10/0x10 <4> [564.592999] ret_from_fork+0x3bd/0x470 <4> [564.593001] ? __pfx_kthread+0x10/0x10 <4> [564.593004] ret_from_fork_asm+0x1a/0x30 <4> [564.593012] </TASK> <4> [564.593013] irq event stamp: 2099955 <4> [564.593014] hardirqs last enabled at (2099961): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.593016] hardirqs last disabled at (2099966): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.593018] softirqs last enabled at (2099100): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.593020] softirqs last disabled at (2099093): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.593023] ---[ end trace 0000000000000000 ]--- <6> [564.593024] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.593102] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.593108] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.594368] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [564.594505] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [564.594621] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.594838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.594940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.595044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.595143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.595240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.595338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.595447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.595543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.595634] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.595737] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.595835] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.596873] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.607353] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.607634] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.608648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.608737] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.608823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.608908] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.608989] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.609070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.609148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.609227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.609306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.609399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.609480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.609560] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.609642] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.609722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.609802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.609884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.609963] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.610041] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.610121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.610207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.610293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.610397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.610484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.610571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.610657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.610741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.610823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.610905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.610991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.611079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.611167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.611252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.611337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.611433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.611523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.611611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.611700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.611790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.611879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.611963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.612047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.612131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.612212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.612295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.612397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.612480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.612562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.612643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.612728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.612815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.612903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.612988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.613071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.613155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.613236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.613320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.613413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.613494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.613575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.613660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.613742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.613829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.613914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.613996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.614078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.614161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.614244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.614324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.614417] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.614539] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.614543] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175743, lrc_seqno=175743, guc_id=0, flags=0x73 in no process [-1] <7> [564.614545] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.614613] ------------[ cut here ]------------ <4> [564.614614] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.614615] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:766/11660 <4> [564.614694] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.614760] [last unloaded: xe] <4> [564.614764] CPU: 10 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.614767] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.614768] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.614769] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.614775] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.614851] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.614853] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [564.614855] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.614857] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.614858] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.614859] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.614860] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.614862] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [564.614863] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.614865] CR2: 00007ffd308f1a88 CR3: 000000012a5e2003 CR4: 0000000000f72ef0 <4> [564.614866] PKRU: 55555554 <4> [564.614867] Call Trace: <4> [564.614868] <TASK> <4> [564.614872] ? lock_acquire+0xa0/0x300 <4> [564.614878] ? lock_release+0xd0/0x2b0 <4> [564.614882] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.614888] process_one_work+0x239/0x740 <4> [564.614894] worker_thread+0x200/0x3f0 <4> [564.614897] ? __pfx_worker_thread+0x10/0x10 <4> [564.614900] kthread+0x10d/0x150 <4> [564.614902] ? __pfx_kthread+0x10/0x10 <4> [564.614905] ret_from_fork+0x3bd/0x470 <4> [564.614907] ? __pfx_kthread+0x10/0x10 <4> [564.614910] ret_from_fork_asm+0x1a/0x30 <4> [564.614918] </TASK> <4> [564.614919] irq event stamp: 831895 <4> [564.614920] hardirqs last enabled at (831901): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.614922] hardirqs last disabled at (831906): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.614924] softirqs last enabled at (831046): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.614927] softirqs last disabled at (831039): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.614930] ---[ end trace 0000000000000000 ]--- <5> [564.615537] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175798, lrc_seqno=175798, guc_id=0, flags=0x73 in no process [-1] <7> [564.615546] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.615929] ------------[ cut here ]------------ <4> [564.615931] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.615934] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:766/11660 <4> [564.616281] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.616375] [last unloaded: xe] <4> [564.616380] CPU: 11 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.616384] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.616386] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.616388] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.616397] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <7> [564.616428] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [564.616517] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.616519] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [564.616522] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.616524] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.616526] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.616527] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.616529] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.616531] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [564.616533] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.616534] CR2: 00006523d19d8318 CR3: 000000000344a003 CR4: 0000000000f72ef0 <4> [564.616536] PKRU: 55555554 <4> [564.616538] Call Trace: <4> [564.616539] <TASK> <4> [564.616544] ? lock_acquire+0xa0/0x300 <4> [564.616552] ? lock_release+0xd0/0x2b0 <4> [564.616560] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.616570] process_one_work+0x239/0x740 <4> [564.616581] worker_thread+0x200/0x3f0 <4> [564.616592] ? __pfx_worker_thread+0x10/0x10 <4> [564.616597] kthread+0x10d/0x150 <4> [564.616600] ? __pfx_kthread+0x10/0x10 <4> [564.616605] ret_from_fork+0x3bd/0x470 <4> [564.616608] ? __pfx_kthread+0x10/0x10 <4> [564.616612] ret_from_fork_asm+0x1a/0x30 <4> [564.616623] </TASK> <4> [564.616625] irq event stamp: 833785 <4> [564.616626] hardirqs last enabled at (833791): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.616630] hardirqs last disabled at (833796): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.616633] softirqs last enabled at (833458): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.616637] softirqs last disabled at (833453): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.616641] ---[ end trace 0000000000000000 ]--- <7> [564.616588] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [564.616644] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.616761] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.616768] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.616949] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.617160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.617258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.617365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.617499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.617597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.617688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.617780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.617873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.617962] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.618063] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.618161] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.619217] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.629951] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.630209] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.631226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.631313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.631409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.631504] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.631587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.631669] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.631753] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.631834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.631914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.631992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.632072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.632152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.632231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.632309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.632402] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.632505] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.632585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.632664] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.632742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.632829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.632915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.633000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.633088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.633180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.633269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.633360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.633458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.633544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.633633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.633723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.633813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.633900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.633986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.634073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.634164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.634260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.634360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.634471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.634560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.634646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.634730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.634815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.634903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.634993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.635082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.635169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.635256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.635340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.635440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.635544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.635634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.635719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.635805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.635890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.635977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.636067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.636154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.636238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.636321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.636418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.636517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.636601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.636684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.636765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.636851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.636941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.637028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.637114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.637204] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.637326] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.637330] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175798, lrc_seqno=175798, guc_id=0, flags=0x73 in no process [-1] <7> [564.637333] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.637652] ------------[ cut here ]------------ <4> [564.637656] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.637659] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:766/11660 <4> [564.638046] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.638171] [last unloaded: xe] <4> [564.638177] CPU: 10 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.638186] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.638190] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.638193] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.638212] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.638333] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.638335] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [564.638337] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.638338] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.638340] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.638341] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.638342] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.638344] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [564.638350] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.638351] CR2: 00007ffd308f1a88 CR3: 000000012a5e2003 CR4: 0000000000f72ef0 <4> [564.638354] PKRU: 55555554 <4> [564.638356] Call Trace: <4> [564.638358] <TASK> <4> [564.638365] ? lock_acquire+0xa0/0x300 <4> [564.638374] ? lock_release+0xd0/0x2b0 <4> [564.638383] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.638393] process_one_work+0x239/0x740 <4> [564.638403] worker_thread+0x200/0x3f0 <4> [564.638407] ? __pfx_worker_thread+0x10/0x10 <4> [564.638411] kthread+0x10d/0x150 <4> [564.638415] ? __pfx_kthread+0x10/0x10 <4> [564.638420] ret_from_fork+0x3bd/0x470 <4> [564.638423] ? __pfx_kthread+0x10/0x10 <4> [564.638428] ret_from_fork_asm+0x1a/0x30 <4> [564.638442] </TASK> <4> [564.638444] irq event stamp: 836973 <4> [564.638446] hardirqs last enabled at (836979): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.638450] hardirqs last disabled at (836984): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <7> [564.638375] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [564.638453] softirqs last enabled at (836870): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.638457] softirqs last disabled at (836865): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.638460] ---[ end trace 0000000000000000 ]--- <6> [564.638463] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.638590] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.638599] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.638537] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [564.638906] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.639117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.639216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.639317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.639429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.639523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.639614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.639705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.639797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.639885] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.639985] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.640082] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.641119] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.651353] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.651609] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.652586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.652671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.652754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.652839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.652924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.653006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.653088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.653167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.653246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.653326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.653413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.653492] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.653570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.653649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.653728] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.653807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.653886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.653965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.654045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.654132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.654218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.654306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.654401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.654489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.654573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.654656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.654738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.654820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.654902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.654991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.655082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.655168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.655255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.655340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.655444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.655535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.655624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.655716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.655806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.655891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.655976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.656060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.656142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.656226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.656316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.656414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.656500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.656583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.656664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.656746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.656830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.656912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.656995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.657081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.657168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.657255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.657340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.657434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.657516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.657603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.657690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.657776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.657860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.657942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.658026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.658108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.658189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.658270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.658356] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.658477] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.658482] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175798, lrc_seqno=175798, guc_id=0, flags=0x73 in no process [-1] <7> [564.658485] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.658552] ------------[ cut here ]------------ <4> [564.658554] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.658555] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:766/11660 <4> [564.658634] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.658702] [last unloaded: xe] <4> [564.658705] CPU: 10 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.658708] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.658709] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.658711] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.658717] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.658794] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.658796] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [564.658798] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.658799] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.658800] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.658802] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.658803] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.658804] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [564.658806] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.658807] CR2: 00007ffd308f1a88 CR3: 000000012a5e2003 CR4: 0000000000f72ef0 <4> [564.658809] PKRU: 55555554 <4> [564.658810] Call Trace: <4> [564.658811] <TASK> <4> [564.658815] ? lock_acquire+0xa0/0x300 <4> [564.658820] ? lock_release+0xd0/0x2b0 <4> [564.658824] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.658830] process_one_work+0x239/0x740 <4> [564.658836] worker_thread+0x200/0x3f0 <4> [564.658839] ? __pfx_worker_thread+0x10/0x10 <4> [564.658842] kthread+0x10d/0x150 <4> [564.658844] ? __pfx_kthread+0x10/0x10 <4> [564.658847] ret_from_fork+0x3bd/0x470 <4> [564.658850] ? __pfx_kthread+0x10/0x10 <4> [564.658852] ret_from_fork_asm+0x1a/0x30 <4> [564.658860] </TASK> <4> [564.658861] irq event stamp: 840149 <4> [564.658862] hardirqs last enabled at (840155): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.658864] hardirqs last disabled at (840160): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.658866] softirqs last enabled at (839148): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.658869] softirqs last disabled at (839141): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.658871] ---[ end trace 0000000000000000 ]--- <5> [564.659491] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175853, lrc_seqno=175853, guc_id=0, flags=0x73 in no process [-1] <7> [564.659500] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.659867] ------------[ cut here ]------------ <4> [564.659870] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.659873] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:766/11660 <4> [564.660240] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.660320] [last unloaded: xe] <4> [564.660323] CPU: 11 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.660326] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.660327] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.660329] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.660334] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <7> [564.660373] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [564.660470] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.660473] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [564.660478] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.660479] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.660481] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.660482] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.660484] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.660486] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [564.660487] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.660489] CR2: 00006523d19d8318 CR3: 000000000344a003 CR4: 0000000000f72ef0 <4> [564.660491] PKRU: 55555554 <4> [564.660492] Call Trace: <4> [564.660494] <TASK> <4> [564.660500] ? lock_acquire+0xa0/0x300 <4> [564.660508] ? lock_release+0xd0/0x2b0 <4> [564.660517] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.660527] process_one_work+0x239/0x740 <4> [564.660538] worker_thread+0x200/0x3f0 <4> [564.660543] ? __pfx_worker_thread+0x10/0x10 <4> [564.660547] kthread+0x10d/0x150 <4> [564.660551] ? __pfx_kthread+0x10/0x10 <4> [564.660556] ret_from_fork+0x3bd/0x470 <4> [564.660559] ? __pfx_kthread+0x10/0x10 <4> [564.660563] ret_from_fork_asm+0x1a/0x30 <4> [564.660574] </TASK> <4> [564.660576] irq event stamp: 842087 <4> [564.660577] hardirqs last enabled at (842093): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.660580] hardirqs last disabled at (842098): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.660583] softirqs last enabled at (841926): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.660587] softirqs last disabled at (841921): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.660591] ---[ end trace 0000000000000000 ]--- <7> [564.660543] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [564.660594] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.660715] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.660721] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.660929] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.661142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.661239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.661342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.661454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.661553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.661649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.661747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.661846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.661937] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.662041] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.662144] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.663201] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.673934] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.674195] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.675233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.675319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.675421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.675506] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.675592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.675675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.675758] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.675839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.675920] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.676000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.676078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.676159] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.676238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.676317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.676404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.676486] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.676566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.676649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.676735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.676827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.676916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.677001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.677088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.677178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.677266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.677353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.677436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.677519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.677601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.677685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.677771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.677854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.677938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.678023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.678113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.678203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.678293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.678385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.678472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.678560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.678650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.678736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.678820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.678904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.678989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.679072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.679156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.679239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.679321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.679421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.679506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.679591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.679677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.679765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.679850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.679935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.680021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.680103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.680185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.680271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.680358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.680442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.680525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.680608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.680691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.680775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.680857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.680940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.681025] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.681145] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.681149] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175853, lrc_seqno=175853, guc_id=0, flags=0x73 in no process [-1] <7> [564.681152] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.682558] ------------[ cut here ]------------ <4> [564.682560] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.682561] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:766/11660 <4> [564.682652] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.682718] [last unloaded: xe] <4> [564.682721] CPU: 11 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.682724] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.682725] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.682727] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.682733] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.682814] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.682816] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [564.682818] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.682819] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.682821] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.682822] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.682823] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.682824] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [564.682826] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.682827] CR2: 00006523d19d8318 CR3: 000000000344a003 CR4: 0000000000f72ef0 <4> [564.682829] PKRU: 55555554 <4> [564.682830] Call Trace: <4> [564.682831] <TASK> <4> [564.682835] ? lock_acquire+0xa0/0x300 <4> [564.682841] ? lock_release+0xd0/0x2b0 <4> [564.682845] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.682851] process_one_work+0x239/0x740 <4> [564.682858] worker_thread+0x200/0x3f0 <4> [564.682861] ? __pfx_worker_thread+0x10/0x10 <4> [564.682864] kthread+0x10d/0x150 <4> [564.682866] ? __pfx_kthread+0x10/0x10 <4> [564.682869] ret_from_fork+0x3bd/0x470 <4> [564.682872] ? __pfx_kthread+0x10/0x10 <4> [564.682874] ret_from_fork_asm+0x1a/0x30 <4> [564.682882] </TASK> <4> [564.682883] irq event stamp: 845273 <4> [564.682884] hardirqs last enabled at (845279): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.682887] hardirqs last disabled at (845284): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.682888] softirqs last enabled at (844366): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.682891] softirqs last disabled at (844355): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.682894] ---[ end trace 0000000000000000 ]--- <6> [564.682896] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.682978] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.682984] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.683000] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [564.683112] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [564.683410] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.683665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.683764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.683866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.683961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.684055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.684147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.684239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.684332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.684461] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.684564] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.684660] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.685699] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.696692] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.696944] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.697910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.697990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.698067] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.698145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.698222] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.698298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.698390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.698479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.698561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.698645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.698728] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.698807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.698888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.698967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.699046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.699125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.699204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.699282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.699372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.699487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.699577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.699667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.699751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.699836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.699919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.700000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.700082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.700164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.700244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.700331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.700439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.700534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.700619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.700703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.700793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.700883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.700972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.701058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.701149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.701236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.701323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.701419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.701512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.701596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.701682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.701767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.701851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.701934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.702016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.702105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.702196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.702282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.702376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.702469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.702553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.702637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.702720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.702805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.702890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.702976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.703060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.703144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.703229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.703314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.703412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.703506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.703590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.703671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.703756] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.703878] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.703882] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175853, lrc_seqno=175853, guc_id=0, flags=0x73 in no process [-1] <7> [564.703885] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.703953] ------------[ cut here ]------------ <4> [564.703954] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.703956] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:257/11151 <4> [564.704035] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.704102] [last unloaded: xe] <4> [564.704105] CPU: 5 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.704108] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.704110] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.704111] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.704117] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.704195] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.704197] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [564.704199] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.704200] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.704202] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.704203] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.704204] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.704205] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [564.704207] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.704208] CR2: 000062466a74b198 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [564.704210] PKRU: 55555554 <4> [564.704211] Call Trace: <4> [564.704212] <TASK> <4> [564.704561] ? lock_acquire+0xa0/0x300 <4> [564.704570] ? lock_release+0xd0/0x2b0 <4> [564.704579] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.704607] process_one_work+0x239/0x740 <4> [564.704620] worker_thread+0x200/0x3f0 <4> [564.704626] ? __pfx_worker_thread+0x10/0x10 <4> [564.704630] kthread+0x10d/0x150 <4> [564.704634] ? __pfx_kthread+0x10/0x10 <4> [564.704640] ret_from_fork+0x3bd/0x470 <4> [564.704644] ? __pfx_kthread+0x10/0x10 <4> [564.704649] ret_from_fork_asm+0x1a/0x30 <4> [564.704663] </TASK> <4> [564.704665] irq event stamp: 78747 <4> [564.704668] hardirqs last enabled at (78753): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.704672] hardirqs last disabled at (78758): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.704675] softirqs last enabled at (78672): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.704679] softirqs last disabled at (78651): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.704683] ---[ end trace 0000000000000000 ]--- <5> [564.705606] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175908, lrc_seqno=175908, guc_id=0, flags=0x73 in no process [-1] <7> [564.705615] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.705747] ------------[ cut here ]------------ <4> [564.705750] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.705752] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:257/11151 <4> [564.705837] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.705909] [last unloaded: xe] <4> [564.705912] CPU: 1 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.705915] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.705916] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.705918] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.705924] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.706005] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.706007] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [564.706009] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.706011] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.706012] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.706013] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.706014] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.706016] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [564.706017] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.706019] CR2: 000077dc54013008 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [564.706020] PKRU: 55555554 <4> [564.706021] Call Trace: <4> [564.706022] <TASK> <4> [564.706027] ? lock_acquire+0xa0/0x300 <4> [564.706032] ? lock_release+0xd0/0x2b0 <4> [564.706037] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.706043] process_one_work+0x239/0x740 <4> [564.706050] worker_thread+0x200/0x3f0 <4> [564.706053] ? __pfx_worker_thread+0x10/0x10 <4> [564.706056] kthread+0x10d/0x150 <7> [564.706005] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [564.706059] ? __pfx_kthread+0x10/0x10 <4> [564.706062] ret_from_fork+0x3bd/0x470 <4> [564.706064] ? __pfx_kthread+0x10/0x10 <4> [564.706066] ret_from_fork_asm+0x1a/0x30 <4> [564.706074] </TASK> <4> [564.706075] irq event stamp: 81015 <4> [564.706076] hardirqs last enabled at (81021): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.706078] hardirqs last disabled at (81026): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.706079] softirqs last enabled at (79392): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.706082] softirqs last disabled at (79383): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.706084] ---[ end trace 0000000000000000 ]--- <6> [564.706086] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.706165] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.706171] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.706119] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [564.706275] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.706521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.706617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.706715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.706807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.706904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.706998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.707091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.707186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.707274] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.707400] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.707495] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.708557] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.718355] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.718640] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.719690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.719777] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.719862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.719947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.720032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.720115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.720198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.720281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.720399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.720485] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.720569] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.720650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.720730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.720810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.720889] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.720968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.721047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.721125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.721204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.721289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.721402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.721490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.721574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.721661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.721744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.721826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.721907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.721991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.722077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.722164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.722249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.722333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.722439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.722531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.722625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.722717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.722808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.722896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.722983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.723066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.723151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.723235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.723322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.723425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.723512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.723597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.723682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.723768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.723853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.723939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.724025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.724109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.724196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.724283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.724396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.724481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.724566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.724647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.724728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.724814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.724900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.724987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.725072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.725155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.725239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.725322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.725440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.725523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.725612] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.725735] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.725739] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175908, lrc_seqno=175908, guc_id=0, flags=0x73 in no process [-1] <7> [564.725742] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.725808] ------------[ cut here ]------------ <4> [564.725809] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.725811] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:257/11151 <4> [564.725888] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.725954] [last unloaded: xe] <4> [564.725957] CPU: 1 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.725960] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.725961] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.725962] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.725968] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.726044] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.726046] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [564.726048] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.726050] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.726051] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.726052] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.726053] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.726055] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [564.726056] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.726058] CR2: 000077dc54013008 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [564.726059] PKRU: 55555554 <4> [564.726060] Call Trace: <4> [564.726062] <TASK> <4> [564.726065] ? lock_acquire+0xa0/0x300 <4> [564.726071] ? lock_release+0xd0/0x2b0 <4> [564.726075] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.726081] process_one_work+0x239/0x740 <4> [564.726088] worker_thread+0x200/0x3f0 <4> [564.726091] ? __pfx_worker_thread+0x10/0x10 <4> [564.726094] kthread+0x10d/0x150 <4> [564.726097] ? __pfx_kthread+0x10/0x10 <4> [564.726099] ret_from_fork+0x3bd/0x470 <4> [564.726102] ? __pfx_kthread+0x10/0x10 <4> [564.726105] ret_from_fork_asm+0x1a/0x30 <4> [564.726112] </TASK> <4> [564.726113] irq event stamp: 84319 <4> [564.726114] hardirqs last enabled at (84325): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.726117] hardirqs last disabled at (84330): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.726118] softirqs last enabled at (83458): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.726121] softirqs last disabled at (83451): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.726124] ---[ end trace 0000000000000000 ]--- <6> [564.726125] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.726205] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.726211] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.727460] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [564.727574] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [564.727687] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.727915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.728071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.728219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.728365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.728505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.728642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.728789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.728895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.728993] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.729099] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.729197] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.730240] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.740354] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.740603] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.741600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.741693] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.741771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.741850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.741928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.742005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.742080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.742154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.742231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.742309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.742396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.742480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.742556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.742631] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.742705] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.742778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.742851] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.742924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.742999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.743082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.743165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.743244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.743321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.743412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.743499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.743575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.743652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.743729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.743807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.743892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.743975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.744055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.744134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.744212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.744297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.744403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.744492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.744572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.744652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.744733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.744811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.744890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.744971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.745051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.745133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.745213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.745291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.745379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.745470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.745550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.745631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.745709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.745786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.745863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.745939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.746022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.746103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.746179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.746255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.746336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.746430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.746519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.746596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.746673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.746750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.746827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.746903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.746978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.747062] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.748415] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.748420] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175908, lrc_seqno=175908, guc_id=0, flags=0x73 in no process [-1] <7> [564.748422] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.748488] ------------[ cut here ]------------ <4> [564.748490] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.748491] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:766/11660 <4> [564.748565] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.748627] [last unloaded: xe] <4> [564.748630] CPU: 11 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.748633] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.748634] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.748636] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.748641] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.748713] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.748715] RSP: 0000:ffffc9002542fca0 EFLAGS: 00010246 <4> [564.748717] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.748718] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.748719] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.748720] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.748722] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.748723] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [564.748724] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.748726] CR2: 00006523d19d8318 CR3: 000000000344a003 CR4: 0000000000f72ef0 <4> [564.748727] PKRU: 55555554 <4> [564.748728] Call Trace: <4> [564.748729] <TASK> <4> [564.748733] ? lock_acquire+0xa0/0x300 <4> [564.748738] ? lock_release+0xd0/0x2b0 <4> [564.748742] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.748748] process_one_work+0x239/0x740 <4> [564.748754] worker_thread+0x200/0x3f0 <4> [564.748757] ? __pfx_worker_thread+0x10/0x10 <4> [564.748759] kthread+0x10d/0x150 <4> [564.748762] ? __pfx_kthread+0x10/0x10 <4> [564.748764] ret_from_fork+0x3bd/0x470 <4> [564.748767] ? __pfx_kthread+0x10/0x10 <4> [564.748769] ret_from_fork_asm+0x1a/0x30 <4> [564.748777] </TASK> <4> [564.748777] irq event stamp: 848721 <4> [564.748779] hardirqs last enabled at (848727): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.748781] hardirqs last disabled at (848732): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.748782] softirqs last enabled at (847638): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.748785] softirqs last disabled at (847627): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.748787] ---[ end trace 0000000000000000 ]--- <7> [564.749203] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <5> [564.749358] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175963, lrc_seqno=175963, guc_id=0, flags=0x73 in no process [-1] <7> [564.749318] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [564.749363] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.749479] ------------[ cut here ]------------ <4> [564.749480] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.749481] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:766/11660 <4> [564.749565] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.749631] [last unloaded: xe] <4> [564.749634] CPU: 10 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.749637] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.749638] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.749640] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.749645] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.749724] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.749725] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [564.749727] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.749729] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.749730] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.749731] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.749732] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.749734] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [564.749735] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.749736] CR2: 00007ffd308f1a88 CR3: 000000012a5e2003 CR4: 0000000000f72ef0 <4> [564.749738] PKRU: 55555554 <4> [564.749739] Call Trace: <4> [564.749740] <TASK> <4> [564.749744] ? lock_acquire+0xa0/0x300 <4> [564.749749] ? lock_release+0xd0/0x2b0 <4> [564.749753] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.749759] process_one_work+0x239/0x740 <4> [564.749766] worker_thread+0x200/0x3f0 <4> [564.749769] ? __pfx_worker_thread+0x10/0x10 <4> [564.749772] kthread+0x10d/0x150 <4> [564.749774] ? __pfx_kthread+0x10/0x10 <4> [564.749777] ret_from_fork+0x3bd/0x470 <4> [564.749779] ? __pfx_kthread+0x10/0x10 <4> [564.749782] ret_from_fork_asm+0x1a/0x30 <4> [564.749789] </TASK> <4> [564.749790] irq event stamp: 850609 <4> [564.749791] hardirqs last enabled at (850615): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.749793] hardirqs last disabled at (850620): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.749795] softirqs last enabled at (847638): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.749798] softirqs last disabled at (847627): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.749801] ---[ end trace 0000000000000000 ]--- <6> [564.749802] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.749881] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.749894] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.750134] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.750353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.750449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.750550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.750646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.750737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.750828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.750918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.751010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.751098] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.751200] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.751296] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.752340] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.762354] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.762610] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.763708] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.763798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.763878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.763953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.764028] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.764102] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.764176] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.764248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.764321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.764409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.764491] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.764571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.764651] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.764732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.764814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.764895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.764975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.765060] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.765142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.765232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.765319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.765415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.765500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.765586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.765672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.765759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.765848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.765934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.766019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.766105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.766192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.766277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.766366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.766451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.766543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.766639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.766732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.766821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.766908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.766993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.767076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.767159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.767241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.767325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.767421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.767506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.767591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.767674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.767757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.767842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.767927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.768010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.768093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.768174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.768257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.768348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.768436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.768521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.768605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.768691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.768776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.768861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.768945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.769032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.769121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.769207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.769291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.769380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.769467] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.769589] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.769593] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175963, lrc_seqno=175963, guc_id=0, flags=0x73 in no process [-1] <7> [564.769596] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.769663] ------------[ cut here ]------------ <4> [564.769665] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.769666] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:766/11660 <4> [564.769744] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.769809] [last unloaded: xe] <4> [564.769812] CPU: 10 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.769815] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.769816] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.769818] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.769823] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.769902] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.769903] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [564.769906] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.769907] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.769908] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.769910] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.769911] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.769912] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [564.769914] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.769915] CR2: 00007ffd308f1a88 CR3: 000000012a5e2003 CR4: 0000000000f72ef0 <4> [564.769917] PKRU: 55555554 <4> [564.769918] Call Trace: <4> [564.769919] <TASK> <4> [564.769923] ? lock_acquire+0xa0/0x300 <4> [564.769927] ? lock_release+0xd0/0x2b0 <4> [564.769932] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.769938] process_one_work+0x239/0x740 <4> [564.769945] worker_thread+0x200/0x3f0 <4> [564.769948] ? __pfx_worker_thread+0x10/0x10 <4> [564.769950] kthread+0x10d/0x150 <4> [564.769952] ? __pfx_kthread+0x10/0x10 <4> [564.769955] ret_from_fork+0x3bd/0x470 <4> [564.769958] ? __pfx_kthread+0x10/0x10 <4> [564.769960] ret_from_fork_asm+0x1a/0x30 <4> [564.769968] </TASK> <4> [564.769969] irq event stamp: 853819 <4> [564.769970] hardirqs last enabled at (853825): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.769972] hardirqs last disabled at (853830): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.769974] softirqs last enabled at (852964): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.769976] softirqs last disabled at (852957): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.769979] ---[ end trace 0000000000000000 ]--- <6> [564.769981] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.770058] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.770063] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.771361] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [564.771472] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [564.772071] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.772287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.772397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.772499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.772599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.772695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.772787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.772879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.772972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.773061] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.773161] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.773258] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.774291] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.784352] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.784607] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.785601] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.785686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.785769] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.785853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.785936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.786019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.786101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.786185] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.786270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.786360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.786443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.786524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.786605] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.786687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.786767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.786850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.786935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.787018] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.787099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.787188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.787276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.787367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.787452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.787539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.787625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.787710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.787797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.787882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.787964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.788049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.788135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.788220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.788303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.788395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.788490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.788584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.788676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.788764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.788850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.788933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.789017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.789099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.789186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.789273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.789364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.789449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.789533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.789616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.789699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.789783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.789870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.789953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.790042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.790129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.790216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.790302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.790398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.790481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.790564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.790650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.790732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.790815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.790899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.790987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.791075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.791161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.791245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.791327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.791423] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.791544] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.791548] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=175963, lrc_seqno=175963, guc_id=0, flags=0x73 in no process [-1] <7> [564.791550] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.791618] ------------[ cut here ]------------ <4> [564.791619] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.791621] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:766/11660 <4> [564.791699] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.791764] [last unloaded: xe] <4> [564.791767] CPU: 10 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.791770] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.791771] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.791773] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.791779] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.791856] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.791858] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [564.791860] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.791861] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.791863] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.791864] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.791865] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.791866] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [564.791868] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.791869] CR2: 00007ffd308f1a88 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [564.791871] PKRU: 55555554 <4> [564.791872] Call Trace: <4> [564.791873] <TASK> <4> [564.791877] ? lock_acquire+0xa0/0x300 <4> [564.791882] ? lock_release+0xd0/0x2b0 <4> [564.791887] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.791893] process_one_work+0x239/0x740 <4> [564.791899] worker_thread+0x200/0x3f0 <4> [564.791902] ? __pfx_worker_thread+0x10/0x10 <4> [564.791905] kthread+0x10d/0x150 <4> [564.791908] ? __pfx_kthread+0x10/0x10 <4> [564.791911] ret_from_fork+0x3bd/0x470 <4> [564.791913] ? __pfx_kthread+0x10/0x10 <4> [564.791915] ret_from_fork_asm+0x1a/0x30 <4> [564.791923] </TASK> <4> [564.791924] irq event stamp: 856995 <4> [564.791925] hardirqs last enabled at (857001): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.791927] hardirqs last disabled at (857006): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.791929] softirqs last enabled at (856146): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.791932] softirqs last disabled at (856139): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.791934] ---[ end trace 0000000000000000 ]--- <5> [564.792529] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176018, lrc_seqno=176018, guc_id=0, flags=0x73 in no process [-1] <7> [564.792537] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.792906] ------------[ cut here ]------------ <4> [564.792908] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.792913] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:766/11660 <4> [564.793278] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.793364] [last unloaded: xe] <4> [564.793368] CPU: 11 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.793371] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.793372] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.793373] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.793381] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <7> [564.793399] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [564.793504] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.793506] RSP: 0000:ffffc9002542fca0 EFLAGS: 00010246 <4> [564.793509] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.793511] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.793512] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.793513] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.793515] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.793516] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [564.793518] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.793520] CR2: 00006523d19d8318 CR3: 000000000344a003 CR4: 0000000000f72ef0 <4> [564.793523] PKRU: 55555554 <4> [564.793524] Call Trace: <4> [564.793526] <TASK> <4> [564.793532] ? lock_acquire+0xa0/0x300 <4> [564.793540] ? lock_release+0xd0/0x2b0 <4> [564.793549] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.793559] process_one_work+0x239/0x740 <4> [564.793570] worker_thread+0x200/0x3f0 <4> [564.793576] ? __pfx_worker_thread+0x10/0x10 <4> [564.793580] kthread+0x10d/0x150 <4> [564.793583] ? __pfx_kthread+0x10/0x10 <4> [564.793588] ret_from_fork+0x3bd/0x470 <4> [564.793591] ? __pfx_kthread+0x10/0x10 <4> [564.793595] ret_from_fork_asm+0x1a/0x30 <4> [564.793606] </TASK> <4> [564.793608] irq event stamp: 858897 <4> [564.793610] hardirqs last enabled at (858903): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.793613] hardirqs last disabled at (858908): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.793616] softirqs last enabled at (858600): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.793620] softirqs last disabled at (858595): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.793624] ---[ end trace 0000000000000000 ]--- <7> [564.793568] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [564.793627] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.793746] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.793753] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.793992] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.794212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.794315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.794460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.794565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.794660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.794752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.794844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.794935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.795022] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.795124] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.795222] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.796268] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.806356] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.806617] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.807644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.807731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.807817] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.807904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.807992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.808076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.808158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.808240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.808321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.808417] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.808511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.808591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.808672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.808756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.808842] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.808926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.809007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.809088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.809168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.809256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.809351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.809453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.809539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.809626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.809713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.809798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.809885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.809976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.810064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.810152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.810240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.810326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.810426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.810537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.810629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.810722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.810819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.810910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.810997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.811083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.811167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.811252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.811339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.811443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.811544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.811630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.811714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.811797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.811879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.811961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.812047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.812134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.812219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.812303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.812400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.812508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.812592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.812673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.812756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.812845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.812930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.813014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.813100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.813185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.813269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.813359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.813455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.813537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.813621] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.813742] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.813747] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176018, lrc_seqno=176018, guc_id=0, flags=0x73 in no process [-1] <7> [564.813749] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.813818] ------------[ cut here ]------------ <4> [564.813819] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.813821] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:257/11151 <4> [564.813901] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.813967] [last unloaded: xe] <4> [564.813970] CPU: 1 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.813973] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.813974] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.813976] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.813981] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.814059] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.814061] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [564.814064] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.814066] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.814067] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.814069] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.814070] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.814072] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [564.814073] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.814075] CR2: 000077dc54013008 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [564.814077] PKRU: 55555554 <4> [564.814078] Call Trace: <4> [564.814080] <TASK> <4> [564.814084] ? lock_acquire+0xa0/0x300 <4> [564.814089] ? lock_release+0xd0/0x2b0 <4> [564.814094] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.814100] process_one_work+0x239/0x740 <4> [564.814107] worker_thread+0x200/0x3f0 <4> [564.814111] ? __pfx_worker_thread+0x10/0x10 <4> [564.814113] kthread+0x10d/0x150 <4> [564.814116] ? __pfx_kthread+0x10/0x10 <4> [564.814119] ret_from_fork+0x3bd/0x470 <4> [564.814121] ? __pfx_kthread+0x10/0x10 <4> [564.814124] ret_from_fork_asm+0x1a/0x30 <4> [564.814132] </TASK> <4> [564.814133] irq event stamp: 89617 <4> [564.814134] hardirqs last enabled at (89623): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.814137] hardirqs last disabled at (89628): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.814138] softirqs last enabled at (88512): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.814141] softirqs last disabled at (88505): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.814144] ---[ end trace 0000000000000000 ]--- <6> [564.814146] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.814222] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.814228] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.815510] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [564.815620] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [564.815733] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.815948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.816046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.816148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.816244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.816340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.816476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.816576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.816670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.816764] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.816865] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.816960] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.818013] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.828354] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.828609] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.829610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.829694] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.829778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.829863] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.829946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.830027] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.830107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.830190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.830274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.830361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.830462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.830544] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.830625] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.830705] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.830790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.830875] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.830959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.831042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.831123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.831211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.831300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.831399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.831503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.831591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.831681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.831768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.831853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.831935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.832016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.832103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.832189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.832271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.832360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.832458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.832549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.832639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.832728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.832816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.832899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.832982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.833066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.833148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.833232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.833321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.833431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.833536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.833621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.833705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.833786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.833868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.833955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.834042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.834135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.834220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.834302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.834397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.834496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.834578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.834660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.834745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.834827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.834914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.835001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.835086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.835172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.835257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.835706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.835796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.835885] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.836007] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.836012] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176018, lrc_seqno=176018, guc_id=0, flags=0x73 in no process [-1] <7> [564.836014] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.836083] ------------[ cut here ]------------ <4> [564.836084] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.836085] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:766/11660 <4> [564.836164] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.836231] [last unloaded: xe] <4> [564.836234] CPU: 11 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.836237] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.836238] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.836239] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.836245] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.836324] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.836326] RSP: 0000:ffffc9002542fca0 EFLAGS: 00010246 <4> [564.836329] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.836330] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.836331] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.836332] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.836334] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.836335] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [564.836337] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.836338] CR2: 00006523d19d8318 CR3: 000000000344a003 CR4: 0000000000f72ef0 <4> [564.836339] PKRU: 55555554 <4> [564.836341] Call Trace: <4> [564.836342] <TASK> <4> [564.836351] ? lock_acquire+0xa0/0x300 <4> [564.836357] ? lock_release+0xd0/0x2b0 <4> [564.836362] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.836370] process_one_work+0x239/0x740 <4> [564.836382] worker_thread+0x200/0x3f0 <4> [564.836387] ? __pfx_worker_thread+0x10/0x10 <4> [564.836392] kthread+0x10d/0x150 <4> [564.836395] ? __pfx_kthread+0x10/0x10 <4> [564.836401] ret_from_fork+0x3bd/0x470 <4> [564.836404] ? __pfx_kthread+0x10/0x10 <4> [564.836409] ret_from_fork_asm+0x1a/0x30 <4> [564.836422] </TASK> <4> [564.836424] irq event stamp: 863147 <4> [564.836427] hardirqs last enabled at (863153): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.836430] hardirqs last disabled at (863158): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.836433] softirqs last enabled at (862210): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.836438] softirqs last disabled at (862203): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.836442] ---[ end trace 0000000000000000 ]--- <5> [564.837263] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176073, lrc_seqno=176073, guc_id=0, flags=0x73 in no process [-1] <7> [564.837271] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.837410] ------------[ cut here ]------------ <4> [564.837412] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.837414] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:766/11660 <4> [564.837506] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.837582] [last unloaded: xe] <4> [564.837587] CPU: 4 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.837592] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.837593] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.837596] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.837603] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.837686] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.837688] RSP: 0000:ffffc9002542fca0 EFLAGS: 00010246 <4> [564.837690] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.837692] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.837693] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.837695] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.837698] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.837700] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [564.837703] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.837705] CR2: 00006523d19dc038 CR3: 000000012a5e2003 CR4: 0000000000f72ef0 <4> [564.837708] PKRU: 55555554 <4> [564.837709] Call Trace: <4> [564.837710] <TASK> <4> [564.837714] ? lock_acquire+0xa0/0x300 <4> [564.837720] ? lock_release+0xd0/0x2b0 <4> [564.837724] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.837730] process_one_work+0x239/0x740 <4> [564.837737] worker_thread+0x200/0x3f0 <4> [564.837740] ? __pfx_worker_thread+0x10/0x10 <4> [564.837743] kthread+0x10d/0x150 <4> [564.837745] ? __pfx_kthread+0x10/0x10 <4> [564.837748] ret_from_fork+0x3bd/0x470 <4> [564.837750] ? __pfx_kthread+0x10/0x10 <4> [564.837753] ret_from_fork_asm+0x1a/0x30 <4> [564.837760] </TASK> <4> [564.837762] irq event stamp: 865135 <4> [564.837763] hardirqs last enabled at (865141): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.837765] hardirqs last disabled at (865146): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.837767] softirqs last enabled at (864368): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.837770] softirqs last disabled at (864363): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <7> [564.837716] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [564.837773] ---[ end trace 0000000000000000 ]--- <6> [564.837775] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.837855] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.837863] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.837828] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [564.838059] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.838305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.838415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.838516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.838612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.838707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.838803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.838898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.838995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.839086] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.839187] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.839284] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.840323] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.850362] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.850623] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.851677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.851767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.851852] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.851933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.852015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.852097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.852178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.852262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.852351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.852435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.852517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.852596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.852676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.852755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.852834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.852913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.852996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.853078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.853158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.853247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.853335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.853437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.853520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.853606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.853695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.853783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.853867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.853947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.854029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.854113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.854199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.854282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.854376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.854462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.854551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.854641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.854731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.854817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.854902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.854990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.855078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.855162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.855245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.855330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.855428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.855512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.855596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.855679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.855761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.855844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.855931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.856015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.856105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.856192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.856276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.856365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.856449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.856531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.856612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.856697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.856779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.856864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.856952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.857038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.857124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.857210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.857292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.857383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.857468] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.857596] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.857600] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176073, lrc_seqno=176073, guc_id=0, flags=0x73 in no process [-1] <7> [564.857603] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.857669] ------------[ cut here ]------------ <4> [564.857671] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.857672] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:766/11660 <4> [564.857751] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.857816] [last unloaded: xe] <4> [564.857819] CPU: 4 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.857822] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.857823] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.857825] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.857830] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.857907] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.857909] RSP: 0000:ffffc9002542fca0 EFLAGS: 00010246 <4> [564.857911] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.857912] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.857914] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.857915] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.857916] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.857917] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [564.857919] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.857920] CR2: 00006523d19dc038 CR3: 000000012a5e2003 CR4: 0000000000f72ef0 <4> [564.857922] PKRU: 55555554 <4> [564.857923] Call Trace: <4> [564.857924] <TASK> <4> [564.857928] ? lock_acquire+0xa0/0x300 <4> [564.857933] ? lock_release+0xd0/0x2b0 <4> [564.857938] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.857944] process_one_work+0x239/0x740 <4> [564.857950] worker_thread+0x200/0x3f0 <4> [564.857953] ? __pfx_worker_thread+0x10/0x10 <4> [564.857956] kthread+0x10d/0x150 <4> [564.857958] ? __pfx_kthread+0x10/0x10 <4> [564.857961] ret_from_fork+0x3bd/0x470 <4> [564.857963] ? __pfx_kthread+0x10/0x10 <4> [564.857966] ret_from_fork_asm+0x1a/0x30 <4> [564.857974] </TASK> <4> [564.857975] irq event stamp: 868307 <4> [564.857976] hardirqs last enabled at (868313): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.857978] hardirqs last disabled at (868318): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.857980] softirqs last enabled at (867202): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.857983] softirqs last disabled at (867195): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.857985] ---[ end trace 0000000000000000 ]--- <6> [564.857987] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.858064] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.858069] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.859317] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [564.859440] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [564.859553] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.859771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.859872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.859975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.860072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.860170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.860267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.860367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.860463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.860553] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.860655] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.860752] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.861788] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.872518] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.872767] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.873769] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.873857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.873934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.874012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.874091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.874168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.874245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.874320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.874413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.874497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.874579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.874659] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.874739] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.874818] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.874898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.874978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.875058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.875137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.875217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.875303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.875406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.875497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.875583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.875670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.875756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.875839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.875921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.876003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.876085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.876170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.876258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.876350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.876444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.876531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.876623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.876715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.876805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.876892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.876980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.877064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.877150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.877237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.877322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.877424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.877517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.877608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.877699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.877793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.877889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.877985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.878083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.878178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.878274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.878373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.878477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.878578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.878675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.878769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.878861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.878956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.879045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.879135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.879223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.879309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.879412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.879506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.879595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.879683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.879769] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.879891] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.879896] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176073, lrc_seqno=176073, guc_id=0, flags=0x73 in no process [-1] <7> [564.879899] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.879966] ------------[ cut here ]------------ <4> [564.879967] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.879969] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:257/11151 <4> [564.880048] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.880114] [last unloaded: xe] <4> [564.880117] CPU: 1 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.880121] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.880122] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.880123] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.880129] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.880207] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.880209] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [564.880211] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.880213] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.880214] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.880215] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.880216] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.880218] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [564.880219] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.880223] CR2: 000077dc54013008 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [564.880224] PKRU: 55555554 <4> [564.880226] Call Trace: <4> [564.880227] <TASK> <4> [564.880231] ? lock_acquire+0xa0/0x300 <4> [564.880236] ? lock_release+0xd0/0x2b0 <4> [564.880240] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.880246] process_one_work+0x239/0x740 <4> [564.880253] worker_thread+0x200/0x3f0 <4> [564.880256] ? __pfx_worker_thread+0x10/0x10 <4> [564.880259] kthread+0x10d/0x150 <4> [564.880261] ? __pfx_kthread+0x10/0x10 <4> [564.880264] ret_from_fork+0x3bd/0x470 <4> [564.880266] ? __pfx_kthread+0x10/0x10 <4> [564.880269] ret_from_fork_asm+0x1a/0x30 <4> [564.880277] </TASK> <4> [564.880278] irq event stamp: 94031 <4> [564.880279] hardirqs last enabled at (94037): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.880281] hardirqs last disabled at (94042): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.880283] softirqs last enabled at (93084): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.880286] softirqs last disabled at (93077): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.880288] ---[ end trace 0000000000000000 ]--- <7> [564.881552] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [564.881663] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [564.881831] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176128, lrc_seqno=176128, guc_id=0, flags=0x73 in no process [-1] <7> [564.881835] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.881905] ------------[ cut here ]------------ <4> [564.881906] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.881907] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:257/11151 <4> [564.881987] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.882051] [last unloaded: xe] <4> [564.882055] CPU: 4 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.882057] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.882058] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.882060] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.882066] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.882143] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.882145] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [564.882147] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.882149] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.882150] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.882151] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.882152] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.882154] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [564.882155] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.882157] CR2: 00006523d19dc038 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [564.882158] PKRU: 55555554 <4> [564.882159] Call Trace: <4> [564.882160] <TASK> <4> [564.882164] ? lock_acquire+0xa0/0x300 <4> [564.882169] ? lock_release+0xd0/0x2b0 <4> [564.882174] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.882180] process_one_work+0x239/0x740 <4> [564.882186] worker_thread+0x200/0x3f0 <4> [564.882189] ? __pfx_worker_thread+0x10/0x10 <4> [564.882192] kthread+0x10d/0x150 <4> [564.882194] ? __pfx_kthread+0x10/0x10 <4> [564.882197] ret_from_fork+0x3bd/0x470 <4> [564.882200] ? __pfx_kthread+0x10/0x10 <4> [564.882202] ret_from_fork_asm+0x1a/0x30 <4> [564.882210] </TASK> <4> [564.882211] irq event stamp: 95903 <4> [564.882212] hardirqs last enabled at (95909): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.882214] hardirqs last disabled at (95914): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.882216] softirqs last enabled at (93084): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.882219] softirqs last disabled at (93077): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.882221] ---[ end trace 0000000000000000 ]--- <6> [564.882223] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.882301] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.882307] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.882426] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.882652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.882752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.882852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.882947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.883042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.883133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.883225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.883325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.883438] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.883547] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.883646] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.884688] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.895691] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.895950] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.896981] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.897070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.897153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.897236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.897318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.897413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.897501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.897583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.897666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.897746] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.897826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.897904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.897984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.898062] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.898139] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.898217] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.898294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.898383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.898472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.898559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.898647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.898735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.898818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.898902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.898985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.899067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.899147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.899228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.899309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.899410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.899508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.899595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.899679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.899763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.899852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.899942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.900031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.900121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.900208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.900291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.900397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.900490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.900570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.900656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.900743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.900828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.900911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.900994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.901074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.901155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.901239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.901321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.901417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.901512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.901597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.901685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.901770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.901852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.901933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.902016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.902098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.902182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.902264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.902354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.902454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.902541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.902625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.902709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.902801] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.902923] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.902927] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176128, lrc_seqno=176128, guc_id=0, flags=0x73 in no process [-1] <7> [564.902930] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.902998] ------------[ cut here ]------------ <4> [564.902999] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.903001] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:766/11660 <4> [564.903079] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.903145] [last unloaded: xe] <4> [564.903148] CPU: 11 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.903151] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.903152] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.903153] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.903159] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.903245] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.903247] RSP: 0000:ffffc9002542fca0 EFLAGS: 00010246 <4> [564.903249] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.903250] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.903252] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.903253] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.903254] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.903255] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [564.903257] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.903258] CR2: 00006523d19d8318 CR3: 000000000344a003 CR4: 0000000000f72ef0 <4> [564.903260] PKRU: 55555554 <4> [564.903261] Call Trace: <4> [564.903262] <TASK> <4> [564.903266] ? lock_acquire+0xa0/0x300 <4> [564.903271] ? lock_release+0xd0/0x2b0 <4> [564.903276] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.903282] process_one_work+0x239/0x740 <4> [564.903289] worker_thread+0x200/0x3f0 <4> [564.903292] ? __pfx_worker_thread+0x10/0x10 <4> [564.903295] kthread+0x10d/0x150 <4> [564.903297] ? __pfx_kthread+0x10/0x10 <4> [564.903300] ret_from_fork+0x3bd/0x470 <4> [564.903302] ? __pfx_kthread+0x10/0x10 <4> [564.903305] ret_from_fork_asm+0x1a/0x30 <4> [564.903312] </TASK> <4> [564.903313] irq event stamp: 871785 <4> [564.903314] hardirqs last enabled at (871791): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.903317] hardirqs last disabled at (871796): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.903318] softirqs last enabled at (870576): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.903321] softirqs last disabled at (870569): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.903323] ---[ end trace 0000000000000000 ]--- <6> [564.904285] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.904400] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.904406] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.904421] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [564.904531] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [564.904740] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.904953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.905048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.905148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.905243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.905337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.905455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.905553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.905649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.905737] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.905837] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.905933] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.906971] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.917353] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.917613] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.918643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.918731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.918815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.918900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.918983] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.919067] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.919151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.919234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.919316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.919407] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.919488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.919568] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.919648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.919729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.919809] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.919889] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.919968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.920049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.920130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.920218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.920305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.920406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.920492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.920576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.920659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.920742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.920824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.920906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.920988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.921072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.921157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.921240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.921324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.921430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.921523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.921615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.921706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.921794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.921880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.921964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.922051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.922139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.922224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.922310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.922407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.922498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.922587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.922674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.922757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.922843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.922930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.923014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.923103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.923190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.923274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.923363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.923447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.923529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.923611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.923696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.923779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.923862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.923945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.924029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.924116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.924202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.924286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.924379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.924465] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.924590] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.924594] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176128, lrc_seqno=176128, guc_id=0, flags=0x73 in no process [-1] <7> [564.924597] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.924664] ------------[ cut here ]------------ <4> [564.924665] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.924667] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:19/2441 <4> [564.924747] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.924814] [last unloaded: xe] <4> [564.924817] CPU: 5 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.924820] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.924821] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.924823] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.924829] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.924907] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.924909] RSP: 0018:ffffc9000405bca0 EFLAGS: 00010246 <4> [564.924911] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.924912] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.924914] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.924915] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.924916] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.924917] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [564.924919] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.924920] CR2: 000062466a74b198 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [564.924922] PKRU: 55555554 <4> [564.924923] Call Trace: <4> [564.924924] <TASK> <4> [564.924928] ? lock_acquire+0xa0/0x300 <4> [564.924933] ? lock_release+0xd0/0x2b0 <4> [564.924938] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.924944] process_one_work+0x239/0x740 <4> [564.924951] worker_thread+0x200/0x3f0 <4> [564.924954] ? __pfx_worker_thread+0x10/0x10 <4> [564.924956] kthread+0x10d/0x150 <4> [564.924959] ? __pfx_kthread+0x10/0x10 <4> [564.924962] ret_from_fork+0x3bd/0x470 <4> [564.924964] ? __pfx_kthread+0x10/0x10 <4> [564.924966] ret_from_fork_asm+0x1a/0x30 <4> [564.924974] </TASK> <4> [564.924975] irq event stamp: 2112105 <4> [564.924976] hardirqs last enabled at (2112111): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.924979] hardirqs last disabled at (2112116): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.924980] softirqs last enabled at (2111096): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.924983] softirqs last disabled at (2111089): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.924986] ---[ end trace 0000000000000000 ]--- <5> [564.926184] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176183, lrc_seqno=176183, guc_id=0, flags=0x73 in no process [-1] <7> [564.926188] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.926269] ------------[ cut here ]------------ <4> [564.926270] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.926271] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:19/2441 <4> [564.926355] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.926420] [last unloaded: xe] <4> [564.926423] CPU: 5 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.926425] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.926426] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.926428] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.926433] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.926509] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.926511] RSP: 0018:ffffc9000405bca0 EFLAGS: 00010246 <4> [564.926513] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.926514] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.926515] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.926516] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.926517] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.926519] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [564.926520] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.926521] CR2: 000062466a74b198 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [564.926523] PKRU: 55555554 <4> [564.926524] Call Trace: <4> [564.926525] <TASK> <4> [564.926529] ? lock_acquire+0xa0/0x300 <4> [564.926534] ? lock_release+0xd0/0x2b0 <4> [564.926538] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.926544] process_one_work+0x239/0x740 <4> [564.926550] worker_thread+0x200/0x3f0 <4> [564.926553] ? __pfx_worker_thread+0x10/0x10 <4> [564.926556] kthread+0x10d/0x150 <4> [564.926558] ? __pfx_kthread+0x10/0x10 <4> [564.926561] ret_from_fork+0x3bd/0x470 <4> [564.926563] ? __pfx_kthread+0x10/0x10 <4> [564.926566] ret_from_fork_asm+0x1a/0x30 <4> [564.926574] </TASK> <4> [564.926575] irq event stamp: 2114031 <4> [564.926576] hardirqs last enabled at (2114037): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.926578] hardirqs last disabled at (2114042): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.926580] softirqs last enabled at (2111096): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.926582] softirqs last disabled at (2111089): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.926585] ---[ end trace 0000000000000000 ]--- <7> [564.926599] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [564.926708] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [564.926812] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.926889] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.926894] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.926941] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.927493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.927589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.927690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.927784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.927877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.927970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.928063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.928156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.928244] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.928352] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.928450] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.929501] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.939351] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.939607] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.940601] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.940687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.940769] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.940853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.940935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.941017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.941098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.941180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.941262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.941342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.941436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.941515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.941593] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.941671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.941748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.941825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.941904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.941982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.942060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.942149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.942237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.942323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.942416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.942503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.942592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.942679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.942764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.942848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.942930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.943020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.943108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.943194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.943279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.943368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.943458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.943549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.943640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.943727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.943812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.943899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.943986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.944071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.944154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.944239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.944323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.944416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.944500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.944582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.944666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.944757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.944847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.944933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.945019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.945104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.945188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.945273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.945362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.945449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.945534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.945621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.945706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.945790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.945874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.945961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.946049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.946135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.946218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.946301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.946394] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.946518] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.946524] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176183, lrc_seqno=176183, guc_id=0, flags=0x73 in no process [-1] <7> [564.946526] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.946594] ------------[ cut here ]------------ <4> [564.946595] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.946596] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:19/2441 <4> [564.946675] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.946740] [last unloaded: xe] <4> [564.946743] CPU: 5 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.946746] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.946747] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.946749] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.946754] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.946831] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.946833] RSP: 0018:ffffc9000405bca0 EFLAGS: 00010246 <4> [564.946835] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.946836] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.946837] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.946839] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.946840] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.946841] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [564.946843] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.946844] CR2: 000062466a74b198 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [564.946845] PKRU: 55555554 <4> [564.946847] Call Trace: <4> [564.946848] <TASK> <4> [564.946851] ? lock_acquire+0xa0/0x300 <4> [564.946856] ? lock_release+0xd0/0x2b0 <4> [564.946861] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.946867] process_one_work+0x239/0x740 <4> [564.946874] worker_thread+0x200/0x3f0 <4> [564.946877] ? __pfx_worker_thread+0x10/0x10 <4> [564.946880] kthread+0x10d/0x150 <4> [564.946882] ? __pfx_kthread+0x10/0x10 <4> [564.946885] ret_from_fork+0x3bd/0x470 <4> [564.946887] ? __pfx_kthread+0x10/0x10 <4> [564.946890] ret_from_fork_asm+0x1a/0x30 <4> [564.946897] </TASK> <4> [564.946898] irq event stamp: 2117201 <4> [564.946899] hardirqs last enabled at (2117207): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.946902] hardirqs last disabled at (2117212): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.946903] softirqs last enabled at (2116352): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.946906] softirqs last disabled at (2116347): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.946908] ---[ end trace 0000000000000000 ]--- <6> [564.946910] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.946987] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.946994] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.948284] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [564.948407] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [564.948520] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.948733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.948829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.948930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.949023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.949115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.949206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.949299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.949405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.949495] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.949596] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.949694] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.950752] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.961353] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.961609] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.962632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.962717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.962800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.962885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.962973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.963060] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.963144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.963226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.963307] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.963397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.963479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.963559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.963640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.963720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.963801] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.963881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.963961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.964040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.964120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.964209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.964326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.964436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.964521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.964607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.964692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.964775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.964857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.964938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.965020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.965105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.965195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.965283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.965376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.965461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.965551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.965640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.965729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.965815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.965900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.965981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.966063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.966146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.966232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.966316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.966410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.966495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.966578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.966661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.966743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.966826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.966910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.966992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.967074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.967158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.967238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.967320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.967412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.967493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.967575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.967664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.967748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.967830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.967911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.967993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.968080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.968165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.968246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.968327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.968428] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.968555] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.968559] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176183, lrc_seqno=176183, guc_id=0, flags=0x73 in no process [-1] <7> [564.968561] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.968629] ------------[ cut here ]------------ <4> [564.968630] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.968632] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:19/2441 <4> [564.968712] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.968777] [last unloaded: xe] <4> [564.968780] CPU: 5 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.968783] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.968784] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.968786] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.968792] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.968868] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.968870] RSP: 0018:ffffc9000405bca0 EFLAGS: 00010246 <4> [564.968873] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.968874] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.968875] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.968876] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.968878] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.968879] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [564.968880] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.968882] CR2: 000062466a74b198 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [564.968883] PKRU: 55555554 <4> [564.968884] Call Trace: <4> [564.968885] <TASK> <4> [564.968889] ? lock_acquire+0xa0/0x300 <4> [564.968894] ? lock_release+0xd0/0x2b0 <4> [564.968899] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.968905] process_one_work+0x239/0x740 <4> [564.968912] worker_thread+0x200/0x3f0 <4> [564.968915] ? __pfx_worker_thread+0x10/0x10 <4> [564.968918] kthread+0x10d/0x150 <4> [564.968920] ? __pfx_kthread+0x10/0x10 <4> [564.968923] ret_from_fork+0x3bd/0x470 <4> [564.968925] ? __pfx_kthread+0x10/0x10 <4> [564.968928] ret_from_fork_asm+0x1a/0x30 <4> [564.968935] </TASK> <4> [564.968936] irq event stamp: 2120375 <4> [564.968938] hardirqs last enabled at (2120381): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.968940] hardirqs last disabled at (2120386): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.968941] softirqs last enabled at (2119526): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.968944] softirqs last disabled at (2119519): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.968947] ---[ end trace 0000000000000000 ]--- <5> [564.970191] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176238, lrc_seqno=176238, guc_id=0, flags=0x73 in no process [-1] <7> [564.970194] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.970266] ------------[ cut here ]------------ <4> [564.970268] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.970270] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:19/2441 <4> [564.970354] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.970434] [last unloaded: xe] <4> [564.970437] CPU: 5 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.970440] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.970441] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.970443] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.970448] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.970525] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.970527] RSP: 0018:ffffc9000405bca0 EFLAGS: 00010246 <4> [564.970529] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.970530] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.970531] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.970532] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.970534] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.970535] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [564.970536] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.970538] CR2: 000062466a74b198 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [564.970539] PKRU: 55555554 <4> [564.970540] Call Trace: <4> [564.970541] <TASK> <4> [564.970545] ? lock_acquire+0xa0/0x300 <4> [564.970550] ? lock_release+0xd0/0x2b0 <4> [564.970555] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.970560] process_one_work+0x239/0x740 <4> [564.970567] worker_thread+0x200/0x3f0 <4> [564.970570] ? __pfx_worker_thread+0x10/0x10 <4> [564.970573] kthread+0x10d/0x150 <4> [564.970575] ? __pfx_kthread+0x10/0x10 <4> [564.970578] ret_from_fork+0x3bd/0x470 <4> [564.970580] ? __pfx_kthread+0x10/0x10 <4> [564.970583] ret_from_fork_asm+0x1a/0x30 <4> [564.970590] </TASK> <4> [564.970591] irq event stamp: 2122255 <4> [564.970592] hardirqs last enabled at (2122261): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.970594] hardirqs last disabled at (2122266): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.970596] softirqs last enabled at (2119526): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.970599] softirqs last disabled at (2119519): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.970601] ---[ end trace 0000000000000000 ]--- <7> [564.970616] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [564.970727] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [564.970830] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.970912] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.970919] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.971133] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.971391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.971488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.971588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.971687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.971782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.971875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.971968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.972063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.972152] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.972256] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.972357] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.973410] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [564.983353] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [564.983635] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [564.984659] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [564.984744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [564.984831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [564.984919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [564.985004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [564.985087] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [564.985167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [564.985246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [564.985325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [564.985420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [564.985504] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [564.985588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [564.985670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [564.985753] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [564.985834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [564.985915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [564.985996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [564.986075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [564.986155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [564.986242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [564.986333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [564.986439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [564.986525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [564.986612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [564.986697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [564.986779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [564.986861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [564.986942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [564.987028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [564.987115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [564.987202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [564.987287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [564.987380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [564.987465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [564.987555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [564.987644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [564.987733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [564.987824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [564.987913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [564.987999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [564.988084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [564.988168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [564.988252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [564.988340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [564.988447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [564.988532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [564.988615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [564.988698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [564.988780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [564.988864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [564.988953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [564.989037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [564.989120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [564.989202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [564.989283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [564.989394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [564.989479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [564.989567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [564.989654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [564.989742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [564.989828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [564.989913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [564.989999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [564.990081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [564.990164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [564.990247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [564.990329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [564.990425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [564.990513] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [564.990639] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [564.990658] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176238, lrc_seqno=176238, guc_id=0, flags=0x73 in no process [-1] <7> [564.990661] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [564.990730] ------------[ cut here ]------------ <4> [564.990731] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [564.990732] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:19/2441 <4> [564.990833] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [564.990911] [last unloaded: xe] <4> [564.990915] CPU: 5 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [564.990918] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [564.990920] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [564.990922] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [564.990929] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [564.991020] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [564.991021] RSP: 0018:ffffc9000405bca0 EFLAGS: 00010246 <4> [564.991024] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [564.991025] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [564.991026] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [564.991027] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [564.991029] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [564.991030] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [564.991031] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [564.991033] CR2: 000062466a74b198 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [564.991034] PKRU: 55555554 <4> [564.991035] Call Trace: <4> [564.991037] <TASK> <4> [564.991040] ? lock_acquire+0xa0/0x300 <4> [564.991045] ? lock_release+0xd0/0x2b0 <4> [564.991050] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [564.991056] process_one_work+0x239/0x740 <4> [564.991062] worker_thread+0x200/0x3f0 <4> [564.991065] ? __pfx_worker_thread+0x10/0x10 <4> [564.991068] kthread+0x10d/0x150 <4> [564.991070] ? __pfx_kthread+0x10/0x10 <4> [564.991073] ret_from_fork+0x3bd/0x470 <4> [564.991075] ? __pfx_kthread+0x10/0x10 <4> [564.991078] ret_from_fork_asm+0x1a/0x30 <4> [564.991085] </TASK> <4> [564.991087] irq event stamp: 2125447 <4> [564.991088] hardirqs last enabled at (2125453): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [564.991090] hardirqs last disabled at (2125458): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [564.991091] softirqs last enabled at (2124588): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.991094] softirqs last disabled at (2124577): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [564.991097] ---[ end trace 0000000000000000 ]--- <6> [564.991106] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [564.991598] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [564.991614] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [564.992364] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [564.992474] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [564.992587] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [564.992799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [564.992896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [564.992996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [564.993089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [564.993180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [564.993269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [564.993368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [564.993481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [564.993571] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [564.993672] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [564.993768] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [564.994805] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.005354] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.005613] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.006602] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.006689] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.006772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.006854] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.006937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.007020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.007105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.007188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.007270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.007353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.007434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.007513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.007593] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.007673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.007752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.007831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.007911] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.007992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.008074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.008162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.008249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.008335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.008438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.008523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.008611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.008698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.008784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.008866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.008948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.009033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.009118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.009203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.009287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.009378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.009469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.009559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.009650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.009740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.009828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.009913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.009996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.010079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.010163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.010248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.010334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.010429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.010512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.010595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.010682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.010771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.010860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.010944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.011029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.011112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.011195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.011280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.011366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.011448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.011530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.011616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.011699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.011787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.011876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.011961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.012047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.012132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.012215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.012297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.012391] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.012512] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.012516] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176238, lrc_seqno=176238, guc_id=0, flags=0x73 in no process [-1] <7> [565.012519] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.012586] ------------[ cut here ]------------ <4> [565.012587] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.012589] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:257/11151 <4> [565.012668] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.012733] [last unloaded: xe] <4> [565.012737] CPU: 4 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.012739] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.012741] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.012742] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.012748] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.012825] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.012827] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [565.012829] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.012830] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.012832] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.012833] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.012834] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.012835] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [565.012837] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.012838] CR2: 00006523d19dc038 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [565.012840] PKRU: 55555554 <4> [565.012841] Call Trace: <4> [565.012842] <TASK> <4> [565.012846] ? lock_acquire+0xa0/0x300 <4> [565.012851] ? lock_release+0xd0/0x2b0 <4> [565.012856] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.012862] process_one_work+0x239/0x740 <4> [565.012868] worker_thread+0x200/0x3f0 <4> [565.012871] ? __pfx_worker_thread+0x10/0x10 <4> [565.012874] kthread+0x10d/0x150 <4> [565.012876] ? __pfx_kthread+0x10/0x10 <4> [565.012879] ret_from_fork+0x3bd/0x470 <4> [565.012881] ? __pfx_kthread+0x10/0x10 <4> [565.012884] ret_from_fork_asm+0x1a/0x30 <4> [565.012892] </TASK> <4> [565.012893] irq event stamp: 102577 <4> [565.012894] hardirqs last enabled at (102583): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.012896] hardirqs last disabled at (102588): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.012898] softirqs last enabled at (101728): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.012900] softirqs last disabled at (101717): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.012903] ---[ end trace 0000000000000000 ]--- <5> [565.014090] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176293, lrc_seqno=176293, guc_id=0, flags=0x73 in no process [-1] <7> [565.014094] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.014171] ------------[ cut here ]------------ <4> [565.014173] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.014174] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:257/11151 <4> [565.014252] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.014316] [last unloaded: xe] <4> [565.014318] CPU: 4 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.014321] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.014322] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.014323] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.014329] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.014415] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.014416] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [565.014419] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.014420] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.014421] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.014423] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.014424] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.014426] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [565.014427] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.014428] CR2: 00006523d19dc038 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [565.014430] PKRU: 55555554 <4> [565.014431] Call Trace: <4> [565.014432] <TASK> <4> [565.014438] ? lock_acquire+0xa0/0x300 <4> [565.014442] ? lock_release+0xd0/0x2b0 <4> [565.014447] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.014453] process_one_work+0x239/0x740 <4> [565.014459] worker_thread+0x200/0x3f0 <4> [565.014462] ? __pfx_worker_thread+0x10/0x10 <4> [565.014465] kthread+0x10d/0x150 <4> [565.014467] ? __pfx_kthread+0x10/0x10 <4> [565.014470] ret_from_fork+0x3bd/0x470 <4> [565.014473] ? __pfx_kthread+0x10/0x10 <4> [565.014475] ret_from_fork_asm+0x1a/0x30 <4> [565.014483] </TASK> <4> [565.014484] irq event stamp: 104473 <4> [565.014485] hardirqs last enabled at (104479): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.014487] hardirqs last disabled at (104484): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.014489] softirqs last enabled at (101728): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.014492] softirqs last disabled at (101717): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.014494] ---[ end trace 0000000000000000 ]--- <7> [565.014508] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [565.014615] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [565.014717] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.014799] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.014805] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.014854] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.015082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.015184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.015288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.015406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.015507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.015603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.015697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.015790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.015879] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.015979] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.016075] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.017127] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.027350] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.027611] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.028594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.028680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.028763] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.028845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.028928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.029014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.029099] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.029181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.029262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.029341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.029440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.029520] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.029602] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.029686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.029768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.029848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.029928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.030008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.030088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.030175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.030262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.030353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.030441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.030529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.030617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.030700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.030784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.030865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.030947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.031032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.031117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.031200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.031283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.031375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.031468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.031558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.031648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.031735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.031821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.031904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.031987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.032070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.032157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.032244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.032333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.032432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.032518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.032602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.032685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.032769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.032856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.032939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.033022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.033105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.033187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.033271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.033358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.033440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.033523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.033606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.033690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.033777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.033862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.033944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.034028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.034112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.034197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.034284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.034377] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.034503] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.034507] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176293, lrc_seqno=176293, guc_id=0, flags=0x73 in no process [-1] <7> [565.034510] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.034577] ------------[ cut here ]------------ <4> [565.034578] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.034579] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:19/2441 <4> [565.034658] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.034723] [last unloaded: xe] <4> [565.034727] CPU: 10 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.034730] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.034731] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.034732] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.034738] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.034813] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.034815] RSP: 0018:ffffc9000405bca0 EFLAGS: 00010246 <4> [565.034818] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.034819] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.034820] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.034822] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.034823] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.034824] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [565.034826] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.034827] CR2: 00007ffd308f1a88 CR3: 000000012a5e2003 CR4: 0000000000f72ef0 <4> [565.034829] PKRU: 55555554 <4> [565.034830] Call Trace: <4> [565.034831] <TASK> <4> [565.034835] ? lock_acquire+0xa0/0x300 <4> [565.034840] ? lock_release+0xd0/0x2b0 <4> [565.034845] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.034851] process_one_work+0x239/0x740 <4> [565.034858] worker_thread+0x200/0x3f0 <4> [565.034861] ? __pfx_worker_thread+0x10/0x10 <4> [565.034863] kthread+0x10d/0x150 <4> [565.034866] ? __pfx_kthread+0x10/0x10 <4> [565.034869] ret_from_fork+0x3bd/0x470 <4> [565.034871] ? __pfx_kthread+0x10/0x10 <4> [565.034873] ret_from_fork_asm+0x1a/0x30 <4> [565.034881] </TASK> <4> [565.034882] irq event stamp: 2129919 <4> [565.034883] hardirqs last enabled at (2129925): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.034885] hardirqs last disabled at (2129930): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.034887] softirqs last enabled at (2128992): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.034890] softirqs last disabled at (2128985): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.034892] ---[ end trace 0000000000000000 ]--- <6> [565.034894] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.034973] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.034980] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.036247] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [565.036363] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [565.036479] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.036694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.036788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.036887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.036984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.037079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.037173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.037265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.037364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.037453] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.037552] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.037649] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.038686] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.049687] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.049944] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.050948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.051033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.051115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.051198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.051282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.051375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.051463] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.051547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.051630] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.051715] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.051799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.051880] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.051961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.052043] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.052123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.052204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.052284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.052371] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.052454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.052542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.052631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.052719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.052804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.052890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.052975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.053058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.053140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.053222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.053303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.053398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.053486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.053573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.053658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.053744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.053834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.053924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.054013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.054100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.054185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.054268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.054357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.054441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.054522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.054605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.054689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.054774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.054861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.054946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.055028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.055111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.055195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.055278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.055373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.055460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.055543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.055627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.055710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.055792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.055874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.055957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.056041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.056124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.056207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.056291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.056395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.056483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.056570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.056653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.056737] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.056862] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.056866] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176293, lrc_seqno=176293, guc_id=0, flags=0x73 in no process [-1] <7> [565.056868] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.056936] ------------[ cut here ]------------ <4> [565.056937] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.056938] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:766/11660 <4> [565.057017] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.057082] [last unloaded: xe] <4> [565.057086] CPU: 11 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.057089] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.057090] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.057092] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.057097] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.057180] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.057181] RSP: 0000:ffffc9002542fca0 EFLAGS: 00010246 <4> [565.057184] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.057185] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.057186] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.057188] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.057189] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.057190] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [565.057192] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.057193] CR2: 00006523d19d8318 CR3: 000000000344a003 CR4: 0000000000f72ef0 <4> [565.057195] PKRU: 55555554 <4> [565.057196] Call Trace: <4> [565.057197] <TASK> <4> [565.057201] ? lock_acquire+0xa0/0x300 <4> [565.057206] ? lock_release+0xd0/0x2b0 <4> [565.057211] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.057217] process_one_work+0x239/0x740 <4> [565.057223] worker_thread+0x200/0x3f0 <4> [565.057227] ? __pfx_worker_thread+0x10/0x10 <4> [565.057229] kthread+0x10d/0x150 <4> [565.057231] ? __pfx_kthread+0x10/0x10 <4> [565.057234] ret_from_fork+0x3bd/0x470 <4> [565.057236] ? __pfx_kthread+0x10/0x10 <4> [565.057239] ret_from_fork_asm+0x1a/0x30 <4> [565.057247] </TASK> <4> [565.057248] irq event stamp: 877417 <4> [565.057249] hardirqs last enabled at (877423): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.057251] hardirqs last disabled at (877428): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.057253] softirqs last enabled at (876382): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.057256] softirqs last disabled at (876375): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.057258] ---[ end trace 0000000000000000 ]--- <5> [565.058282] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176348, lrc_seqno=176348, guc_id=0, flags=0x73 in no process [-1] <7> [565.058292] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.058451] ------------[ cut here ]------------ <4> [565.058452] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.058454] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:766/11660 <4> [565.058543] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad <7> [565.058536] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [565.058596] mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe] <4> [565.058612] CPU: 1 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.058614] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.058615] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.058616] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.058622] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.058701] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.058703] RSP: 0000:ffffc9002542fca0 EFLAGS: 00010246 <7> [565.058655] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [565.058706] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.058707] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.058708] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.058709] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.058710] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.058711] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [565.058713] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.058714] CR2: 000077dc54013008 CR3: 000000012a5e2002 CR4: 0000000000f72ef0 <4> [565.058715] PKRU: 55555554 <4> [565.058716] Call Trace: <4> [565.058717] <TASK> <4> [565.058721] ? lock_acquire+0xa0/0x300 <4> [565.058726] ? lock_release+0xd0/0x2b0 <4> [565.058730] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.058736] process_one_work+0x239/0x740 <4> [565.058742] worker_thread+0x200/0x3f0 <4> [565.058745] ? __pfx_worker_thread+0x10/0x10 <4> [565.058748] kthread+0x10d/0x150 <4> [565.058750] ? __pfx_kthread+0x10/0x10 <4> [565.058753] ret_from_fork+0x3bd/0x470 <4> [565.058755] ? __pfx_kthread+0x10/0x10 <4> [565.058757] ret_from_fork_asm+0x1a/0x30 <4> [565.058765] </TASK> <4> [565.058766] irq event stamp: 879523 <4> [565.058767] hardirqs last enabled at (879529): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.058770] hardirqs last disabled at (879534): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.058771] softirqs last enabled at (878756): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.058774] softirqs last disabled at (878693): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.058777] ---[ end trace 0000000000000000 ]--- <6> [565.058779] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.058856] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.058863] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.059115] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.059353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.059451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.059554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.059652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.059746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.059838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.059931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.060024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.060114] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.060216] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.060314] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.061407] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.071352] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.071612] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.072640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.072726] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.072811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.072899] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.072986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.073069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.073152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.073235] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.073316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.073408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.073489] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.073572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.073656] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.073738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.073819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.073900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.073981] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.074060] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.074141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.074230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.074321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.074427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.074516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.074603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.074690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.074774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.074856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.074940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.075023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.075109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.075195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.075284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.075383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.075470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.075563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.075654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.075745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.075831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.075917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.076004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.076092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.076178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.076261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.076351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.076439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.076523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.076609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.076693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.076777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.076862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.076949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.077032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.077115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.077198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.077281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.077379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.077468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.077553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.077636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.077723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.077809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.077894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.077977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.078064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.078152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.078239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.078324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.078419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.078506] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.078632] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.078636] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176348, lrc_seqno=176348, guc_id=0, flags=0x73 in no process [-1] <7> [565.078639] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.078707] ------------[ cut here ]------------ <4> [565.078708] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.078710] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:257/11151 <4> [565.078791] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.078856] [last unloaded: xe] <4> [565.078860] CPU: 0 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.078863] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.078864] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.078865] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.078871] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.078949] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.078951] RSP: 0000:ffffc9002448fca0 EFLAGS: 00010246 <4> [565.078953] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.078954] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.078956] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.078957] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.078958] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.078959] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [565.078961] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.078962] CR2: 00007b37b3102000 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [565.078964] PKRU: 55555554 <4> [565.078965] Call Trace: <4> [565.078966] <TASK> <4> [565.078970] ? lock_acquire+0xa0/0x300 <4> [565.078975] ? lock_release+0xd0/0x2b0 <4> [565.078980] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.078986] process_one_work+0x239/0x740 <4> [565.078993] worker_thread+0x200/0x3f0 <4> [565.078996] ? __pfx_worker_thread+0x10/0x10 <4> [565.078999] kthread+0x10d/0x150 <4> [565.079001] ? __pfx_kthread+0x10/0x10 <4> [565.079004] ret_from_fork+0x3bd/0x470 <4> [565.079006] ? __pfx_kthread+0x10/0x10 <4> [565.079009] ret_from_fork_asm+0x1a/0x30 <4> [565.079016] </TASK> <4> [565.079017] irq event stamp: 109719 <4> [565.079018] hardirqs last enabled at (109725): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.079020] hardirqs last disabled at (109730): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.079022] softirqs last enabled at (108864): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.079025] softirqs last disabled at (108857): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.079028] ---[ end trace 0000000000000000 ]--- <6> [565.079029] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.079107] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.079114] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.080392] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [565.080502] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [565.080613] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.080857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.080956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.081056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.081149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.081241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.081332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.081468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.081563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.081653] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.081758] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.081856] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.082895] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.093353] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.093629] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.094651] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.094738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.094821] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.094904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.094985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.095069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.095151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.095234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.095316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.095407] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.095488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.095567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.095647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.095727] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.095806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.095887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.095966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.096046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.096124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.096215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.096304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.096404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.096488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.096575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.096666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.096773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.096857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.096946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.097031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.097119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.097206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.097291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.097388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.097474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.097565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.097655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.097745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.097832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.097917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.098004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.098092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.098177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.098260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.098351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.098436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.098519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.098604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.098686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.098766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.098849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.098933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.099014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.099097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.099179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.099260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.099350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.099437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.099522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.099605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.099691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.099774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.099858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.099944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.100031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.100118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.100202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.100284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.100394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.100480] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.100605] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.100609] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176348, lrc_seqno=176348, guc_id=0, flags=0x73 in no process [-1] <7> [565.100612] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.100679] ------------[ cut here ]------------ <4> [565.100680] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.100681] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:766/11660 <4> [565.100761] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.100826] [last unloaded: xe] <4> [565.100830] CPU: 1 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.100833] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.100834] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.100835] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.100841] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.100919] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.100920] RSP: 0000:ffffc9002542fca0 EFLAGS: 00010246 <4> [565.100923] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.100924] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.100925] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.100926] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.100928] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.100929] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [565.100930] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.100932] CR2: 000077dc54013008 CR3: 000000012a5e2002 CR4: 0000000000f72ef0 <4> [565.100933] PKRU: 55555554 <4> [565.100934] Call Trace: <4> [565.100935] <TASK> <4> [565.100939] ? lock_acquire+0xa0/0x300 <4> [565.100944] ? lock_release+0xd0/0x2b0 <4> [565.100949] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.100955] process_one_work+0x239/0x740 <4> [565.100962] worker_thread+0x200/0x3f0 <4> [565.100965] ? __pfx_worker_thread+0x10/0x10 <4> [565.100967] kthread+0x10d/0x150 <4> [565.100970] ? __pfx_kthread+0x10/0x10 <4> [565.100972] ret_from_fork+0x3bd/0x470 <4> [565.100975] ? __pfx_kthread+0x10/0x10 <4> [565.100977] ret_from_fork_asm+0x1a/0x30 <4> [565.100985] </TASK> <4> [565.100986] irq event stamp: 883893 <4> [565.100987] hardirqs last enabled at (883899): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.100989] hardirqs last disabled at (883904): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.100991] softirqs last enabled at (882878): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.100994] softirqs last disabled at (882871): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.100997] ---[ end trace 0000000000000000 ]--- <5> [565.102351] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176403, lrc_seqno=176403, guc_id=0, flags=0x73 in no process [-1] <7> [565.102355] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.102429] ------------[ cut here ]------------ <4> [565.102430] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.102432] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:766/11660 <7> [565.102455] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [565.102514] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.102580] [last unloaded: xe] <4> [565.102583] CPU: 10 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.102586] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.102587] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.102589] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [565.102565] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [565.102594] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.102673] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.102674] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [565.102677] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.102678] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.102679] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.102681] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.102682] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.102683] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [565.102685] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.102686] CR2: 00007ffd308f1a88 CR3: 000000012a5e2003 CR4: 0000000000f72ef0 <4> [565.102687] PKRU: 55555554 <4> [565.102689] Call Trace: <4> [565.102690] <TASK> <4> [565.102694] ? lock_acquire+0xa0/0x300 <4> [565.102699] ? lock_release+0xd0/0x2b0 <4> [565.102704] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.102710] process_one_work+0x239/0x740 <4> [565.102716] worker_thread+0x200/0x3f0 <4> [565.102720] ? __pfx_worker_thread+0x10/0x10 <4> [565.102723] kthread+0x10d/0x150 <4> [565.102725] ? __pfx_kthread+0x10/0x10 <4> [565.102728] ret_from_fork+0x3bd/0x470 <4> [565.102730] ? __pfx_kthread+0x10/0x10 <4> [565.102733] ret_from_fork_asm+0x1a/0x30 <4> [565.102741] </TASK> <4> [565.102742] irq event stamp: 885819 <4> [565.102744] hardirqs last enabled at (885825): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.102746] hardirqs last disabled at (885830): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.102748] softirqs last enabled at (884966): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.102751] softirqs last disabled at (884961): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.102754] ---[ end trace 0000000000000000 ]--- <6> [565.102756] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.102833] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.102840] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.103042] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.103254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.103356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.103457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.103554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.103649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.103741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.103832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.103926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.104015] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.104115] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.104211] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.105250] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.115352] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.115610] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.116580] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.116668] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.116752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.116835] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.116916] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.117000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.117084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.117166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.117247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.117327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.117424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.117508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.117591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.117673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.117754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.117835] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.117914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.117994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.118072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.118159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.118249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.118338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.118449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.118539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.118624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.118707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.118789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.118872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.118954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.119038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.119129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.119219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.119306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.119406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.119499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.119589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.119680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.119767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.119858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.119947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.120033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.120117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.120200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.120285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.120382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.120467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.120549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.120631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.120713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.120796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.120883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.120969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.121054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.121138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.121221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.121306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.121401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.121484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.121565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.121653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.121739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.121825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.121909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.121991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.122075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.122158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.122255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.122337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.122446] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.122573] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.122577] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176403, lrc_seqno=176403, guc_id=0, flags=0x73 in no process [-1] <7> [565.122580] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.122650] ------------[ cut here ]------------ <4> [565.122651] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.122652] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:19/2441 <4> [565.122732] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.122798] [last unloaded: xe] <4> [565.122801] CPU: 0 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.122804] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.122805] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.122806] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.122812] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.122889] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.122890] RSP: 0000:ffffc9000405bca0 EFLAGS: 00010246 <4> [565.122893] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.122894] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.122895] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.122896] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.122898] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.122899] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [565.122901] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.122902] CR2: 00007b37b3102000 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [565.122903] PKRU: 55555554 <4> [565.122904] Call Trace: <4> [565.122906] <TASK> <4> [565.122910] ? lock_acquire+0xa0/0x300 <4> [565.122915] ? lock_release+0xd0/0x2b0 <4> [565.122919] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.122925] process_one_work+0x239/0x740 <4> [565.122932] worker_thread+0x200/0x3f0 <4> [565.122935] ? __pfx_worker_thread+0x10/0x10 <4> [565.122938] kthread+0x10d/0x150 <4> [565.122940] ? __pfx_kthread+0x10/0x10 <4> [565.122943] ret_from_fork+0x3bd/0x470 <4> [565.122945] ? __pfx_kthread+0x10/0x10 <4> [565.122948] ret_from_fork_asm+0x1a/0x30 <4> [565.122955] </TASK> <4> [565.122956] irq event stamp: 2134129 <4> [565.122957] hardirqs last enabled at (2134135): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.122959] hardirqs last disabled at (2134140): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.122961] softirqs last enabled at (2133280): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.122964] softirqs last disabled at (2133257): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.122966] ---[ end trace 0000000000000000 ]--- <6> [565.122968] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.123045] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.123052] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.124316] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [565.124441] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [565.124557] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.124772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.124870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.124972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.125068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.125161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.125255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.125359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.125456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.125546] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.125647] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.125742] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.126797] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.137351] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.137609] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.138606] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.138693] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.138777] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.138860] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.138943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.139024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.139106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.139190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.139272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.139358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.139442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.139522] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.139602] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.139682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.139761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.139841] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.139920] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.139999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.140078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.140163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.140251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.140340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.140442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.140527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.140614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.140696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.140779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.140862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.140943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.141029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.141121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.141208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.141295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.141393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.141484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.141575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.141665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.141757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.141847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.141933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.142018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.142102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.142184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.142267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.142356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.142440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.142525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.142611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.142729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.142816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.142904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.142986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.143070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.143152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.143234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.143316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.143410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.143493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.143574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.143658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.143741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.143825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.143908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.143990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.144073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.144161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.144247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.144331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.144433] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.144558] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.144562] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176403, lrc_seqno=176403, guc_id=0, flags=0x73 in no process [-1] <7> [565.144564] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.144631] ------------[ cut here ]------------ <4> [565.144633] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.144634] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:257/11151 <4> [565.144711] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.144777] [last unloaded: xe] <4> [565.144780] CPU: 1 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.144783] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.144784] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.144786] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.144791] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.144868] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.144870] RSP: 0000:ffffc9002448fca0 EFLAGS: 00010246 <4> [565.144872] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.144874] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.144875] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.144876] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.144877] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.144879] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [565.144880] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.144882] CR2: 000077dc54013008 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [565.144883] PKRU: 55555554 <4> [565.144884] Call Trace: <4> [565.144885] <TASK> <4> [565.144889] ? lock_acquire+0xa0/0x300 <4> [565.144894] ? lock_release+0xd0/0x2b0 <4> [565.144899] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.144905] process_one_work+0x239/0x740 <4> [565.144911] worker_thread+0x200/0x3f0 <4> [565.144914] ? __pfx_worker_thread+0x10/0x10 <4> [565.144917] kthread+0x10d/0x150 <4> [565.144919] ? __pfx_kthread+0x10/0x10 <4> [565.144922] ret_from_fork+0x3bd/0x470 <4> [565.144924] ? __pfx_kthread+0x10/0x10 <4> [565.144927] ret_from_fork_asm+0x1a/0x30 <4> [565.144934] </TASK> <4> [565.144935] irq event stamp: 113287 <4> [565.144937] hardirqs last enabled at (113293): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.144939] hardirqs last disabled at (113298): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.144940] softirqs last enabled at (112438): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.144943] softirqs last disabled at (112427): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.144945] ---[ end trace 0000000000000000 ]--- <5> [565.146168] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176458, lrc_seqno=176458, guc_id=0, flags=0x73 in no process [-1] <7> [565.146172] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.146245] ------------[ cut here ]------------ <4> [565.146246] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.146248] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:257/11151 <4> [565.146330] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg <7> [565.146281] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [565.146338] mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe] <4> [565.146409] CPU: 4 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.146413] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.146414] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.146415] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [565.146406] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [565.146421] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.146501] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.146503] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [565.146505] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.146506] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.146508] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.146509] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.146510] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.146511] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [565.146513] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.146515] CR2: 00006523d19dc038 CR3: 000000012a5e2003 CR4: 0000000000f72ef0 <4> [565.146516] PKRU: 55555554 <4> [565.146517] Call Trace: <4> [565.146518] <TASK> <4> [565.146522] ? lock_acquire+0xa0/0x300 <4> [565.146528] ? lock_release+0xd0/0x2b0 <4> [565.146532] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.146538] process_one_work+0x239/0x740 <4> [565.146547] worker_thread+0x200/0x3f0 <4> [565.146550] ? __pfx_worker_thread+0x10/0x10 <4> [565.146553] kthread+0x10d/0x150 <4> [565.146555] ? __pfx_kthread+0x10/0x10 <4> [565.146558] ret_from_fork+0x3bd/0x470 <4> [565.146560] ? __pfx_kthread+0x10/0x10 <4> [565.146562] ret_from_fork_asm+0x1a/0x30 <4> [565.146570] </TASK> <4> [565.146571] irq event stamp: 115871 <4> [565.146573] hardirqs last enabled at (115877): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.146575] hardirqs last disabled at (115882): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.146577] softirqs last enabled at (115196): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.146579] softirqs last disabled at (115189): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.146582] ---[ end trace 0000000000000000 ]--- <6> [565.146584] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.146663] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.146669] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.146839] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.147052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.147149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.147248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.147730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.147831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.147929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.148024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.148118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.148206] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.148307] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.148415] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.149459] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.159349] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.159607] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.160617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.160702] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.160786] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.160873] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.160958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.161039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.161120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.161199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.161278] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.161362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.161443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.161526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.161609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.161692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.161773] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.161855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.161939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.162021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.162102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.162190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.162278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.162371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.162458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.162543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.162627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.162710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.162792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.162873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.162959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.163048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.163135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.163220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.163307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.163399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.163490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.163580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.163672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.163760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.163850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.163935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.164019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.164102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.164184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.164268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.164354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.164439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.164526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.164612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.164695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.164780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.164866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.164954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.165042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.165127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.165210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.165295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.165396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.165479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.165566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.165655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.165740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.165825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.165909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.165991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.166074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.166157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.166238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.166319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.166437] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.166560] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.166564] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176458, lrc_seqno=176458, guc_id=0, flags=0x73 in no process [-1] <7> [565.166567] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.166636] ------------[ cut here ]------------ <4> [565.166637] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.166638] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:257/11151 <4> [565.166719] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.166783] [last unloaded: xe] <4> [565.166787] CPU: 4 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.166790] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.166792] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.166793] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.166799] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.166877] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.166879] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [565.166881] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.166883] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.166885] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.166886] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.166888] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.166889] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [565.166891] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.166893] CR2: 00006523d19dc038 CR3: 000000012a5e2003 CR4: 0000000000f72ef0 <4> [565.166895] PKRU: 55555554 <4> [565.166896] Call Trace: <4> [565.166897] <TASK> <4> [565.166901] ? lock_acquire+0xa0/0x300 <4> [565.166907] ? lock_release+0xd0/0x2b0 <4> [565.166912] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.166918] process_one_work+0x239/0x740 <4> [565.166925] worker_thread+0x200/0x3f0 <4> [565.166928] ? __pfx_worker_thread+0x10/0x10 <4> [565.166931] kthread+0x10d/0x150 <4> [565.166933] ? __pfx_kthread+0x10/0x10 <4> [565.166937] ret_from_fork+0x3bd/0x470 <4> [565.166939] ? __pfx_kthread+0x10/0x10 <4> [565.166942] ret_from_fork_asm+0x1a/0x30 <4> [565.166950] </TASK> <4> [565.166951] irq event stamp: 119039 <4> [565.166953] hardirqs last enabled at (119045): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.166955] hardirqs last disabled at (119050): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.166957] softirqs last enabled at (118190): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.166960] softirqs last disabled at (118179): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.166963] ---[ end trace 0000000000000000 ]--- <6> [565.166965] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.167041] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.167046] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.168286] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [565.168403] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [565.168515] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.168733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.168833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.168935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.169032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.169125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.169222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.169318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.169423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.169515] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.169617] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.169715] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.170753] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.181349] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.181628] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.182666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.182752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.182835] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.182917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.183002] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.183085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.183167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.183247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.183330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.183425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.183510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.183594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.183676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.183757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.183836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.183916] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.183996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.184075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.184153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.184238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.184325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.184421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.184505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.184590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.184674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.184762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.184847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.184931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.185013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.185098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.185186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.185271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.185358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.185452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.185543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.185635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.185727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.185814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.185902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.185990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.186076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.186159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.186241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.186328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.186429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.186516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.186601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.186685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.186766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.186849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.186934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.187017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.187100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.187183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.187265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.187352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.187436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.187521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.187607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.187695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.187779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.187863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.187946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.188029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.188113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.188202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.188288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.188377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.188463] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.188602] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.188607] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176458, lrc_seqno=176458, guc_id=0, flags=0x73 in no process [-1] <7> [565.188609] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.188677] ------------[ cut here ]------------ <4> [565.188678] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.188679] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:19/2441 <4> [565.188757] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.188835] [last unloaded: xe] <4> [565.188839] CPU: 10 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.188842] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.188844] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.188846] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.188852] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.188928] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.188931] RSP: 0018:ffffc9000405bca0 EFLAGS: 00010246 <4> [565.188933] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.188935] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.188936] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.188938] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.188939] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.188941] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [565.188942] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.188944] CR2: 00007ffd308f1a88 CR3: 000000012a5e2003 CR4: 0000000000f72ef0 <4> [565.188946] PKRU: 55555554 <4> [565.188947] Call Trace: <4> [565.188948] <TASK> <4> [565.188952] ? lock_acquire+0xa0/0x300 <4> [565.188958] ? lock_release+0xd0/0x2b0 <4> [565.188963] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.188969] process_one_work+0x239/0x740 <4> [565.188976] worker_thread+0x200/0x3f0 <4> [565.188979] ? __pfx_worker_thread+0x10/0x10 <4> [565.188982] kthread+0x10d/0x150 <4> [565.188984] ? __pfx_kthread+0x10/0x10 <4> [565.188987] ret_from_fork+0x3bd/0x470 <4> [565.188989] ? __pfx_kthread+0x10/0x10 <4> [565.188992] ret_from_fork_asm+0x1a/0x30 <4> [565.189000] </TASK> <4> [565.189001] irq event stamp: 2138685 <4> [565.189002] hardirqs last enabled at (2138691): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.189004] hardirqs last disabled at (2138696): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.189006] softirqs last enabled at (2137752): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.189009] softirqs last disabled at (2137745): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.189011] ---[ end trace 0000000000000000 ]--- <5> [565.190358] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176513, lrc_seqno=176513, guc_id=0, flags=0x73 in no process [-1] <7> [565.190362] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [565.190366] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [565.190438] ------------[ cut here ]------------ <4> [565.190439] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.190440] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:257/11151 <4> [565.190524] Modules linked in: snd_hda_intel xe <7> [565.190477] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [565.190528] snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe] <4> [565.190595] CPU: 4 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.190598] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.190599] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.190601] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.190607] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.190686] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.190688] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [565.190690] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.190692] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.190693] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.190694] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.190695] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.190697] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [565.190698] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.190700] CR2: 00006523d19dc038 CR3: 000000012a5e2003 CR4: 0000000000f72ef0 <4> [565.190701] PKRU: 55555554 <4> [565.190702] Call Trace: <4> [565.190703] <TASK> <4> [565.190708] ? lock_acquire+0xa0/0x300 <4> [565.190713] ? lock_release+0xd0/0x2b0 <4> [565.190717] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.190723] process_one_work+0x239/0x740 <4> [565.190730] worker_thread+0x200/0x3f0 <4> [565.190733] ? __pfx_worker_thread+0x10/0x10 <4> [565.190736] kthread+0x10d/0x150 <4> [565.190738] ? __pfx_kthread+0x10/0x10 <4> [565.190741] ret_from_fork+0x3bd/0x470 <4> [565.190743] ? __pfx_kthread+0x10/0x10 <4> [565.190746] ret_from_fork_asm+0x1a/0x30 <4> [565.190754] </TASK> <4> [565.190755] irq event stamp: 120719 <4> [565.190756] hardirqs last enabled at (120725): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.190758] hardirqs last disabled at (120730): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.190760] softirqs last enabled at (119902): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.190763] softirqs last disabled at (119897): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.190765] ---[ end trace 0000000000000000 ]--- <6> [565.190767] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.190845] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.190851] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.190914] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.191135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.191237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.191339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.191478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.191578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.191672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.191765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.191858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.191947] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.192052] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.192149] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.193192] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.203349] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.203631] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.204674] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.204761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.204845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.204930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.205017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.205104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.205187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.205270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.205357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.205440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.205522] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.205604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.205686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.205767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.205848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.205931] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.206015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.206097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.206179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.206266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.206357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.206444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.206530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.206617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.206704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.206792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.206876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.206959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.207042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.207127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.207213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.207298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.207392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.207482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.207575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.207667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.207758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.207846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.207932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.208017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.208100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.208184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.208268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.208356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.208441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.208528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.208616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.208702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.208785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.208870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.208957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.209040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.209129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.209214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.209298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.209391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.209476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.209559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.209642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.209727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.209811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.209899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.209984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.210068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.210154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.210238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.210320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.210409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.210494] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.210616] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.210620] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176513, lrc_seqno=176513, guc_id=0, flags=0x73 in no process [-1] <7> [565.210622] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.210691] ------------[ cut here ]------------ <4> [565.210692] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.210693] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:766/11660 <4> [565.210772] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.210849] [last unloaded: xe] <4> [565.210853] CPU: 8 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.210856] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.210857] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.210859] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.210865] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.210945] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.210947] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [565.210950] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.210952] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.210953] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.210954] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.210956] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.210958] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [565.210959] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.210961] CR2: 0000796064a5e058 CR3: 0000000114e50004 CR4: 0000000000f72ef0 <4> [565.210963] PKRU: 55555554 <4> [565.210964] Call Trace: <4> [565.210966] <TASK> <4> [565.210970] ? lock_acquire+0xa0/0x300 <4> [565.210975] ? lock_release+0xd0/0x2b0 <4> [565.210980] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.210986] process_one_work+0x239/0x740 <4> [565.210993] worker_thread+0x200/0x3f0 <4> [565.210997] ? __pfx_worker_thread+0x10/0x10 <4> [565.211000] kthread+0x10d/0x150 <4> [565.211002] ? __pfx_kthread+0x10/0x10 <4> [565.211005] ret_from_fork+0x3bd/0x470 <4> [565.211008] ? __pfx_kthread+0x10/0x10 <4> [565.211011] ret_from_fork_asm+0x1a/0x30 <4> [565.211018] </TASK> <4> [565.211020] irq event stamp: 895915 <4> [565.211021] hardirqs last enabled at (895921): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.211023] hardirqs last disabled at (895926): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.211025] softirqs last enabled at (894982): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.211027] softirqs last disabled at (894975): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.211030] ---[ end trace 0000000000000000 ]--- <6> [565.211032] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.211112] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.211118] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.212418] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [565.212529] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [565.212640] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.212850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.212944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.213043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.213138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.213234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.213328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.213435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.213529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.213617] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.213716] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.213810] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.214843] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.225350] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.225614] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.226564] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.226649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.226731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.226813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.226894] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.226974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.227056] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.227136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.227216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.227298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.227387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.227467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.227545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.227623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.227701] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.227779] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.227857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.227935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.228013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.228097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.228185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.228275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.228365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.228452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.228536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.228618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.228700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.228785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.228872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.228960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.229048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.229133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.229219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.229305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.229406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.229496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.229587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.229678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.229766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.229850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.229934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.230016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.230097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.230182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.230266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.230353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.230458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.230540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.230625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.230714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.230802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.230885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.230967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.231050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.231131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.231214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.231298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.231387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.231469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.231553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.231634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.231717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.231797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.231878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.231962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.232045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.232127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.232208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.232291] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.232417] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.232421] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176513, lrc_seqno=176513, guc_id=0, flags=0x73 in no process [-1] <7> [565.232424] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.232491] ------------[ cut here ]------------ <4> [565.232492] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.232493] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:766/11660 <4> [565.232572] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.232638] [last unloaded: xe] <4> [565.232641] CPU: 8 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.232643] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.232645] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.232646] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.232652] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.232731] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.232733] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [565.232735] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.232737] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.232738] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.232739] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.232740] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.232742] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [565.232743] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.232745] CR2: 0000796064a5e058 CR3: 0000000114e50004 CR4: 0000000000f72ef0 <4> [565.232746] PKRU: 55555554 <4> [565.232747] Call Trace: <4> [565.232748] <TASK> <4> [565.232752] ? lock_acquire+0xa0/0x300 <4> [565.232757] ? lock_release+0xd0/0x2b0 <4> [565.232762] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.232768] process_one_work+0x239/0x740 <4> [565.232774] worker_thread+0x200/0x3f0 <4> [565.232778] ? __pfx_worker_thread+0x10/0x10 <4> [565.232780] kthread+0x10d/0x150 <4> [565.232783] ? __pfx_kthread+0x10/0x10 <4> [565.232785] ret_from_fork+0x3bd/0x470 <4> [565.232788] ? __pfx_kthread+0x10/0x10 <4> [565.232791] ret_from_fork_asm+0x1a/0x30 <4> [565.232798] </TASK> <4> [565.232800] irq event stamp: 899107 <4> [565.232801] hardirqs last enabled at (899113): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.232803] hardirqs last disabled at (899118): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.232805] softirqs last enabled at (898186): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.232808] softirqs last disabled at (898179): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.232811] ---[ end trace 0000000000000000 ]--- <5> [565.233860] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176568, lrc_seqno=176568, guc_id=0, flags=0x73 in no process [-1] <7> [565.233868] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.234052] ------------[ cut here ]------------ <4> [565.234054] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.234056] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:766/11660 <4> [565.234202] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.234267] [last unloaded: xe] <4> [565.234271] CPU: 5 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.234274] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.234275] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.234276] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.234282] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <7> [565.234295] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [565.234398] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.234400] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [565.234404] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.234406] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.234410] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.234412] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.234414] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.234417] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [565.234420] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.234422] CR2: 000062466a74b198 CR3: 0000000114e50005 CR4: 0000000000f72ef0 <4> [565.234424] PKRU: 55555554 <4> [565.234426] Call Trace: <4> [565.234427] <TASK> <4> [565.234435] ? lock_acquire+0xa0/0x300 <4> [565.234443] ? lock_release+0xd0/0x2b0 <4> [565.234452] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.234463] process_one_work+0x239/0x740 <7> [565.234415] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [565.234475] worker_thread+0x200/0x3f0 <4> [565.234480] ? __pfx_worker_thread+0x10/0x10 <4> [565.234484] kthread+0x10d/0x150 <4> [565.234486] ? __pfx_kthread+0x10/0x10 <4> [565.234489] ret_from_fork+0x3bd/0x470 <4> [565.234491] ? __pfx_kthread+0x10/0x10 <4> [565.234493] ret_from_fork_asm+0x1a/0x30 <4> [565.234501] </TASK> <4> [565.234502] irq event stamp: 901029 <4> [565.234503] hardirqs last enabled at (901035): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.234505] hardirqs last disabled at (901040): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.234506] softirqs last enabled at (898186): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.234509] softirqs last disabled at (898179): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.234511] ---[ end trace 0000000000000000 ]--- <6> [565.234513] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.234597] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.234605] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.234653] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.234871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.234969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.235071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.235166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.235262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.235368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.235490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.235591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.235683] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.235792] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.235889] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.236944] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.247361] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.247626] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.248692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.248803] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.248890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.248976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.249061] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.249147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.249231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.249315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.249417] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.249513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.249597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.249679] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.249759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.249841] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.249922] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.250001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.250080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.250161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.250241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.250328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.250458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.250564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.250649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.250735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.250821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.250906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.250993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.251081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.251168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.251256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.251350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.251459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.251547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.251633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.251724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.251816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.251907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.251999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.252090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.252177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.252263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.252356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.252450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.252541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.252630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.252716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.252801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.252884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.252967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.253050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.253136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.253218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.253300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.253397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.253496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.253584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.253669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.253751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.253834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.253919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.254002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.254084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.254166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.254249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.254332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.254432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.254526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.254609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.254699] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.254827] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.254832] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176568, lrc_seqno=176568, guc_id=0, flags=0x73 in no process [-1] <7> [565.254835] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.254902] ------------[ cut here ]------------ <4> [565.254904] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.254905] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:766/11660 <4> [565.254985] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.255061] [last unloaded: xe] <4> [565.255064] CPU: 5 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.255067] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.255069] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.255070] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.255076] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.255154] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.255156] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [565.255158] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.255160] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.255161] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.255162] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.255163] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.255165] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [565.255166] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.255168] CR2: 000062466a74b198 CR3: 0000000114e50005 CR4: 0000000000f72ef0 <4> [565.255169] PKRU: 55555554 <4> [565.255170] Call Trace: <4> [565.255172] <TASK> <4> [565.255175] ? lock_acquire+0xa0/0x300 <4> [565.255181] ? lock_release+0xd0/0x2b0 <4> [565.255186] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.255192] process_one_work+0x239/0x740 <4> [565.255199] worker_thread+0x200/0x3f0 <4> [565.255202] ? __pfx_worker_thread+0x10/0x10 <4> [565.255205] kthread+0x10d/0x150 <4> [565.255207] ? __pfx_kthread+0x10/0x10 <4> [565.255210] ret_from_fork+0x3bd/0x470 <4> [565.255212] ? __pfx_kthread+0x10/0x10 <4> [565.255215] ret_from_fork_asm+0x1a/0x30 <4> [565.255223] </TASK> <4> [565.255224] irq event stamp: 904209 <4> [565.255225] hardirqs last enabled at (904215): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.255227] hardirqs last disabled at (904220): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.255229] softirqs last enabled at (903340): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.255232] softirqs last disabled at (903335): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.255235] ---[ end trace 0000000000000000 ]--- <6> [565.255745] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.255874] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.255887] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.256379] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [565.256493] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [565.256605] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.256820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.256920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.257024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.257123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.257221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.257315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.257417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.257513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.257603] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.257704] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.257802] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.258850] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.269350] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.269620] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.270734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.270877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.271005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.271134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.271261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.271401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.271538] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.271622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.271701] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.271778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.271857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.271934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.272008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.272081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.272155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.272228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.272300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.272389] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.272474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.272561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.272653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.272733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.272811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.272891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.272971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.273051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.273130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.273207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.273283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.273383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.273477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.273557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.273634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.273711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.273793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.273875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.273962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.274044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.274125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.274201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.274281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.274362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.274447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.274532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.274618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.274703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.274785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.274866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.274946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.275032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.275122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.275206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.275290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.275400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.275483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.275568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.275649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.275729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.275814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.275901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.275984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.276067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.276148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.276228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.276308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.276396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.276477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.276562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.276649] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.276771] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.276775] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176568, lrc_seqno=176568, guc_id=0, flags=0x73 in no process [-1] <7> [565.276778] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.276845] ------------[ cut here ]------------ <4> [565.276847] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.276848] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:766/11660 <4> [565.276928] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.277007] [last unloaded: xe] <4> [565.277011] CPU: 4 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.277014] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.277016] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.277018] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.277024] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.277103] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.277105] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [565.277107] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.277109] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.277110] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.277112] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.277113] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.277115] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [565.277117] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.277118] CR2: 00006523d19dc038 CR3: 000000012a5e2003 CR4: 0000000000f72ef0 <4> [565.277120] PKRU: 55555554 <4> [565.277121] Call Trace: <4> [565.277123] <TASK> <4> [565.277127] ? lock_acquire+0xa0/0x300 <4> [565.277132] ? lock_release+0xd0/0x2b0 <4> [565.277137] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.277143] process_one_work+0x239/0x740 <4> [565.277150] worker_thread+0x200/0x3f0 <4> [565.277153] ? __pfx_worker_thread+0x10/0x10 <4> [565.277156] kthread+0x10d/0x150 <4> [565.277158] ? __pfx_kthread+0x10/0x10 <4> [565.277573] ret_from_fork+0x3bd/0x470 <4> [565.277576] ? __pfx_kthread+0x10/0x10 <4> [565.277579] ret_from_fork_asm+0x1a/0x30 <4> [565.277593] </TASK> <4> [565.277596] irq event stamp: 907379 <4> [565.277598] hardirqs last enabled at (907385): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.277602] hardirqs last disabled at (907390): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.277605] softirqs last enabled at (906508): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.277608] softirqs last disabled at (906503): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.277611] ---[ end trace 0000000000000000 ]--- <5> [565.278702] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176623, lrc_seqno=176623, guc_id=0, flags=0x73 in no process [-1] <7> [565.278708] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.278820] ------------[ cut here ]------------ <4> [565.278822] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.278823] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:19/2441 <4> [565.278910] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec <7> [565.278867] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [565.278924] drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe] <4> [565.278981] CPU: 8 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.278984] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.278985] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.278987] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [565.278983] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [565.278993] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.279077] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.279079] RSP: 0018:ffffc9000405bca0 EFLAGS: 00010246 <4> [565.279081] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.279082] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.279083] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.279084] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.279085] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.279086] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [565.279089] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.279090] CR2: 0000796064a5e058 CR3: 000000012a5e2005 CR4: 0000000000f72ef0 <4> [565.279092] PKRU: 55555554 <4> [565.279093] Call Trace: <4> [565.279094] <TASK> <4> [565.279098] ? lock_acquire+0xa0/0x300 <4> [565.279104] ? lock_release+0xd0/0x2b0 <4> [565.279108] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.279115] process_one_work+0x239/0x740 <4> [565.279122] worker_thread+0x200/0x3f0 <4> [565.279125] ? __pfx_worker_thread+0x10/0x10 <4> [565.279127] kthread+0x10d/0x150 <4> [565.279130] ? __pfx_kthread+0x10/0x10 <4> [565.279133] ret_from_fork+0x3bd/0x470 <4> [565.279135] ? __pfx_kthread+0x10/0x10 <4> [565.279137] ret_from_fork_asm+0x1a/0x30 <4> [565.279145] </TASK> <4> [565.279147] irq event stamp: 2142287 <4> [565.279148] hardirqs last enabled at (2142293): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.279150] hardirqs last disabled at (2142298): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.279152] softirqs last enabled at (2140774): [<ffffffff8133abd3>] kernel_fpu_end+0x53/0x70 <4> [565.279154] softirqs last disabled at (2140772): [<ffffffff8133b2e4>] kernel_fpu_begin_mask+0xc4/0x120 <4> [565.279157] ---[ end trace 0000000000000000 ]--- <6> [565.279159] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.279242] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.279249] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.279472] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.279691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.279793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.279897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.280000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.280101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.280200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.280298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.280405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.280499] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.280606] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.280709] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.281764] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.292349] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.292613] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.293639] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.293731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.293822] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.293912] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.294001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.294089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.294176] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.294262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.294350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.294438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.294523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.294612] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.294700] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.294787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.294874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.294958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.295044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.295128] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.295213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.295304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.295407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.295503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.295594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.295685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.295777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.295866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.295955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.296044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.296132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.296228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.296324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.296426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.296519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.296611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.296708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.296809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.296908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.297001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.297093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.297184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.297274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.297367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.297461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.297554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.297646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.297736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.297825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.297915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.298002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.298090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.298182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.298269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.298366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.298459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.298550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.298641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.298731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.298818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.298906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.298997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.299085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.299175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.299269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.299386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.299478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.299567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.299655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.299742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.299832] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.299958] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.299962] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176623, lrc_seqno=176623, guc_id=0, flags=0x73 in no process [-1] <7> [565.299965] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.300036] ------------[ cut here ]------------ <4> [565.300037] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.300039] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:19/2441 <4> [565.300122] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.300186] [last unloaded: xe] <4> [565.300189] CPU: 8 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.300192] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.300194] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.300195] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.300201] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.300285] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.300287] RSP: 0018:ffffc9000405bca0 EFLAGS: 00010246 <4> [565.300289] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.300291] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.300292] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.300293] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.300294] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.300296] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [565.300297] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.300299] CR2: 0000796064a5e058 CR3: 000000012a5e2005 CR4: 0000000000f72ef0 <4> [565.300300] PKRU: 55555554 <4> [565.300301] Call Trace: <4> [565.300302] <TASK> <4> [565.300306] ? lock_acquire+0xa0/0x300 <4> [565.300311] ? lock_release+0xd0/0x2b0 <4> [565.300316] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.300322] process_one_work+0x239/0x740 <4> [565.300328] worker_thread+0x200/0x3f0 <4> [565.300332] ? __pfx_worker_thread+0x10/0x10 <4> [565.300334] kthread+0x10d/0x150 <4> [565.300336] ? __pfx_kthread+0x10/0x10 <4> [565.300343] ret_from_fork+0x3bd/0x470 <4> [565.300345] ? __pfx_kthread+0x10/0x10 <4> [565.300348] ret_from_fork_asm+0x1a/0x30 <4> [565.300356] </TASK> <4> [565.300357] irq event stamp: 2145463 <4> [565.300359] hardirqs last enabled at (2145469): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.300361] hardirqs last disabled at (2145474): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.300363] softirqs last enabled at (2145438): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.300390] softirqs last disabled at (2145433): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.300393] ---[ end trace 0000000000000000 ]--- <6> [565.300395] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.300480] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.300487] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.301756] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [565.301879] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [565.301997] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.302214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.302336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.302451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.302550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.302644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.302739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.302833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.302926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.303013] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.303114] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.303210] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.304246] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.314349] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.314607] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.315631] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.315718] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.315802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.315886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.315967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.316046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.316127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.316206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.316285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.316371] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.316451] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.316531] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.316609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.316690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.316772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.316852] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.316931] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.317010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.317089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.317175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.317266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.317357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.317442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.317526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.317610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.317691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.317771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.317853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.317934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.318017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.318101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.318184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.318269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.318361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.318455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.318547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.318639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.318726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.318811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.318893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.318977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.319062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.319144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.319232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.319318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.319409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.319493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.319575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.319659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.319744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.319831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.319914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.319997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.320080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.320163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.320246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.320329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.320424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.320511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.320602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.320688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.320776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.320861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.320945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.321029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.321112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.321194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.321275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.321362] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.321483] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.321487] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176623, lrc_seqno=176623, guc_id=0, flags=0x73 in no process [-1] <7> [565.321489] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.321559] ------------[ cut here ]------------ <4> [565.321560] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.321561] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:766/11660 <4> [565.321641] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.321711] [last unloaded: xe] <4> [565.321715] CPU: 10 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.321718] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.321720] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.321721] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.321728] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.321805] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.321807] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [565.321810] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.321812] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.321813] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.321815] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.321816] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.321818] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [565.321820] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.321821] CR2: 00007ffd308f1a88 CR3: 000000012a5e2003 CR4: 0000000000f72ef0 <4> [565.321823] PKRU: 55555554 <4> [565.321824] Call Trace: <4> [565.321826] <TASK> <4> [565.321830] ? lock_acquire+0xa0/0x300 <4> [565.321835] ? lock_release+0xd0/0x2b0 <4> [565.321840] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.321847] process_one_work+0x239/0x740 <4> [565.321854] worker_thread+0x200/0x3f0 <4> [565.321857] ? __pfx_worker_thread+0x10/0x10 <4> [565.321860] kthread+0x10d/0x150 <4> [565.321863] ? __pfx_kthread+0x10/0x10 <4> [565.321866] ret_from_fork+0x3bd/0x470 <4> [565.321868] ? __pfx_kthread+0x10/0x10 <4> [565.321871] ret_from_fork_asm+0x1a/0x30 <4> [565.321879] </TASK> <4> [565.321880] irq event stamp: 912819 <4> [565.321881] hardirqs last enabled at (912825): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.321884] hardirqs last disabled at (912830): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.321886] softirqs last enabled at (911818): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.321889] softirqs last disabled at (911811): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.321892] ---[ end trace 0000000000000000 ]--- <5> [565.323013] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176678, lrc_seqno=176678, guc_id=0, flags=0x73 in no process [-1] <7> [565.323016] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.323088] ------------[ cut here ]------------ <4> [565.323089] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.323090] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:766/11660 <4> [565.323170] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.323234] [last unloaded: xe] <4> [565.323237] CPU: 10 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.323240] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.323241] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.323242] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.323247] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.323324] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.323325] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [565.323327] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.323329] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.323330] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.323331] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.323332] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.323333] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [565.323335] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.323336] CR2: 00007ffd308f1a88 CR3: 000000012a5e2003 CR4: 0000000000f72ef0 <4> [565.323338] PKRU: 55555554 <4> [565.323339] Call Trace: <4> [565.323346] <TASK> <4> [565.323350] ? lock_acquire+0xa0/0x300 <4> [565.323355] ? lock_release+0xd0/0x2b0 <4> [565.323360] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.323366] process_one_work+0x239/0x740 <4> [565.323372] worker_thread+0x200/0x3f0 <4> [565.323375] ? __pfx_worker_thread+0x10/0x10 <4> [565.323378] kthread+0x10d/0x150 <4> [565.323380] ? __pfx_kthread+0x10/0x10 <4> [565.323383] ret_from_fork+0x3bd/0x470 <4> [565.323385] ? __pfx_kthread+0x10/0x10 <4> [565.323388] ret_from_fork_asm+0x1a/0x30 <4> [565.323396] </TASK> <4> [565.323397] irq event stamp: 914563 <4> [565.323398] hardirqs last enabled at (914569): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.323400] hardirqs last disabled at (914574): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.323402] softirqs last enabled at (914480): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.323405] softirqs last disabled at (914469): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.323407] ---[ end trace 0000000000000000 ]--- <7> [565.323422] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [565.323534] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [565.323639] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.323716] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.323722] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.323772] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.323992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.324093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.324195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.324299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.324452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.324551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.324649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.324746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.324838] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.324940] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.325036] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.326097] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.336354] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.336618] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.337644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.337732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.337815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.337898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.337980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.338063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.338147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.338229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.338310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.338403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.338499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.338581] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.338661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.338743] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.338827] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.338909] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.338990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.339070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.339149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.339237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.339325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.339450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.339560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.339650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.339736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.339820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.339903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.339986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.340069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.340153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.340240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.340326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.340429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.340530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.340622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.340717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.340810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.340897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.340982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.341065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.341149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.341231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.341311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.341406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.341506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.341591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.341674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.341756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.341837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.341919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.342006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.342093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.342179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.342263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.342352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.342478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.342564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.342649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.342734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.342821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.342904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.342989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.343071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.343153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.343237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.343320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.343421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.343524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.343615] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.343737] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.343742] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176678, lrc_seqno=176678, guc_id=0, flags=0x73 in no process [-1] <7> [565.343744] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.343812] ------------[ cut here ]------------ <4> [565.343814] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.343815] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:257/11151 <4> [565.343894] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.343971] [last unloaded: xe] <4> [565.343975] CPU: 0 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.343978] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.343980] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.343981] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.343988] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.344067] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.344068] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [565.344071] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.344072] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.344074] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.344075] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.344076] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.344078] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [565.344079] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.344081] CR2: 00007b37b3102000 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [565.344082] PKRU: 55555554 <4> [565.344083] Call Trace: <4> [565.344085] <TASK> <4> [565.344089] ? lock_acquire+0xa0/0x300 <4> [565.344094] ? lock_release+0xd0/0x2b0 <4> [565.344099] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.344105] process_one_work+0x239/0x740 <4> [565.344112] worker_thread+0x200/0x3f0 <4> [565.344115] ? __pfx_worker_thread+0x10/0x10 <4> [565.344118] kthread+0x10d/0x150 <4> [565.344120] ? __pfx_kthread+0x10/0x10 <4> [565.344123] ret_from_fork+0x3bd/0x470 <4> [565.344125] ? __pfx_kthread+0x10/0x10 <4> [565.344128] ret_from_fork_asm+0x1a/0x30 <4> [565.344136] </TASK> <4> [565.344137] irq event stamp: 128605 <4> [565.344138] hardirqs last enabled at (128611): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.344140] hardirqs last disabled at (128616): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.344142] softirqs last enabled at (127744): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.344145] softirqs last disabled at (127723): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.344148] ---[ end trace 0000000000000000 ]--- <6> [565.344150] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.344229] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.344235] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.345531] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [565.345644] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [565.345757] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.345971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.346067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.346167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.346261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.346357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.346449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.346542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.346635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.346724] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.346825] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.346922] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.347995] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.358702] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.358953] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.359876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.359958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.360037] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.360114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.360189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.360262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.360335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.360442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.360521] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.360602] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.360683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.360768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.360853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.360936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.361017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.361099] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.361181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.361262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.361350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.361446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.361542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.361629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.361714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.361801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.361889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.361973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.362056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.362138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.362223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.362312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.362411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.362497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.362582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.362667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.362756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.362845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.362935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.363027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.363117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.363203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.363289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.363382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.363465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.363549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.363633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.363715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.363798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.363880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.363961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.364043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.364128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.364210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.364292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.364392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.364475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.364564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.364653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.364738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.364821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.364907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.364990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.365074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.365161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.365247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.365333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.365435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.365518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.365600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.365686] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.365815] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.365820] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176678, lrc_seqno=176678, guc_id=0, flags=0x73 in no process [-1] <7> [565.365823] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.365891] ------------[ cut here ]------------ <4> [565.365893] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.365895] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:19/2441 <4> [565.365974] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.366044] [last unloaded: xe] <4> [565.366048] CPU: 9 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.366051] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.366052] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.366054] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.366060] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.366139] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.366140] RSP: 0018:ffffc9000405bca0 EFLAGS: 00010246 <4> [565.366143] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.366144] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.366145] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.366147] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.366148] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.366149] FS: 0000000000000000(0000) GS:ffff8888db103000(0000) knlGS:0000000000000000 <4> [565.366151] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.366152] CR2: 000062466a751008 CR3: 000000000344a003 CR4: 0000000000f72ef0 <4> [565.366154] PKRU: 55555554 <4> [565.366155] Call Trace: <4> [565.366156] <TASK> <4> [565.366160] ? lock_acquire+0xa0/0x300 <4> [565.366165] ? lock_release+0xd0/0x2b0 <4> [565.366170] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.366177] process_one_work+0x239/0x740 <4> [565.366186] worker_thread+0x200/0x3f0 <4> [565.366189] ? __pfx_worker_thread+0x10/0x10 <4> [565.366192] kthread+0x10d/0x150 <4> [565.366194] ? __pfx_kthread+0x10/0x10 <4> [565.366197] ret_from_fork+0x3bd/0x470 <4> [565.366199] ? __pfx_kthread+0x10/0x10 <4> [565.366202] ret_from_fork_asm+0x1a/0x30 <4> [565.366210] </TASK> <4> [565.366211] irq event stamp: 2148961 <4> [565.366212] hardirqs last enabled at (2148967): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.366215] hardirqs last disabled at (2148972): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.366216] softirqs last enabled at (2148092): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.366219] softirqs last disabled at (2148081): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.366222] ---[ end trace 0000000000000000 ]--- <7> [565.367292] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [565.367463] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [565.367912] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176733, lrc_seqno=176733, guc_id=0, flags=0x73 in no process [-1] <7> [565.367919] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.368035] ------------[ cut here ]------------ <4> [565.368037] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.368039] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#12: kworker/u64:766/11660 <4> [565.368163] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.368257] [last unloaded: xe] <4> [565.368261] CPU: 12 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.368265] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.368267] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.368269] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.368277] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.368409] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.368412] RSP: 0000:ffffc9002542fca0 EFLAGS: 00010246 <4> [565.368415] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.368417] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.368419] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.368421] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.368423] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.368425] FS: 0000000000000000(0000) GS:ffff8888db283000(0000) knlGS:0000000000000000 <4> [565.368427] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.368429] CR2: 000073eeb00813b8 CR3: 000000012a5e2006 CR4: 0000000000f72ef0 <4> [565.368431] PKRU: 55555554 <4> [565.368433] Call Trace: <4> [565.368434] <TASK> <4> [565.368441] ? lock_acquire+0xa0/0x300 <4> [565.368449] ? lock_release+0xd0/0x2b0 <4> [565.368457] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.368467] process_one_work+0x239/0x740 <4> [565.368478] worker_thread+0x200/0x3f0 <4> [565.368482] ? __pfx_worker_thread+0x10/0x10 <4> [565.368486] kthread+0x10d/0x150 <4> [565.368489] ? __pfx_kthread+0x10/0x10 <4> [565.368493] ret_from_fork+0x3bd/0x470 <4> [565.368496] ? __pfx_kthread+0x10/0x10 <4> [565.368500] ret_from_fork_asm+0x1a/0x30 <4> [565.368513] </TASK> <4> [565.368514] irq event stamp: 916241 <4> [565.368516] hardirqs last enabled at (916247): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.368519] hardirqs last disabled at (916252): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.368522] softirqs last enabled at (916080): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.368525] softirqs last disabled at (916071): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.368529] ---[ end trace 0000000000000000 ]--- <6> [565.368531] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.368650] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.368659] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.368708] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.368967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.369108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.369251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.369405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.369510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.369607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.369701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.369795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.369885] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.369987] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.370084] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.371133] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.381348] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.381607] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.382923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.383065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.383194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.383322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.383460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.383587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.383714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.383840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.383966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.384091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.384217] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.384349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.384476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.384602] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.384728] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.384854] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.384980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.385106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.385232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.385376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.385466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.385554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.385641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.385729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.385815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.385899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.385981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.386064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.386145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.386229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.386314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.386411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.386503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.386592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.386685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.386775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.386865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.386952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.387037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.387120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.387204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.387293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.387386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.387471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.387556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.387641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.387725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.387809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.387892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.387977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.388063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.388146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.388232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.388320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.388414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.388499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.388583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.388666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.388747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.388833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.388917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.389002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.389091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.389178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.389264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.389352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.389435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.389517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.389602] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.389724] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.389728] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176733, lrc_seqno=176733, guc_id=0, flags=0x73 in no process [-1] <7> [565.389730] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.389798] ------------[ cut here ]------------ <4> [565.389799] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.389800] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:766/11660 <4> [565.389879] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.389949] [last unloaded: xe] <4> [565.389952] CPU: 10 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.389956] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.389957] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.389958] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.389964] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.390043] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.390044] RSP: 0000:ffffc9002542fca0 EFLAGS: 00010246 <4> [565.390047] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.390048] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.390050] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.390051] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.390052] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.390054] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [565.390055] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.390056] CR2: 00007ffd308f1a88 CR3: 000000012a5e2003 CR4: 0000000000f72ef0 <4> [565.390058] PKRU: 55555554 <4> [565.390059] Call Trace: <4> [565.390060] <TASK> <4> [565.390064] ? lock_acquire+0xa0/0x300 <4> [565.390071] ? lock_release+0xd0/0x2b0 <4> [565.390076] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.390082] process_one_work+0x239/0x740 <4> [565.390089] worker_thread+0x200/0x3f0 <4> [565.390092] ? __pfx_worker_thread+0x10/0x10 <4> [565.390095] kthread+0x10d/0x150 <4> [565.390098] ? __pfx_kthread+0x10/0x10 <4> [565.390101] ret_from_fork+0x3bd/0x470 <4> [565.390104] ? __pfx_kthread+0x10/0x10 <4> [565.390106] ret_from_fork_asm+0x1a/0x30 <4> [565.390115] </TASK> <4> [565.390116] irq event stamp: 919435 <4> [565.390117] hardirqs last enabled at (919441): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.390119] hardirqs last disabled at (919446): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.390121] softirqs last enabled at (918568): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.390124] softirqs last disabled at (918563): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.390127] ---[ end trace 0000000000000000 ]--- <6> [565.390129] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.390207] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.390213] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.391460] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [565.391570] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [565.391719] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.391989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.392133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.392278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.392424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.392562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.392699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.392837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.392977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.393112] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.393260] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.393418] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.394480] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.405215] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.405485] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.406582] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.406661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.406740] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.406819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.406897] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.406974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.407051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.407130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.407206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.407281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.407361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.407442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.407522] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.407601] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.407680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.407760] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.407846] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.407928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.408009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.408095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.408183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.408270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.408363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.408450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.408536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.408625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.408710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.408795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.408879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.408965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.409051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.409137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.409226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.409315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.409420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.409512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.409604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.409690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.409777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.409861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.409949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.410037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.410122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.410207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.410293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.410393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.410477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.410561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.410643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.410727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.410813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.410895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.410979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.411061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.411146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.411232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.411318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.411415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.411496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.411579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.411661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.411749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.411899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.412025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.412152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.412278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.412420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.412546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.412682] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.412829] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.412834] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176733, lrc_seqno=176733, guc_id=0, flags=0x73 in no process [-1] <7> [565.412837] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.412906] ------------[ cut here ]------------ <4> [565.412908] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.412909] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:257/11151 <4> [565.412990] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.413057] [last unloaded: xe] <4> [565.413061] CPU: 4 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.413064] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.413065] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.413067] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.413073] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.413153] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.413155] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [565.413157] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.413158] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.413160] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.413161] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.413162] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.413163] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [565.413165] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.413166] CR2: 00006523d19dc038 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [565.413168] PKRU: 55555554 <4> [565.413169] Call Trace: <4> [565.413170] <TASK> <4> [565.413174] ? lock_acquire+0xa0/0x300 <4> [565.413180] ? lock_release+0xd0/0x2b0 <4> [565.413185] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.413191] process_one_work+0x239/0x740 <4> [565.413198] worker_thread+0x200/0x3f0 <4> [565.413201] ? __pfx_worker_thread+0x10/0x10 <4> [565.413204] kthread+0x10d/0x150 <4> [565.413207] ? __pfx_kthread+0x10/0x10 <4> [565.413210] ret_from_fork+0x3bd/0x470 <4> [565.413212] ? __pfx_kthread+0x10/0x10 <4> [565.413215] ret_from_fork_asm+0x1a/0x30 <4> [565.413223] </TASK> <4> [565.413224] irq event stamp: 132213 <4> [565.413225] hardirqs last enabled at (132219): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.413228] hardirqs last disabled at (132224): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.413229] softirqs last enabled at (131352): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.413232] softirqs last disabled at (131345): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.413235] ---[ end trace 0000000000000000 ]--- <5> [565.414429] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176788, lrc_seqno=176788, guc_id=0, flags=0x73 in no process [-1] <7> [565.414440] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.414609] ------------[ cut here ]------------ <4> [565.414611] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.414613] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#12: kworker/u64:257/11151 <4> [565.414738] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl <7> [565.414736] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [565.414792] usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe] <4> [565.414837] CPU: 12 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.414841] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.414842] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.414844] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [565.414849] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [565.414853] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.414972] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.414974] RSP: 0000:ffffc9002448fca0 EFLAGS: 00010246 <4> [565.414978] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.414980] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.414982] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.414984] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.414985] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.414987] FS: 0000000000000000(0000) GS:ffff8888db283000(0000) knlGS:0000000000000000 <4> [565.414990] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.414992] CR2: 000073eeb00813b8 CR3: 000000000344a002 CR4: 0000000000f72ef0 <4> [565.414994] PKRU: 55555554 <4> [565.414995] Call Trace: <4> [565.414997] <TASK> <4> [565.415004] ? lock_acquire+0xa0/0x300 <4> [565.415012] ? lock_release+0xd0/0x2b0 <4> [565.415019] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.415029] process_one_work+0x239/0x740 <4> [565.415040] worker_thread+0x200/0x3f0 <4> [565.415044] ? __pfx_worker_thread+0x10/0x10 <4> [565.415048] kthread+0x10d/0x150 <4> [565.415051] ? __pfx_kthread+0x10/0x10 <4> [565.415056] ret_from_fork+0x3bd/0x470 <4> [565.415059] ? __pfx_kthread+0x10/0x10 <4> [565.415063] ret_from_fork_asm+0x1a/0x30 <4> [565.415075] </TASK> <4> [565.415077] irq event stamp: 134121 <4> [565.415078] hardirqs last enabled at (134127): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.415081] hardirqs last disabled at (134132): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.415084] softirqs last enabled at (131352): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.415088] softirqs last disabled at (131345): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.415091] ---[ end trace 0000000000000000 ]--- <6> [565.415093] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.415212] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.415223] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.415318] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.415974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.416072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.416172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.416266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.416365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.416461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.416558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.416653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.416744] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.416850] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.416948] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.417988] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.428350] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.428638] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.429733] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.429840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.429933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.430023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.430111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.430197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.430283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.430383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.430465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.430545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.430622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.430702] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.430781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.430864] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.430947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.431030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.431111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.431192] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.431272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.431366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.431455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.431541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.431630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.431719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.431804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.431887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.431970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.432051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.432131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.432215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.432300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.432416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.432501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.432587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.432682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.432775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.432866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.432953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.433040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.433124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.433207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.433290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.433382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.433465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.433550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.433633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.433715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.433797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.433878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.433961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.434047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.434130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.434216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.434302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.434396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.434481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.434564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.434646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.434727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.434812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.434893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.434975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.435056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.435142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.435230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.435314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.435411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.435495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.435581] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.435705] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.435710] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176788, lrc_seqno=176788, guc_id=0, flags=0x73 in no process [-1] <7> [565.435712] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.435780] ------------[ cut here ]------------ <4> [565.435782] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.435783] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:257/11151 <4> [565.435863] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.435931] [last unloaded: xe] <4> [565.435934] CPU: 2 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.435938] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.435939] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.435941] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.435947] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.436024] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.436026] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [565.436029] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.436030] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.436032] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.436033] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.436035] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.436036] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [565.436038] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.436040] CR2: 00007b37b3102000 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [565.436041] PKRU: 55555554 <4> [565.436043] Call Trace: <4> [565.436044] <TASK> <4> [565.436048] ? lock_acquire+0xa0/0x300 <4> [565.436054] ? lock_release+0xd0/0x2b0 <4> [565.436059] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.436065] process_one_work+0x239/0x740 <4> [565.436072] worker_thread+0x200/0x3f0 <4> [565.436076] ? __pfx_worker_thread+0x10/0x10 <4> [565.436079] kthread+0x10d/0x150 <4> [565.436081] ? __pfx_kthread+0x10/0x10 <4> [565.436084] ret_from_fork+0x3bd/0x470 <4> [565.436087] ? __pfx_kthread+0x10/0x10 <4> [565.436090] ret_from_fork_asm+0x1a/0x30 <4> [565.436097] </TASK> <4> [565.436099] irq event stamp: 137305 <4> [565.436100] hardirqs last enabled at (137311): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.436103] hardirqs last disabled at (137316): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.436105] softirqs last enabled at (136444): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.436108] softirqs last disabled at (136439): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.436111] ---[ end trace 0000000000000000 ]--- <6> [565.436113] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.437034] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.437096] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.437589] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [565.437743] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [565.437863] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.438081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.438180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.438281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.438403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.438499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.438598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.438695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.438790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.438880] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.438981] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.439077] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.440125] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.450348] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.450621] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.451935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.452014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.452089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.452168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.452246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.452323] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.452416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.452515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.452596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.452676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.452758] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.452840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.452921] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.453002] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.453086] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.453170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.453254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.453337] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.453436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.453548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.453638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.453725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.453814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.453905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.453993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.454078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.454162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.454246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.454329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.454431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.454537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.454626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.454712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.454796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.454886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.454976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.455065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.455151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.455238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.455327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.455429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.455528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.455611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.455696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.455781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.455865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.455948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.456032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.456119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.456207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.456295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.456389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.456496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.456583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.456669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.456754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.456837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.456919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.457000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.457084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.457168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.457251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.457335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.457432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.457531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.457618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.457703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.457786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.457873] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.457995] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.457999] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176788, lrc_seqno=176788, guc_id=0, flags=0x73 in no process [-1] <7> [565.458002] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.458071] ------------[ cut here ]------------ <4> [565.458072] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.458073] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:257/11151 <4> [565.458152] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.458220] [last unloaded: xe] <4> [565.458223] CPU: 5 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.458228] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.458229] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.458231] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.458237] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.458315] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.458317] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [565.458319] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.458321] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.458322] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.458323] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.458325] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.458326] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [565.458328] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.458329] CR2: 000062466a74b198 CR3: 0000000114e50005 CR4: 0000000000f72ef0 <4> [565.458331] PKRU: 55555554 <4> [565.458332] Call Trace: <4> [565.458333] <TASK> <4> [565.458337] ? lock_acquire+0xa0/0x300 <4> [565.458347] ? lock_release+0xd0/0x2b0 <4> [565.458352] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.458359] process_one_work+0x239/0x740 <4> [565.458366] worker_thread+0x200/0x3f0 <4> [565.458369] ? __pfx_worker_thread+0x10/0x10 <4> [565.458373] kthread+0x10d/0x150 <4> [565.458377] ? __pfx_kthread+0x10/0x10 <4> [565.458382] ret_from_fork+0x3bd/0x470 <4> [565.458386] ? __pfx_kthread+0x10/0x10 <4> [565.458390] ret_from_fork_asm+0x1a/0x30 <4> [565.458404] </TASK> <4> [565.458406] irq event stamp: 140599 <4> [565.458408] hardirqs last enabled at (140605): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.458412] hardirqs last disabled at (140610): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.458415] softirqs last enabled at (139468): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.458419] softirqs last disabled at (139461): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.458423] ---[ end trace 0000000000000000 ]--- <5> [565.459217] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176843, lrc_seqno=176843, guc_id=0, flags=0x73 in no process [-1] <7> [565.459225] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.459359] ------------[ cut here ]------------ <4> [565.459361] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.459362] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:257/11151 <4> [565.459460] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.459539] [last unloaded: xe] <4> [565.459544] CPU: 1 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.459549] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.459550] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.459552] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.459561] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.459645] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.459647] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [565.459650] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.459651] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.459652] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.459654] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.459655] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.459656] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [565.459658] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.459659] CR2: 000077dc54013008 CR3: 000000012a5e2002 CR4: 0000000000f72ef0 <4> [565.459661] PKRU: 55555554 <4> [565.459662] Call Trace: <4> [565.459663] <TASK> <4> [565.459667] ? lock_acquire+0xa0/0x300 <4> [565.459672] ? lock_release+0xd0/0x2b0 <4> [565.459677] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.459686] process_one_work+0x239/0x740 <4> [565.459698] worker_thread+0x200/0x3f0 <4> [565.459701] ? __pfx_worker_thread+0x10/0x10 <4> [565.459704] kthread+0x10d/0x150 <4> [565.459706] ? __pfx_kthread+0x10/0x10 <4> [565.459709] ret_from_fork+0x3bd/0x470 <4> [565.459712] ? __pfx_kthread+0x10/0x10 <4> [565.459714] ret_from_fork_asm+0x1a/0x30 <4> [565.459722] </TASK> <4> [565.459723] irq event stamp: 142531 <4> [565.459724] hardirqs last enabled at (142537): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.459726] hardirqs last disabled at (142542): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.459728] softirqs last enabled at (141764): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.459731] softirqs last disabled at (141751): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.459733] ---[ end trace 0000000000000000 ]--- <7> [565.459708] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [565.459735] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.459816] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.459824] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.459825] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [565.460017] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.460277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.460389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.460491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.460587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.460680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.460771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.460867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.460964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.461054] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.461152] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.461247] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.462282] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.472349] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.472611] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.473646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.473755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.473847] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.473933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.474015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.474097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.474179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.474263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.474350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.474432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.474513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.474592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.474672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.474751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.474830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.474908] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.474987] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.475066] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.475146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.475235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.475324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.475427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.475511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.475595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.475683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.475768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.475851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.475933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.476017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.476105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.476192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.476276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.476371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.476461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.476553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.476644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.476734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.476820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.476908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.476994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.477079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.477162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.477244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.477327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.477427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.477510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.477597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.477686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.477771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.477856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.477942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.478026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.478114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.478199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.478283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.478378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.478463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.478546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.478627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.478713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.478797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.478879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.478960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.479040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.479122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.479203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.479291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.479388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.479478] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.479606] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.480371] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176843, lrc_seqno=176843, guc_id=0, flags=0x73 in no process [-1] <7> [565.480379] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.480489] ------------[ cut here ]------------ <4> [565.480490] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.480492] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:257/11151 <4> [565.480576] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel <7> [565.480556] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [565.480610] wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe] <4> [565.480647] CPU: 8 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.480650] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.480651] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.480652] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.480658] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.480738] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.480740] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [565.480743] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.480744] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <7> [565.480684] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [565.480746] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.480747] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.480748] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.480749] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [565.480751] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.480752] CR2: 0000796064a5e058 CR3: 000000012a5e2005 CR4: 0000000000f72ef0 <4> [565.480753] PKRU: 55555554 <4> [565.480754] Call Trace: <4> [565.480755] <TASK> <4> [565.480759] ? lock_acquire+0xa0/0x300 <4> [565.480764] ? lock_release+0xd0/0x2b0 <4> [565.480768] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.480774] process_one_work+0x239/0x740 <4> [565.480781] worker_thread+0x200/0x3f0 <4> [565.480784] ? __pfx_worker_thread+0x10/0x10 <4> [565.480786] kthread+0x10d/0x150 <4> [565.480789] ? __pfx_kthread+0x10/0x10 <4> [565.480791] ret_from_fork+0x3bd/0x470 <4> [565.480794] ? __pfx_kthread+0x10/0x10 <4> [565.480796] ret_from_fork_asm+0x1a/0x30 <4> [565.480804] </TASK> <4> [565.480804] irq event stamp: 145701 <4> [565.480805] hardirqs last enabled at (145707): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.480808] hardirqs last disabled at (145712): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.480809] softirqs last enabled at (144680): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.480812] softirqs last disabled at (144675): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.480814] ---[ end trace 0000000000000000 ]--- <6> [565.480816] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.480899] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.480906] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.481311] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.481542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.481641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.481741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.481836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.481929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.482022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.482116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.482215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.482309] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.482423] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.482521] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.483571] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.493346] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.493602] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.494617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.494704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.494788] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.494872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.494955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.495036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.495116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.495197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.495278] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.495369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.495453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.495535] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.495616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.495697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.495777] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.495858] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.495938] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.496018] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.496097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.496185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.496273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.496367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.496456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.496544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.496629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.496714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.496797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.496885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.496972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.497060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.497146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.497231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.497317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.497410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.497501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.497591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.497686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.497777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.497863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.497947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.498031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.498113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.498199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.498286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.498380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.498463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.498548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.498631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.498712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.498795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.498879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.498963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.499049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.499134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.499217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.499301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.499392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.499474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.499557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.499641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.499723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.499805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.499888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.499974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.500060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.500143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.500224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.500303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.500395] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.500517] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.500521] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176843, lrc_seqno=176843, guc_id=0, flags=0x73 in no process [-1] <7> [565.500524] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.500591] ------------[ cut here ]------------ <4> [565.500592] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.500593] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:257/11151 <4> [565.500671] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.500737] [last unloaded: xe] <4> [565.500741] CPU: 8 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.500744] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.500745] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.500747] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.500753] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.500829] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.500831] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [565.500833] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.500835] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.500836] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.500838] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.500839] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.500841] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [565.500842] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.500844] CR2: 0000796064a5e058 CR3: 000000012a5e2005 CR4: 0000000000f72ef0 <4> [565.500846] PKRU: 55555554 <4> [565.500847] Call Trace: <4> [565.500848] <TASK> <4> [565.500853] ? lock_acquire+0xa0/0x300 <4> [565.500858] ? lock_release+0xd0/0x2b0 <4> [565.500863] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.500870] process_one_work+0x239/0x740 <4> [565.500876] worker_thread+0x200/0x3f0 <4> [565.500880] ? __pfx_worker_thread+0x10/0x10 <4> [565.500883] kthread+0x10d/0x150 <4> [565.500885] ? __pfx_kthread+0x10/0x10 <4> [565.500888] ret_from_fork+0x3bd/0x470 <4> [565.500891] ? __pfx_kthread+0x10/0x10 <4> [565.500894] ret_from_fork_asm+0x1a/0x30 <4> [565.500902] </TASK> <4> [565.500903] irq event stamp: 148921 <4> [565.500904] hardirqs last enabled at (148927): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.500907] hardirqs last disabled at (148932): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.500909] softirqs last enabled at (148072): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.500912] softirqs last disabled at (148067): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.500914] ---[ end trace 0000000000000000 ]--- <5> [565.501304] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176898, lrc_seqno=176898, guc_id=0, flags=0x73 in no process [-1] <7> [565.501492] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.501615] ------------[ cut here ]------------ <4> [565.501617] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.501619] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:19/2441 <4> [565.501703] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.501778] [last unloaded: xe] <4> [565.501782] CPU: 0 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.501785] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.501786] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.501788] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.501796] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.501885] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.501887] RSP: 0000:ffffc9000405bca0 EFLAGS: 00010246 <4> [565.501889] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.501891] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.501892] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.501893] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.501895] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.501896] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [565.501898] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.501899] CR2: 00007b37b3102000 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [565.501901] PKRU: 55555554 <4> [565.501902] Call Trace: <4> [565.501903] <TASK> <4> [565.501907] ? lock_acquire+0xa0/0x300 <4> [565.501914] ? lock_release+0xd0/0x2b0 <4> [565.501919] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.501926] process_one_work+0x239/0x740 <4> [565.501933] worker_thread+0x200/0x3f0 <4> [565.501936] ? __pfx_worker_thread+0x10/0x10 <4> [565.501938] kthread+0x10d/0x150 <4> [565.501941] ? __pfx_kthread+0x10/0x10 <4> [565.501944] ret_from_fork+0x3bd/0x470 <4> [565.501947] ? __pfx_kthread+0x10/0x10 <4> [565.501950] ret_from_fork_asm+0x1a/0x30 <4> [565.501958] </TASK> <4> [565.501959] irq event stamp: 2155489 <4> [565.501961] hardirqs last enabled at (2155495): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.501963] hardirqs last disabled at (2155500): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.501965] softirqs last enabled at (2153202): [<ffffffff8133abd3>] kernel_fpu_end+0x53/0x70 <4> [565.501968] softirqs last disabled at (2153200): [<ffffffff8133b2e4>] kernel_fpu_begin_mask+0xc4/0x120 <4> [565.501970] ---[ end trace 0000000000000000 ]--- <6> [565.501973] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.502066] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.502078] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.502366] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [565.502479] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [565.502592] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.502805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.502903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.503003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.503096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.503192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.503286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.503404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.503500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.503589] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.503691] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.503786] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.504825] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.515349] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.515608] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.516671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.516767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.516854] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.516940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.517023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.517106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.517189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.517270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.517360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.517446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.517530] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.517613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.517695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.517776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.517855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.517934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.518012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.518091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.518173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.518263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.518359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.518445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.518529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.518615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.518703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.518789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.518871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.518954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.519036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.519119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.519204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.519288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.519383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.519471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.519564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.519656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.519745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.519834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.519919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.520003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.520087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.520173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.520259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.520354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.520442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.520528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.520612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.520695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.520779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.520863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.520950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.521035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.521122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.521208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.521291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.521386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.521471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.521552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.521632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.521716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.521797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.521879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.521962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.522048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.522133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.522217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.522299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.522388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.522478] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.522601] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.522606] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176898, lrc_seqno=176898, guc_id=0, flags=0x73 in no process [-1] <7> [565.522609] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.522676] ------------[ cut here ]------------ <4> [565.522678] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.522679] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:766/11660 <4> [565.522757] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.522823] [last unloaded: xe] <4> [565.522827] CPU: 2 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.522830] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.522832] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.522833] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.522839] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.522914] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.522916] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [565.522919] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.522921] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.522922] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.522923] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.522924] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.522926] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [565.522927] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.522929] CR2: 00007b37b3102000 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [565.522930] PKRU: 55555554 <4> [565.522931] Call Trace: <4> [565.522932] <TASK> <4> [565.522937] ? lock_acquire+0xa0/0x300 <4> [565.522942] ? lock_release+0xd0/0x2b0 <4> [565.522947] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.522953] process_one_work+0x239/0x740 <4> [565.522960] worker_thread+0x200/0x3f0 <4> [565.522963] ? __pfx_worker_thread+0x10/0x10 <4> [565.522966] kthread+0x10d/0x150 <4> [565.522968] ? __pfx_kthread+0x10/0x10 <4> [565.522971] ret_from_fork+0x3bd/0x470 <4> [565.522973] ? __pfx_kthread+0x10/0x10 <4> [565.522976] ret_from_fork_asm+0x1a/0x30 <4> [565.522984] </TASK> <4> [565.522985] irq event stamp: 924905 <4> [565.522986] hardirqs last enabled at (924911): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.522988] hardirqs last disabled at (924916): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.522990] softirqs last enabled at (923890): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.522993] softirqs last disabled at (923883): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.522995] ---[ end trace 0000000000000000 ]--- <6> [565.522997] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.523074] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.523080] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.524323] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [565.524453] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [565.524589] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.524803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.524901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.525000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.525094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.525188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.525282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.525388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.525483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.525571] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.525671] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.525770] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.526821] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.537358] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.537616] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.538684] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.538828] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.538957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.539085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.539212] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.539357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.539455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.539543] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.539630] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.539714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.539800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.539885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.539968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.540048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.540128] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.540207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.540285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.540380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.540462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.540550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.540638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.540726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.540814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.540901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.540986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.541071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.541153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.541237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.541320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.541418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.541510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.541598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.541683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.541768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.541858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.541948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.542043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.542134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.542222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.542307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.542401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.542485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.542569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.542652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.542736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.542819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.542902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.542984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.543066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.543152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.543243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.543329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.543424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.543508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.543592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.543676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.543761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.543846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.543931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.544018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.544107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.544194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.544280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.544368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.544452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.544535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.544618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.544700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.544787] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.544910] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.544916] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176898, lrc_seqno=176898, guc_id=0, flags=0x73 in no process [-1] <7> [565.544918] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.544987] ------------[ cut here ]------------ <4> [565.544988] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.544989] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:19/2441 <4> [565.545069] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.545137] [last unloaded: xe] <4> [565.545140] CPU: 10 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.545143] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.545144] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.545146] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.545152] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.545229] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.545231] RSP: 0018:ffffc9000405bca0 EFLAGS: 00010246 <4> [565.545233] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.545235] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.545236] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.545237] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.545239] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.545240] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [565.545242] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.545243] CR2: 00007ffd308f1a88 CR3: 0000000114e50001 CR4: 0000000000f72ef0 <4> [565.545244] PKRU: 55555554 <4> [565.545246] Call Trace: <4> [565.545247] <TASK> <4> [565.545251] ? lock_acquire+0xa0/0x300 <4> [565.545256] ? lock_release+0xd0/0x2b0 <4> [565.545261] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.545267] process_one_work+0x239/0x740 <4> [565.545274] worker_thread+0x200/0x3f0 <4> [565.545277] ? __pfx_worker_thread+0x10/0x10 <4> [565.545280] kthread+0x10d/0x150 <4> [565.545282] ? __pfx_kthread+0x10/0x10 <4> [565.545285] ret_from_fork+0x3bd/0x470 <4> [565.545287] ? __pfx_kthread+0x10/0x10 <4> [565.545290] ret_from_fork_asm+0x1a/0x30 <4> [565.545298] </TASK> <4> [565.545299] irq event stamp: 2159799 <4> [565.545301] hardirqs last enabled at (2159805): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.545303] hardirqs last disabled at (2159810): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.545304] softirqs last enabled at (2158766): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.545307] softirqs last disabled at (2158761): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.545310] ---[ end trace 0000000000000000 ]--- <5> [565.545693] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176953, lrc_seqno=176953, guc_id=0, flags=0x73 in no process [-1] <7> [565.545698] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.545842] ------------[ cut here ]------------ <4> [565.545845] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.545846] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:257/11151 <4> [565.545950] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.546024] [last unloaded: xe] <4> [565.546028] CPU: 8 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.546032] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.546033] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.546035] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.546044] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.546130] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.546132] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [565.546135] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.546136] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.546137] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.546139] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.546140] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.546142] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [565.546143] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.546145] CR2: 0000796064a5e058 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [565.546146] PKRU: 55555554 <4> [565.546147] Call Trace: <4> [565.546149] <TASK> <4> [565.546154] ? lock_acquire+0xa0/0x300 <4> [565.546161] ? lock_release+0xd0/0x2b0 <4> [565.546167] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.546174] process_one_work+0x239/0x740 <4> [565.546183] worker_thread+0x200/0x3f0 <4> [565.546186] ? __pfx_worker_thread+0x10/0x10 <4> [565.546189] kthread+0x10d/0x150 <4> [565.546191] ? __pfx_kthread+0x10/0x10 <4> [565.546194] ret_from_fork+0x3bd/0x470 <4> [565.546196] ? __pfx_kthread+0x10/0x10 <4> [565.546199] ret_from_fork_asm+0x1a/0x30 <4> [565.546207] </TASK> <4> [565.546208] irq event stamp: 151765 <4> [565.546209] hardirqs last enabled at (151771): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.546211] hardirqs last disabled at (151776): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.546213] softirqs last enabled at (150188): [<ffffffff8133abd3>] kernel_fpu_end+0x53/0x70 <4> [565.546216] softirqs last disabled at (150186): [<ffffffff8133b2e4>] kernel_fpu_begin_mask+0xc4/0x120 <4> [565.546219] ---[ end trace 0000000000000000 ]--- <6> [565.546221] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.546310] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.546864] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.547108] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [565.547221] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [565.547352] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.547570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.547668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.547769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.547865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.547963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.548061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.548155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.548250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.548350] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.548453] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.548551] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.549589] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.560322] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.560599] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.561742] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.561832] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.561918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.562003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.562088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.562171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.562257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.562349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.562432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.562514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.562595] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.562676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.562756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.562835] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.562915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.562996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.563075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.563154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.563234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.563326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.563431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.563518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.563601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.563687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.563775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.563862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.563947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.564032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.564115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.564200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.564285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.564384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.564469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.564553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.564644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.564739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.564833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.564922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.565009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.565093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.565177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.565260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.565347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.565431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.565515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.565598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.565680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.565762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.565844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.565928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.566012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.566097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.566185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.566271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.566359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.566443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.566527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.566608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.566689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.566775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.566860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.566950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.567037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.567122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.567207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.567292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.567388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.567476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.567567] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.567690] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.567695] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176953, lrc_seqno=176953, guc_id=0, flags=0x73 in no process [-1] <7> [565.567697] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.567789] ------------[ cut here ]------------ <4> [565.567791] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.567793] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:19/2441 <4> [565.567968] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.568053] [last unloaded: xe] <4> [565.568057] CPU: 5 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.568061] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.568063] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.568067] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.568076] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.568164] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.568168] RSP: 0000:ffffc9000405bca0 EFLAGS: 00010246 <4> [565.568171] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.568172] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.568174] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.568176] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.568177] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.568179] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [565.568181] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.568183] CR2: 000062466a74b198 CR3: 0000000114e50005 CR4: 0000000000f72ef0 <4> [565.568185] PKRU: 55555554 <4> [565.568187] Call Trace: <4> [565.568188] <TASK> <4> [565.568193] ? lock_acquire+0xa0/0x300 <4> [565.568199] ? lock_release+0xd0/0x2b0 <4> [565.568204] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.568212] process_one_work+0x239/0x740 <4> [565.568220] worker_thread+0x200/0x3f0 <4> [565.568223] ? __pfx_worker_thread+0x10/0x10 <4> [565.568226] kthread+0x10d/0x150 <4> [565.568229] ? __pfx_kthread+0x10/0x10 <4> [565.568232] ret_from_fork+0x3bd/0x470 <4> [565.568235] ? __pfx_kthread+0x10/0x10 <4> [565.568239] ret_from_fork_asm+0x1a/0x30 <4> [565.568247] </TASK> <4> [565.568248] irq event stamp: 2164175 <4> [565.568250] hardirqs last enabled at (2164181): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.568254] hardirqs last disabled at (2164186): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.568256] softirqs last enabled at (2163308): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.568260] softirqs last disabled at (2163297): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.568263] ---[ end trace 0000000000000000 ]--- <6> [565.568267] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.568390] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.568405] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.568740] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [565.568849] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [565.568960] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.569174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.569275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.569389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.569485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.569579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.569669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.569762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.569855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.569944] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.570044] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.570138] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.571172] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.581348] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.581607] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.582628] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.582715] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.582797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.582880] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.582961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.583043] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.583125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.583210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.583294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.583390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.583473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.583555] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.583636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.583717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.583797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.583877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.583957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.584037] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.584117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.584206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.584297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.584393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.584478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.584564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.584649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.584732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.584814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.584896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.584977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.585062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.585147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.585232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.585321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.585422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.585516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.585609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.585699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.585786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.585871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.585954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.586042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.586128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.586213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.586301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.586400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.586486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.586571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.586654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.586736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.586820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.586906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.586988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.587076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.587163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.587248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.587334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.587432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.587515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.587598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.587685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.587769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.587855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.587943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.588029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.588115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.588201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.588284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.588373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.588459] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.588580] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.588585] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=176953, lrc_seqno=176953, guc_id=0, flags=0x73 in no process [-1] <7> [565.588587] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.588655] ------------[ cut here ]------------ <4> [565.588656] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.588657] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:19/2441 <4> [565.588738] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.588804] [last unloaded: xe] <4> [565.588807] CPU: 5 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.588810] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.588811] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.588812] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.588818] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.588895] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.588897] RSP: 0000:ffffc9000405bca0 EFLAGS: 00010246 <4> [565.588899] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.588901] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.588902] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.588903] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.588905] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.588906] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [565.588908] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.588909] CR2: 000062466a74b198 CR3: 0000000114e50005 CR4: 0000000000f72ef0 <4> [565.588910] PKRU: 55555554 <4> [565.588912] Call Trace: <4> [565.588913] <TASK> <4> [565.588917] ? lock_acquire+0xa0/0x300 <4> [565.588922] ? lock_release+0xd0/0x2b0 <4> [565.588927] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.588933] process_one_work+0x239/0x740 <4> [565.588940] worker_thread+0x200/0x3f0 <4> [565.588943] ? __pfx_worker_thread+0x10/0x10 <4> [565.588945] kthread+0x10d/0x150 <4> [565.588948] ? __pfx_kthread+0x10/0x10 <4> [565.588951] ret_from_fork+0x3bd/0x470 <4> [565.588953] ? __pfx_kthread+0x10/0x10 <4> [565.588956] ret_from_fork_asm+0x1a/0x30 <4> [565.588964] </TASK> <4> [565.588965] irq event stamp: 2167381 <4> [565.588966] hardirqs last enabled at (2167387): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.588968] hardirqs last disabled at (2167392): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.588970] softirqs last enabled at (2166526): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.588973] softirqs last disabled at (2166519): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.588975] ---[ end trace 0000000000000000 ]--- <5> [565.590228] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=177008, lrc_seqno=177008, guc_id=0, flags=0x73 in no process [-1] <7> [565.590234] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.590315] ------------[ cut here ]------------ <4> [565.590316] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.590318] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:19/2441 <4> [565.590413] Modules linked in: snd_hda_intel xe <7> [565.590361] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [565.590416] snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe] <4> [565.590486] CPU: 10 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.590489] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.590490] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.590491] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [565.590474] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [565.590497] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.590576] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.590578] RSP: 0018:ffffc9000405bca0 EFLAGS: 00010246 <4> [565.590581] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.590582] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.590583] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.590585] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.590586] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.590587] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [565.590589] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.590590] CR2: 00007ffd308f1a88 CR3: 00000001424a0006 CR4: 0000000000f72ef0 <4> [565.590592] PKRU: 55555554 <4> [565.590593] Call Trace: <4> [565.590594] <TASK> <4> [565.590598] ? lock_acquire+0xa0/0x300 <4> [565.590603] ? lock_release+0xd0/0x2b0 <4> [565.590608] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.590614] process_one_work+0x239/0x740 <4> [565.590621] worker_thread+0x200/0x3f0 <4> [565.590624] ? __pfx_worker_thread+0x10/0x10 <4> [565.590627] kthread+0x10d/0x150 <4> [565.590629] ? __pfx_kthread+0x10/0x10 <4> [565.590632] ret_from_fork+0x3bd/0x470 <4> [565.590634] ? __pfx_kthread+0x10/0x10 <4> [565.590637] ret_from_fork_asm+0x1a/0x30 <4> [565.590644] </TASK> <4> [565.590646] irq event stamp: 2169941 <4> [565.590647] hardirqs last enabled at (2169947): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.590649] hardirqs last disabled at (2169952): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.590651] softirqs last enabled at (2169192): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.590653] softirqs last disabled at (2169185): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.590656] ---[ end trace 0000000000000000 ]--- <6> [565.590658] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.590737] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.590744] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.590921] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.591186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.591329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.591512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.591612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.591708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.591802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.591898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.591995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.592087] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.592186] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.592279] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.593322] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.604067] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.604326] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.605377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.605466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.605551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.605634] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.605718] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.605803] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.605886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.605968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.606049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.606129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.606210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.606290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.606379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.606460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.606548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.606627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.606708] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.606787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.606866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.606953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.607041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.607131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.607216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.607301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.607397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.607480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.607561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.607642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.607723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.607807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.607892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.607974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.608057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.608140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.608229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.608318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.608419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.608504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.608590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.608673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.608756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.608839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.608923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.609010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.609098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.609184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.609270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.609360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.609443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.609531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.609619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.609704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.609786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.609872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.609959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.610046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.610130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.610213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.610297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.610395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.610481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.610566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.610649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.610732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.610824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.610908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.610995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.611083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.611172] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.611296] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.611301] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=177008, lrc_seqno=177008, guc_id=0, flags=0x73 in no process [-1] <7> [565.611304] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.611697] ------------[ cut here ]------------ <4> [565.611701] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.611704] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:766/11660 <4> [565.612106] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.612231] [last unloaded: xe] <4> [565.612236] CPU: 5 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.612241] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.612243] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.612245] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.612257] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.612349] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.612352] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [565.612356] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.612359] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.612361] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.612363] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.612365] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.612367] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [565.612370] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.612372] CR2: 000062466a74b198 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [565.612375] PKRU: 55555554 <4> [565.612376] Call Trace: <4> [565.612378] <TASK> <4> [565.612385] ? lock_acquire+0xa0/0x300 <4> [565.612392] ? lock_release+0xd0/0x2b0 <4> [565.612401] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.612413] process_one_work+0x239/0x740 <4> [565.612424] worker_thread+0x200/0x3f0 <7> [565.612353] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [565.612430] ? __pfx_worker_thread+0x10/0x10 <4> [565.612434] kthread+0x10d/0x150 <4> [565.612437] ? __pfx_kthread+0x10/0x10 <4> [565.612441] ret_from_fork+0x3bd/0x470 <4> [565.612444] ? __pfx_kthread+0x10/0x10 <4> [565.612448] ret_from_fork_asm+0x1a/0x30 <4> [565.612460] </TASK> <4> [565.612461] irq event stamp: 929505 <4> [565.612462] hardirqs last enabled at (929511): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.612465] hardirqs last disabled at (929516): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.612467] softirqs last enabled at (928510): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.612471] softirqs last disabled at (928503): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.612474] ---[ end trace 0000000000000000 ]--- <6> [565.612476] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [565.612517] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [565.612602] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.612610] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.613017] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.613229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.613326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.613451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.613548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.613642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.613735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.613826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.613919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.614008] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.614110] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.614207] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.615244] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.625347] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.625607] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.626588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.626675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.626758] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.626841] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.626924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.627007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.627088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.627170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.627250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.627331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.627431] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.627511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.627595] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.627677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.627758] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.627837] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.627916] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.627996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.628075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.628162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.628250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.628345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.628430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.628517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.628601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.628689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.628777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.628863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.628947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.629034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.629120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.629204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.629289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.629385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.629475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.629564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.629653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.629739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.629824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.629912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.629998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.630083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.630165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.630248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.630333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.630430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.630512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.630596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.630676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.630758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.630846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.630932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.631016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.631099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.631180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.631262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.631355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.631437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.631520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.631606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.631689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.631771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.631852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.631932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.632014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.632097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.632178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.632257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.632376] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.632499] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.632503] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=177008, lrc_seqno=177008, guc_id=0, flags=0x73 in no process [-1] <7> [565.632506] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.632574] ------------[ cut here ]------------ <4> [565.632575] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.632576] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:766/11660 <4> [565.632652] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.632727] [last unloaded: xe] <4> [565.632731] CPU: 5 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.632734] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.632735] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.632737] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.632743] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.632822] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.632823] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [565.632826] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.632828] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.632829] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.632831] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.632832] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.632834] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [565.632835] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.632837] CR2: 000062466a74b198 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [565.632839] PKRU: 55555554 <4> [565.632840] Call Trace: <4> [565.632841] <TASK> <4> [565.632845] ? lock_acquire+0xa0/0x300 <4> [565.632850] ? lock_release+0xd0/0x2b0 <4> [565.632855] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.632862] process_one_work+0x239/0x740 <4> [565.632868] worker_thread+0x200/0x3f0 <4> [565.632872] ? __pfx_worker_thread+0x10/0x10 <4> [565.632874] kthread+0x10d/0x150 <4> [565.632877] ? __pfx_kthread+0x10/0x10 <4> [565.632880] ret_from_fork+0x3bd/0x470 <4> [565.632882] ? __pfx_kthread+0x10/0x10 <4> [565.632885] ret_from_fork_asm+0x1a/0x30 <4> [565.632893] </TASK> <4> [565.632894] irq event stamp: 932807 <4> [565.632895] hardirqs last enabled at (932813): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.632897] hardirqs last disabled at (932818): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.632899] softirqs last enabled at (931960): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.632902] softirqs last disabled at (931921): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.632904] ---[ end trace 0000000000000000 ]--- <5> [565.634106] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=177063, lrc_seqno=177063, guc_id=0, flags=0x73 in no process [-1] <7> [565.634109] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.634180] ------------[ cut here ]------------ <4> [565.634181] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.634183] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:766/11660 <4> [565.634262] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.634327] [last unloaded: xe] <4> [565.634330] CPU: 5 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.634332] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.634334] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.634335] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.634350] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.634428] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.634429] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [565.634431] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.634432] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.634434] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.634435] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.634436] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.634437] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [565.634439] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.634440] CR2: 000062466a74b198 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [565.634442] PKRU: 55555554 <4> [565.634443] Call Trace: <4> [565.634444] <TASK> <4> [565.634447] ? lock_acquire+0xa0/0x300 <4> [565.634452] ? lock_release+0xd0/0x2b0 <4> [565.634457] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.634463] process_one_work+0x239/0x740 <4> [565.634469] worker_thread+0x200/0x3f0 <4> [565.634474] ? __pfx_worker_thread+0x10/0x10 <4> [565.634476] kthread+0x10d/0x150 <4> [565.634478] ? __pfx_kthread+0x10/0x10 <4> [565.634481] ret_from_fork+0x3bd/0x470 <4> [565.634483] ? __pfx_kthread+0x10/0x10 <4> [565.634486] ret_from_fork_asm+0x1a/0x30 <4> [565.634494] </TASK> <4> [565.634495] irq event stamp: 934751 <4> [565.634496] hardirqs last enabled at (934757): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.634498] hardirqs last disabled at (934762): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.634499] softirqs last enabled at (934578): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.634502] softirqs last disabled at (934537): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.634505] ---[ end trace 0000000000000000 ]--- <7> [565.634519] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [565.634629] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [565.634733] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.634811] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.634817] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.634864] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.635082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.635180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.635280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.635397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.635489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.635580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.635671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.635765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.635857] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.635961] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.636058] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.637104] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.647345] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.647602] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.648615] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.648701] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.648783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.648866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.648951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.649033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.649112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.649191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.649270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.649352] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.649432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.649512] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.649592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.649672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.649751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.649830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.649910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.649989] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.650068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.650155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.650245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.650333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.650432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.650519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.650605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.650690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.650776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.650861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.650945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.651030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.651116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.651199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.651285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.651375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.651464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.651553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.651642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.651727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.651812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.651899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.651985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.652068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.652150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.652233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.652317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.652409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.652492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.652574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.652655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.652738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.652823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.652905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.652988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.653073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.653157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.653241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.653324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.653418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.653499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.653583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.653667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.653753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.653838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.653920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.654004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.654086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.654168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.654248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.654333] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.654465] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.654469] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=177063, lrc_seqno=177063, guc_id=0, flags=0x73 in no process [-1] <7> [565.654471] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.654539] ------------[ cut here ]------------ <4> [565.654540] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.654541] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:766/11660 <4> [565.654620] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.654685] [last unloaded: xe] <4> [565.654688] CPU: 5 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.654691] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.654692] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.654694] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.654699] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.654777] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.654779] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [565.654781] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.654782] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.654783] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.654785] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.654786] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.654787] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [565.654789] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.654790] CR2: 000062466a74b198 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [565.654792] PKRU: 55555554 <4> [565.654793] Call Trace: <4> [565.654794] <TASK> <4> [565.654798] ? lock_acquire+0xa0/0x300 <4> [565.654802] ? lock_release+0xd0/0x2b0 <4> [565.654807] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.654813] process_one_work+0x239/0x740 <4> [565.654820] worker_thread+0x200/0x3f0 <4> [565.654823] ? __pfx_worker_thread+0x10/0x10 <4> [565.654826] kthread+0x10d/0x150 <4> [565.654828] ? __pfx_kthread+0x10/0x10 <4> [565.654831] ret_from_fork+0x3bd/0x470 <4> [565.654833] ? __pfx_kthread+0x10/0x10 <4> [565.654836] ret_from_fork_asm+0x1a/0x30 <4> [565.654844] </TASK> <4> [565.654846] irq event stamp: 937929 <4> [565.654847] hardirqs last enabled at (937935): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.654849] hardirqs last disabled at (937940): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.654851] softirqs last enabled at (937088): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.654854] softirqs last disabled at (937081): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.654857] ---[ end trace 0000000000000000 ]--- <6> [565.654859] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.654938] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.654944] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.656184] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [565.656296] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [565.656419] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.656643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.656743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.656844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.656940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.657034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.657125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.657219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.657312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.657420] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.657533] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.657634] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.658774] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.669349] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.669668] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.671629] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.671728] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.671818] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.671906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.671993] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.672078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.672163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.672251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.672335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.672433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.672515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.672597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.672677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.672757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.672839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.672924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.673008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.673090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.673172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.673261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.673353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.673439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.673522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.673609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.673698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.673784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.673868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.673950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.674033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.674115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.674200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.674284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.674378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.674468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.674561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.674653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.674743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.674832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.674919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.675004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.675092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.675180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.675265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.675352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.675440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.675524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.675609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.675691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.675773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.675855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.675946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.676035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.676121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.676204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.676287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.676377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.676459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.676539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.676624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.676712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.676796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.676879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.676962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.677049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.677136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.677221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.677304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.677393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.677477] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.677600] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.677604] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=177063, lrc_seqno=177063, guc_id=0, flags=0x73 in no process [-1] <7> [565.677607] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.677676] ------------[ cut here ]------------ <4> [565.677677] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.677679] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:257/11151 <4> [565.677757] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.677825] [last unloaded: xe] <4> [565.677828] CPU: 10 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.677831] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.677833] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.677834] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.677840] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.677919] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.677921] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [565.677923] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.677925] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.677926] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.677927] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.677928] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.677930] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [565.677931] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.677933] CR2: 00007ffd308f1a88 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [565.677934] PKRU: 55555554 <4> [565.677935] Call Trace: <4> [565.677936] <TASK> <4> [565.677940] ? lock_acquire+0xa0/0x300 <4> [565.677946] ? lock_release+0xd0/0x2b0 <4> [565.677950] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.677956] process_one_work+0x239/0x740 <4> [565.677964] worker_thread+0x200/0x3f0 <4> [565.677967] ? __pfx_worker_thread+0x10/0x10 <4> [565.677970] kthread+0x10d/0x150 <4> [565.677972] ? __pfx_kthread+0x10/0x10 <4> [565.677975] ret_from_fork+0x3bd/0x470 <4> [565.677977] ? __pfx_kthread+0x10/0x10 <4> [565.677980] ret_from_fork_asm+0x1a/0x30 <4> [565.677988] </TASK> <4> [565.677989] irq event stamp: 157521 <4> [565.677990] hardirqs last enabled at (157527): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.677993] hardirqs last disabled at (157532): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.677994] softirqs last enabled at (156416): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.677997] softirqs last disabled at (156411): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.678000] ---[ end trace 0000000000000000 ]--- <5> [565.679198] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=177118, lrc_seqno=177118, guc_id=0, flags=0x73 in no process [-1] <7> [565.679201] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.679273] ------------[ cut here ]------------ <4> [565.679274] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.679275] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:257/11151 <4> [565.679358] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.679424] [last unloaded: xe] <4> [565.679427] CPU: 10 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.679430] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.679431] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.679432] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.679438] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.679514] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.679515] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [565.679517] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.679519] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.679520] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.679521] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.679522] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.679523] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [565.679525] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.679526] CR2: 00007ffd308f1a88 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [565.679528] PKRU: 55555554 <4> [565.679529] Call Trace: <4> [565.679530] <TASK> <4> [565.679534] ? lock_acquire+0xa0/0x300 <4> [565.679538] ? lock_release+0xd0/0x2b0 <4> [565.679543] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.679549] process_one_work+0x239/0x740 <4> [565.679555] worker_thread+0x200/0x3f0 <4> [565.679558] ? __pfx_worker_thread+0x10/0x10 <4> [565.679561] kthread+0x10d/0x150 <4> [565.679563] ? __pfx_kthread+0x10/0x10 <4> [565.679566] ret_from_fork+0x3bd/0x470 <4> [565.679568] ? __pfx_kthread+0x10/0x10 <4> [565.679571] ret_from_fork_asm+0x1a/0x30 <4> [565.679578] </TASK> <4> [565.679579] irq event stamp: 159443 <4> [565.679581] hardirqs last enabled at (159449): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.679582] hardirqs last disabled at (159454): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.679584] softirqs last enabled at (158694): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.679587] softirqs last disabled at (158689): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.679589] ---[ end trace 0000000000000000 ]--- <7> [565.679604] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [565.679714] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [565.679818] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.679896] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.679902] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.680141] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.680364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.680467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.680568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.680662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.680755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.680847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.680943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.681037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.681124] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.681225] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.681322] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.682371] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.692345] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.692606] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.693766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.693862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.693950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.694040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.694127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.694210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.694292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.694394] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.694491] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.694576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.694659] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.694742] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.694823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.694904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.694987] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.695069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.695151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.695232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.695317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.695452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.695550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.695642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.695729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.695816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.695901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.695985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.696070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.696159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.696245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.696333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.696443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.696527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.696613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.696697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.696788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.696879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.696969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.697055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.697146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.697235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.697322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.697418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.697503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.697588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.697675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.697759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.697842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.697926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.698012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.698097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.698182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.698265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.698353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.698436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.698518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.698602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.698685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.698771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.698856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.698944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.699028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.699112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.699195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.699276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.699369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.699452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.699533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.699614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.699699] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.699822] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.699827] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=177118, lrc_seqno=177118, guc_id=0, flags=0x73 in no process [-1] <7> [565.699830] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.699900] ------------[ cut here ]------------ <4> [565.699902] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.699903] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:19/2441 <4> [565.699984] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.700051] [last unloaded: xe] <4> [565.700055] CPU: 1 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.700058] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.700059] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.700061] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.700066] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.700144] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.700145] RSP: 0000:ffffc9000405bca0 EFLAGS: 00010246 <4> [565.700148] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.700149] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.700151] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.700152] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.700153] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.700154] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [565.700156] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.700157] CR2: 000077dc54013008 CR3: 000000012a5e2002 CR4: 0000000000f72ef0 <4> [565.700159] PKRU: 55555554 <4> [565.700160] Call Trace: <4> [565.700161] <TASK> <4> [565.700165] ? lock_acquire+0xa0/0x300 <4> [565.700170] ? lock_release+0xd0/0x2b0 <4> [565.700175] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.700182] process_one_work+0x239/0x740 <4> [565.700188] worker_thread+0x200/0x3f0 <4> [565.700191] ? __pfx_worker_thread+0x10/0x10 <4> [565.700194] kthread+0x10d/0x150 <4> [565.700197] ? __pfx_kthread+0x10/0x10 <4> [565.700200] ret_from_fork+0x3bd/0x470 <4> [565.700202] ? __pfx_kthread+0x10/0x10 <4> [565.700205] ret_from_fork_asm+0x1a/0x30 <4> [565.700212] </TASK> <4> [565.700213] irq event stamp: 2176413 <4> [565.700215] hardirqs last enabled at (2176419): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.700219] hardirqs last disabled at (2176426): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.700221] softirqs last enabled at (2175540): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.700224] softirqs last disabled at (2175535): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.700227] ---[ end trace 0000000000000000 ]--- <6> [565.700778] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.700903] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.700914] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.701478] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [565.701589] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [565.701701] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.701909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.702009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.702111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.702205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.702297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.702397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.702490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.702585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.702677] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.702779] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.702875] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.703908] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.714345] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.714609] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.715671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.715813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.715907] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.715998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.716085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.716172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.716260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.716370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.716470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.716552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.716633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.716714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.716794] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.716874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.716955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.717035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.717115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.717195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.717276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.717376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.717498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.717589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.717677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.717764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.717848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.717930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.718013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.718095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.718178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.718262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.718368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.718462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.718552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.718640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.718730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.718820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.718911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.718999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.719085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.719170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.719256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.719352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.719440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.719525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.719613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.719697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.719782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.719864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.719946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.720029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.720113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.720195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.720278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.720366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.720450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.720538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.720624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.720708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.720790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.720875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.720957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.721040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.721124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.721541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.721626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.721710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.721793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.721875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.721964] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.722089] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.722094] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=177118, lrc_seqno=177118, guc_id=0, flags=0x73 in no process [-1] <7> [565.722096] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.722682] ------------[ cut here ]------------ <4> [565.722684] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.722686] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:19/2441 <4> [565.722820] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.722907] [last unloaded: xe] <4> [565.722914] CPU: 10 UID: 0 PID: 2441 Comm: kworker/u64:19 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.722919] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.722921] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.722923] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.722932] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.723022] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.723024] RSP: 0000:ffffc9000405bca0 EFLAGS: 00010246 <4> [565.723027] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.723029] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.723030] RBP: ffffc9000405bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.723032] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.723033] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.723034] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [565.723036] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.723038] CR2: 00007ffd308f1a88 CR3: 000000012a5e2003 CR4: 0000000000f72ef0 <4> [565.723040] PKRU: 55555554 <4> [565.723041] Call Trace: <4> [565.723042] <TASK> <4> [565.723046] ? lock_acquire+0xa0/0x300 <4> [565.723052] ? lock_release+0xd0/0x2b0 <4> [565.723057] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.723064] process_one_work+0x239/0x740 <4> [565.723071] worker_thread+0x200/0x3f0 <4> [565.723075] ? __pfx_worker_thread+0x10/0x10 <4> [565.723078] kthread+0x10d/0x150 <4> [565.723080] ? __pfx_kthread+0x10/0x10 <4> [565.723083] ret_from_fork+0x3bd/0x470 <4> [565.723086] ? __pfx_kthread+0x10/0x10 <4> [565.723089] ret_from_fork_asm+0x1a/0x30 <4> [565.723097] </TASK> <4> [565.723098] irq event stamp: 2179677 <4> [565.723099] hardirqs last enabled at (2179683): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.723101] hardirqs last disabled at (2179688): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.723103] softirqs last enabled at (2178468): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.723106] softirqs last disabled at (2178459): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.723109] ---[ end trace 0000000000000000 ]--- <7> [565.723123] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [565.723244] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [565.723535] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=177173, lrc_seqno=177173, guc_id=0, flags=0x73 in no process [-1] <7> [565.723539] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.723612] ------------[ cut here ]------------ <4> [565.723613] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.723615] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:766/11660 <4> [565.723699] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.723767] [last unloaded: xe] <4> [565.723771] CPU: 0 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.723774] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.723775] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.723776] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.723782] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.723861] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.723862] RSP: 0000:ffffc9002542fca0 EFLAGS: 00010246 <4> [565.723865] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.723866] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.723867] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.723869] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.723870] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.723871] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [565.723873] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.723874] CR2: 00007b37b3102000 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [565.723876] PKRU: 55555554 <4> [565.723877] Call Trace: <4> [565.723878] <TASK> <4> [565.723882] ? lock_acquire+0xa0/0x300 <4> [565.723887] ? lock_release+0xd0/0x2b0 <4> [565.723892] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.723898] process_one_work+0x239/0x740 <4> [565.723905] worker_thread+0x200/0x3f0 <4> [565.723908] ? __pfx_worker_thread+0x10/0x10 <4> [565.723911] kthread+0x10d/0x150 <4> [565.723913] ? __pfx_kthread+0x10/0x10 <4> [565.723916] ret_from_fork+0x3bd/0x470 <4> [565.723919] ? __pfx_kthread+0x10/0x10 <4> [565.723921] ret_from_fork_asm+0x1a/0x30 <4> [565.723929] </TASK> <4> [565.723930] irq event stamp: 940033 <4> [565.723931] hardirqs last enabled at (940039): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.723934] hardirqs last disabled at (940044): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.723935] softirqs last enabled at (938506): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.723938] softirqs last disabled at (938495): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.723941] ---[ end trace 0000000000000000 ]--- <6> [565.723943] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.724020] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.724030] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.724082] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.724301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.724410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.724555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.724659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.724757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.724852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.724946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.725040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.725130] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.725233] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.725334] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.726434] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.736349] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.736633] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.737724] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.737814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.737900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.737985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.738068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.738150] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.738232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.738313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.738405] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.738502] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.738589] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.738676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.738760] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.738842] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.738925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.739007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.739089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.739173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.739256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.739354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.739465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.739554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.739641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.739730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.739816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.739899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.739980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.740062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.740144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.740228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.740318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.740421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.740526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.740612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.740703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.740797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.740891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.740981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.741069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.741151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.741234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.741319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.741420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.741524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.741611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.741697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.741780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.741866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.741951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.742035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.742120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.742204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.742287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.742381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.742493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.742583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.742669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.742753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.742841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.742930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.743015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.743101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.743184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.743265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.743355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.743459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.743547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.743632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.743719] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.743842] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.744393] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=177173, lrc_seqno=177173, guc_id=0, flags=0x73 in no process [-1] <7> [565.744412] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.744518] ------------[ cut here ]------------ <4> [565.744520] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.744522] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:766/11660 <4> [565.744605] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.744684] [last unloaded: xe] <4> [565.744689] CPU: 8 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.744692] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.744694] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.744695] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.744701] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.744779] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.744781] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [565.744783] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.744784] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.744786] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.744787] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.744788] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.744790] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [565.744791] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.744793] CR2: 0000796064a5e058 CR3: 0000000114e50004 CR4: 0000000000f72ef0 <4> [565.744794] PKRU: 55555554 <4> [565.744795] Call Trace: <4> [565.744796] <TASK> <4> [565.744800] ? lock_acquire+0xa0/0x300 <4> [565.744806] ? lock_release+0xd0/0x2b0 <4> [565.744810] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.744816] process_one_work+0x239/0x740 <4> [565.744823] worker_thread+0x200/0x3f0 <4> [565.744826] ? __pfx_worker_thread+0x10/0x10 <4> [565.744829] kthread+0x10d/0x150 <4> [565.744831] ? __pfx_kthread+0x10/0x10 <4> [565.744834] ret_from_fork+0x3bd/0x470 <4> [565.744837] ? __pfx_kthread+0x10/0x10 <4> [565.744839] ret_from_fork_asm+0x1a/0x30 <4> [565.744847] </TASK> <4> [565.744849] irq event stamp: 943243 <4> [565.744850] hardirqs last enabled at (943249): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.744852] hardirqs last disabled at (943254): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.744854] softirqs last enabled at (942118): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.744857] softirqs last disabled at (942111): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.744859] ---[ end trace 0000000000000000 ]--- <7> [565.744835] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [565.744861] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.744939] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.744950] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.744948] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [565.745135] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.745348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.745445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.745544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.745641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.745735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.745825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.745917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.746008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.746094] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.746195] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.746291] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.747329] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.757345] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.757600] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.758647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.758735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.758818] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.758900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.758982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.759063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.759144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.759223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.759305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.759408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.759489] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.759571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.759652] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.759732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.759811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.759892] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.759971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.760051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.760130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.760217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.760304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.760403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.760489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.760575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.760658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.760742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.760824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.760906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.760989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.761078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [565.761168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [565.761254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [565.761342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [565.761428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [565.761517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [565.761606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [565.761696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [565.761782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [565.761873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [565.761960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [565.762045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [565.762127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [565.762209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [565.762292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [565.762383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [565.762466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [565.762549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [565.762636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [565.762722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [565.762808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [565.762893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [565.762976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [565.763061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [565.763146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [565.763233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [565.763320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [565.763414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [565.763496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [565.763578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [565.763663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [565.763747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [565.763837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [565.763923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [565.764008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [565.764091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [565.764168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [565.764243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [565.764318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [565.764409] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [565.764526] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [565.764531] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=177173, lrc_seqno=177173, guc_id=0, flags=0x73 in no process [-1] <7> [565.764533] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [565.764603] ------------[ cut here ]------------ <4> [565.764604] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.764605] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:766/11660 <4> [565.764684] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.764753] [last unloaded: xe] <4> [565.764756] CPU: 8 UID: 0 PID: 11660 Comm: kworker/u64:766 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.764759] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.764760] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.764761] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.764767] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.764844] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.764845] RSP: 0018:ffffc9002542fca0 EFLAGS: 00010246 <4> [565.764848] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.764849] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.764850] RBP: ffffc9002542fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.764852] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.764853] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.764854] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [565.764856] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.764857] CR2: 0000796064a5e058 CR3: 0000000114e50004 CR4: 0000000000f72ef0 <4> [565.764859] PKRU: 55555554 <4> [565.764860] Call Trace: <4> [565.764861] <TASK> <4> [565.764865] ? lock_acquire+0xa0/0x300 <4> [565.764870] ? lock_release+0xd0/0x2b0 <4> [565.764875] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.764881] process_one_work+0x239/0x740 <4> [565.764887] worker_thread+0x200/0x3f0 <4> [565.764890] ? __pfx_worker_thread+0x10/0x10 <4> [565.764893] kthread+0x10d/0x150 <4> [565.764895] ? __pfx_kthread+0x10/0x10 <4> [565.764898] ret_from_fork+0x3bd/0x470 <4> [565.764901] ? __pfx_kthread+0x10/0x10 <4> [565.764903] ret_from_fork_asm+0x1a/0x30 <4> [565.764911] </TASK> <4> [565.764912] irq event stamp: 946533 <4> [565.764913] hardirqs last enabled at (946539): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.764915] hardirqs last disabled at (946544): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.764917] softirqs last enabled at (945684): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.764920] softirqs last disabled at (945673): [<ffffffff813d227b>] __irq_exit_rcu+0xdb/0x1c0 <4> [565.764923] ---[ end trace 0000000000000000 ]--- <5> [565.766450] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=177228, lrc_seqno=177228, guc_id=0, flags=0x73 in no process [-1] <7> [565.766455] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [565.766460] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [565.766542] ------------[ cut here ]------------ <4> [565.766544] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [565.766545] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:257/11151 <7> [565.766573] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [565.766635] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [565.766701] [last unloaded: xe] <4> [565.766705] CPU: 10 UID: 0 PID: 11151 Comm: kworker/u64:257 Tainted: G S U W N 7.1.0-rc2-lgci-xe-xe-pw-166161v1-debug+ #1 PREEMPT(lazy) <4> [565.766708] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [N]=TEST <4> [565.766709] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [565.766710] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [565.766716] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [565.766799] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [565.766801] RSP: 0018:ffffc9002448fca0 EFLAGS: 00010246 <4> [565.766803] RAX: ffffffffa12bbc46 RBX: 0000000000000000 RCX: 0000000000000000 <4> [565.766805] RDX: ffff888103a35790 RSI: ffffffffa12bbc46 RDI: ffffffffa0c03f10 <4> [565.766806] RBP: ffffc9002448fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [565.766807] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [565.766808] R13: ffff888103a35790 R14: ffff88810d752018 R15: 00000000ffffffc2 <4> [565.766810] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [565.766811] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [565.766813] CR2: 00007ffd308f1a88 CR3: 0000000114e50001 CR4: 0000000000f72ef0 <4> [565.766814] PKRU: 55555554 <4> [565.766815] Call Trace: <4> [565.766817] <TASK> <4> [565.766821] ? lock_acquire+0xa0/0x300 <4> [565.766826] ? lock_release+0xd0/0x2b0 <4> [565.766831] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [565.766837] process_one_work+0x239/0x740 <4> [565.766844] worker_thread+0x200/0x3f0 <4> [565.766847] ? __pfx_worker_thread+0x10/0x10 <4> [565.766850] kthread+0x10d/0x150 <4> [565.766852] ? __pfx_kthread+0x10/0x10 <4> [565.766855] ret_from_fork+0x3bd/0x470 <4> [565.766857] ? __pfx_kthread+0x10/0x10 <4> [565.766860] ret_from_fork_asm+0x1a/0x30 <4> [565.766868] </TASK> <4> [565.766869] irq event stamp: 163181 <4> [565.766870] hardirqs last enabled at (163187): [<ffffffff814ab219>] __up_console_sem+0x79/0xa0 <4> [565.766872] hardirqs last disabled at (163192): [<ffffffff814ab1fe>] __up_console_sem+0x5e/0xa0 <4> [565.766874] softirqs last enabled at (162286): [<ffffffff8133abd3>] kernel_fpu_end+0x53/0x70 <4> [565.766876] softirqs last disabled at (162284): [<ffffffff8133b2e4>] kernel_fpu_begin_mask+0xc4/0x120 <4> [565.766879] ---[ end trace 0000000000000000 ]--- <6> [565.766881] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [565.766965] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [565.766972] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [565.767019] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [565.767229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [565.767326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [565.767440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [565.767534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [565.767627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [565.767719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [565.767810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [565.767902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [565.767990] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [565.768090] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [565.768186] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [565.769226] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [565.779362] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [565.779619] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [565.780732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [565.780810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [565.780886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [565.780964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [565.781040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [565.781114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [565.781188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [565.781259] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [565.781331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [565.781423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [565.781503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [565.781583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [565.781665] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [565.781749] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [565.781830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [565.781911] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [565.781992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [565.782071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [565.782150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [565.782239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [565.782326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [565.782424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [565.782509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [565.782598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [565.782684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [565.782768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [565.782850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [565.782932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [565.783015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [565.783100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040

<4> [564.345925] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.346133] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.370662] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.370835] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.393276] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.393626] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.394937] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.395101] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.416022] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.416182] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.438422] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.438571] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.440227] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.440410] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.461190] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.461354] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.484476] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel

<4> [564.484742] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.485481] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.485641] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.505115] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.505491] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.526808] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.526968] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.528767] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.528934] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.548976] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.549135] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.571135] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.571294] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.572584] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.572759] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.592791] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.592946] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.614694] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.614851] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.616281] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.616517] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.638046] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.638333] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.658634] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.658794] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.660240] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.660470] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.682652] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.682814] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.704035] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.704195] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.705837] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.706005] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.725888] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.726044] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.748565] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.748713] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.749565] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.749724] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.769744] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.769902] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.791699] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.791856] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.793278] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.793504] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.813901] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.814059] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.836164] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.836324] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.837506] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.837686] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.857751] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.857907] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.880048] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.880207] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.881987] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.882143] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.903079] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.903245] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.924747] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.924907] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.926355] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.926509] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.946675] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.946831] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.968712] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.968868] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.970354] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.970525] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [564.990833] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [564.991020] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.012668] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.012825] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.014252] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.014415] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.034658] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.034813] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.057017] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.057180] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.058543] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad

<4> [565.058701] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.078791] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.078949] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.100761] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.100919] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.102514] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.102673] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.122732] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.122889] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.144711] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.144868] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.146338] mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe]

<4> [565.146501] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.166719] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.166877] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.188757] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.188928] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.190528] snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe]

<4> [565.190686] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.210772] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.210945] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.232572] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.232731] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.234202] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.234398] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.254985] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.255154] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.276928] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.277103] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.278910] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec

<4> [565.278924] drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe]

<4> [565.279077] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.300122] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.300285] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.321641] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.321805] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.323170] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.323324] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.343894] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.344067] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.365974] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.366139] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.368163] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.368409] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.389879] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.390043] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.412990] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.413153] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.414738] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl

<4> [565.414792] usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe]

<4> [565.414972] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.435863] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.436024] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.458152] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.458315] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.459460] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.459645] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.480576] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel

<4> [565.480610] wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe]

<4> [565.480738] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.500671] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.500829] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.501703] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.501885] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.522757] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.522914] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.545069] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.545229] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.545950] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.546130] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.567968] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.568164] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.588738] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.588895] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.590416] snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe]

<4> [565.590576] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.612106] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.612349] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.632652] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.632822] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.634262] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.634428] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.654620] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.654777] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.677757] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.677919] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.679358] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.679514] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.699984] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.700144] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.722820] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.723022] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.723699] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.723861] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.744605] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.744779] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.764684] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.764844] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [565.766635] Modules linked in: snd_hda_intel xe snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart asus_nb_wmi asus_wmi spi_nor mei_pxp mei_hdcp sparse_keymap mtd kvm_intel wmi_bmof binfmt_misc kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid hid intel_cstate realtek phy_package video idma64 snd_intel_dspcfg snd_hda_codec snd_hda_core intel_pmc_core snd_hwdep nls_iso8859_1 snd_pcm pmt_telemetry pmt_discovery snd_timer snd pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_tad mei_me i2c_i801 acpi_pad soundcore spi_intel_pci i2c_mux i2c_smbus spi_intel intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [565.766799] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 30 dc 3c e1 48 89 c6 48 8d 3d 56 93 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

Results for igt@xe_pat@pt-caching