igt@xe_pat@pt-caching-update-pat-and-pte on shard-bmg@xe-pw-167950v1 Test details

Detail	Value
Duration	unknown
Hostname	shard-bmg-7
Igt-Version	IGT-Version: 2.4-g53cdcbd04 (x86_64) (Linux: 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ x86_64)
Out	Using IGT_SRANDOM=1780700041 for randomisation Opened device: /dev/dri/card0 Test requirement not met in function __igt_unique____real_main2210, file ../tests/intel/xe_pat.c:2291: Test requirement: intel_graphics_ver(dev_id) == IP_VER(35, 10) Last errno: 2, No such file or directory Starting subtest: pt-caching-update-pat-and-pte va_bits: 48, num_objs: 16384, spread over pt levels: [0]: 16384 [1]: 512 [2]: 16 runner: This test was killed due to a kernel taint (0x244). This test caused an abort condition: Kernel badly tainted (0x244, 0x200) (check dmesg for details): TAINT_WARN: WARN_ON has happened.
Err	Starting subtest: pt-caching-update-pat-and-pte Received signal SIGQUIT. Stack trace: #0 [fatal_sig_handler+0x17b] #1 [__sigaction+0x50] #2 [ioctl+0x3b] #3 [drmIoctl+0x30] #4 [__syncobj_wait+0x2b] #5 [syncobj_wait+0x3f] #6 [pt_bind_objects+0xef] #7 [pt_caching_test+0x2ea] #8 [__igt_unique____real_main2210+0x141f] #9 [main+0x3a] #10 [__libc_init_first+0x8a] #11 [__libc_start_main+0x8b] #12 [_start+0x25]
Dmesg Scroll to first warning	<6> [231.230966] Console: switching to colour dummy device 80x25 <6> [231.231280] [IGT] xe_pat: executing <6> [231.258856] [IGT] xe_pat: starting subtest pt-caching-update-pat-and-pte <7> [231.534190] xe 0000:03:00.0: [drm:intel_power_well_enable [xe]] enabling AUX_TC2 <7> [231.638038] xe 0000:03:00.0: [drm:intel_power_well_disable [xe]] disabling AUX_TC2 <6> [232.330041] xe 0000:03:00.0: [drm] Tile0: GT0: ASID: 0 Faulted Address: 0x000000000060b000 FaultType: 0 AccessType: 1 FaultLevel: 0 EngineClass: 3 bcs EngineInstance: 8 <6> [232.330056] xe 0000:03:00.0: [drm] Tile0: GT0: Fault response: Unsuccessful -EINVAL <6> [232.330156] xe 0000:03:00.0: [drm] Tile0: GT0: Engine memory CAT error [18]: class=bcs, logical_mask: 0x2, guc_id=0 <7> [232.331033] xe 0000:03:00.0: [drm:xe_hw_engine_snapshot_capture [xe]] Tile0: GT0: Proceeding with manual engine snapshot <6> [232.331685] xe 0000:03:00.0: [drm] Tile0: GT0: Engine reset: engine_class=bcs, logical_mask: 0x2, guc_id=0, state=0x249 <5> [232.331695] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46866, lrc_seqno=46866, guc_id=0, flags=0x73 in no process [-1] <6> [232.511442] xe 0000:03:00.0: [drm] Xe device coredump has been created <6> [232.511465] xe 0000:03:00.0: [drm] Check your /sys/class/drm/card0/device/devcoredump/data <4> [232.511468] ------------[ cut here ]------------ <4> [232.511470] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.511472] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:8/994 <4> [232.511571] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.511677] CPU: 8 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.511680] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER <4> [232.511681] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.511683] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.511689] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.511761] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.511762] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [232.511764] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.511766] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.511767] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.511768] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.511769] R13: ffff888103fac890 R14: ffff888142bb8000 R15: 00000000fffffffb <4> [232.511771] FS: 0000000000000000(0000) GS:ffff8888dae82000(0000) knlGS:0000000000000000 <4> [232.511772] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.511773] CR2: 00007ad37e004c38 CR3: 000000012b66c003 CR4: 0000000000f72ef0 <4> [232.511775] PKRU: 55555554 <4> [232.511776] Call Trace: <4> [232.511777] <TASK> <4> [232.511781] ? __pfx_lock_acquire+0x10/0x10 <4> [232.511787] ? __pfx_autoremove_wake_function+0x10/0x10 <4> [232.511792] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.511797] process_one_work+0x239/0x740 <4> [232.511804] worker_thread+0x200/0x3f0 <4> [232.511806] ? __pfx_worker_thread+0x10/0x10 <4> [232.511809] kthread+0x10d/0x150 <4> [232.511811] ? __pfx_kthread+0x10/0x10 <4> [232.511814] ret_from_fork+0x3bd/0x470 <4> [232.511816] ? __pfx_kthread+0x10/0x10 <4> [232.511819] ret_from_fork_asm+0x1a/0x30 <4> [232.511826] </TASK> <4> [232.511827] irq event stamp: 748581 <4> [232.511828] hardirqs last enabled at (748587): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.511830] hardirqs last disabled at (748592): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.511832] softirqs last enabled at (747684): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.511835] softirqs last disabled at (747661): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.511837] ---[ end trace 0000000000000000 ]--- <6> [232.512061] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.512158] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.512521] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.513218] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.513812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.513919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.514023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.514117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.514202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.514286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.514368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.514452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.514533] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.514625] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.514714] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.515860] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.526653] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.526941] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.528431] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.528521] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.528603] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.528683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.528761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.528850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.528937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.529020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.529104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.529189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.529279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.529365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.529449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.529532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.529615] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.529699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.529782] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.529873] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.529958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.530057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.530151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [232.530244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.530334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.530425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [232.530528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.530616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.530702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.530789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.530885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.530979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.531072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.531162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.531255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.531343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.531439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.531538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.531636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.531730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [232.531821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.531920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.532008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [232.532095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.532180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.532268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [232.532358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.532446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.532535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [232.532628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.532716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.532806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [232.532903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.532989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.533077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [232.533164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.533250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.533338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [232.533425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.533516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.533605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.533696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.533784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.533891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [232.533983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.534069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.534157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [232.534243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.534329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.534419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.534510] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.535841] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.535850] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46866, lrc_seqno=46866, guc_id=0, flags=0x73 in no process [-1] <7> [232.535854] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.535990] ------------[ cut here ]------------ <4> [232.535991] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.535993] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:8/994 <4> [232.536079] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer <7> [232.536074] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [232.536133] i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.536151] CPU: 10 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.536154] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.536155] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.536157] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.536162] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.536240] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.536242] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [232.536244] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.536246] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.536247] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.536248] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.536249] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <7> [232.536198] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [232.536251] FS: 0000000000000000(0000) GS:ffff8888daf82000(0000) knlGS:0000000000000000 <4> [232.536252] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.536253] CR2: 00007dc95c08b088 CR3: 000000012991f006 CR4: 0000000000f72ef0 <4> [232.536255] PKRU: 55555554 <4> [232.536256] Call Trace: <4> [232.536257] <TASK> <4> [232.536260] ? __pfx_lock_acquire+0x10/0x10 <4> [232.536266] ? lock_release+0xd0/0x2b0 <4> [232.536271] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.536276] process_one_work+0x239/0x740 <4> [232.536283] worker_thread+0x200/0x3f0 <4> [232.536286] ? __pfx_worker_thread+0x10/0x10 <4> [232.536289] kthread+0x10d/0x150 <4> [232.536291] ? __pfx_kthread+0x10/0x10 <4> [232.536294] ret_from_fork+0x3bd/0x470 <4> [232.536296] ? __pfx_kthread+0x10/0x10 <4> [232.536299] ret_from_fork_asm+0x1a/0x30 <4> [232.536306] </TASK> <4> [232.536310] irq event stamp: 751761 <4> [232.536311] hardirqs last enabled at (751767): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.536314] hardirqs last disabled at (751772): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.536316] softirqs last enabled at (750724): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.536319] softirqs last disabled at (750717): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.536321] ---[ end trace 0000000000000000 ]--- <6> [232.536323] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.536401] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.536408] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.536686] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.536907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.537005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.537102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.537197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.537287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.537377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.537466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.537558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.537644] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.537746] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.537854] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.538908] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.548841] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.549102] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.550133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.550220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.550305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.550387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.550468] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.550549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.550629] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.550708] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.550787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.550876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.550955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.551032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.551109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.551186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.551265] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.551343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.551420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.551499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.551579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.551666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.551754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [232.551848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.551937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.552026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [232.552111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.552192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.552272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.552352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.552432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.552514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.552598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.552682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.552768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.552867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.552957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.553045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.553131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.553216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [232.553299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.553381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.553463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [232.553544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.553625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.553708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [232.553795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.553887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.553970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [232.554052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.554132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.554216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [232.554306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.554392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.554476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [232.554559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.554641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.554723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [232.554804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.554894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.554978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.555063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.555146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.555228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [232.555310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.555393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.555479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [232.555561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.555642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.555722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.555806] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.556148] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.556152] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46866, lrc_seqno=46866, guc_id=0, flags=0x73 in no process [-1] <7> [232.556155] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.556225] ------------[ cut here ]------------ <4> [232.556226] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.556227] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:8/994 <4> [232.556309] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.556376] CPU: 10 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.556379] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.556380] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.556382] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.556387] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.556465] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.556467] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [232.556469] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.556471] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.556472] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.556473] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.556474] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.556476] FS: 0000000000000000(0000) GS:ffff8888daf82000(0000) knlGS:0000000000000000 <4> [232.556477] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.556479] CR2: 00007dc95c08b088 CR3: 000000012991f006 CR4: 0000000000f72ef0 <4> [232.556480] PKRU: 55555554 <4> [232.556481] Call Trace: <4> [232.556483] <TASK> <4> [232.556486] ? __pfx_lock_acquire+0x10/0x10 <4> [232.556492] ? lock_release+0xd0/0x2b0 <4> [232.556497] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.556503] process_one_work+0x239/0x740 <4> [232.556509] worker_thread+0x200/0x3f0 <4> [232.556512] ? __pfx_worker_thread+0x10/0x10 <4> [232.556515] kthread+0x10d/0x150 <4> [232.556517] ? __pfx_kthread+0x10/0x10 <4> [232.556520] ret_from_fork+0x3bd/0x470 <4> [232.556523] ? __pfx_kthread+0x10/0x10 <4> [232.556526] ret_from_fork_asm+0x1a/0x30 <4> [232.556533] </TASK> <4> [232.556534] irq event stamp: 754931 <4> [232.556535] hardirqs last enabled at (754937): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.556538] hardirqs last disabled at (754942): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.556540] softirqs last enabled at (753846): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.556543] softirqs last disabled at (753839): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.556545] ---[ end trace 0000000000000000 ]--- <5> [232.558437] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46921, lrc_seqno=46921, guc_id=0, flags=0x73 in no process [-1] <7> [232.558443] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [232.558445] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.558566] ------------[ cut here ]------------ <4> [232.558568] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [232.558556] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [232.558570] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#13: kworker/u64:10/996 <4> [232.558697] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.558794] CPU: 13 UID: 0 PID: 996 Comm: kworker/u64:10 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.558798] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.558800] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.558802] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.558810] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.558940] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.558943] RSP: 0018:ffffc900034ffca0 EFLAGS: 00010246 <4> [232.558946] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.558948] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.558950] RBP: ffffc900034ffdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.558952] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.558954] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.558956] FS: 0000000000000000(0000) GS:ffff8888db102000(0000) knlGS:0000000000000000 <4> [232.558959] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.558961] CR2: 00005ae5e922ab78 CR3: 000000000364a005 CR4: 0000000000f72ef0 <4> [232.558964] PKRU: 55555554 <4> [232.558966] Call Trace: <4> [232.558968] <TASK> <4> [232.558974] ? __pfx_lock_acquire+0x10/0x10 <4> [232.558982] ? lock_release+0xd0/0x2b0 <4> [232.558990] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.559000] process_one_work+0x239/0x740 <4> [232.559011] worker_thread+0x200/0x3f0 <4> [232.559016] ? __pfx_worker_thread+0x10/0x10 <4> [232.559020] kthread+0x10d/0x150 <4> [232.559023] ? __pfx_kthread+0x10/0x10 <4> [232.559028] ret_from_fork+0x3bd/0x470 <4> [232.559031] ? __pfx_kthread+0x10/0x10 <4> [232.559035] ret_from_fork_asm+0x1a/0x30 <4> [232.559048] </TASK> <4> [232.559050] irq event stamp: 1115459 <4> [232.559052] hardirqs last enabled at (1115465): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.559055] hardirqs last disabled at (1115470): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.559058] softirqs last enabled at (1115298): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.559062] softirqs last disabled at (1115291): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.559066] ---[ end trace 0000000000000000 ]--- <6> [232.559068] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.559190] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.559201] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.559255] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.559522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.559666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.559811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.559986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.560145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.560291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.560436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.560582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.560722] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.560882] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.561030] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.562411] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.572837] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.573159] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.574323] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.574453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.574580] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.574710] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.574845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.574974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.575103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.575231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.575359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.575487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.575615] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.575743] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.575887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.575981] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.576066] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.576148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.576228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.576308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.576389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.576478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.576565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [232.576649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.576732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.576814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [232.576911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.576993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.577077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.577157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.577236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.577319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.577402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.577483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.577564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.577645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.577734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.577822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.577930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.578017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [232.578104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.578184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.578266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [232.578346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.578426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.578507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [232.578592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.578678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.578766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [232.578856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.578938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.579022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [232.579105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.579185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.579268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [232.579353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.579435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.579518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [232.579600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.579680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.579759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.579846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.579927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.580008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [232.580087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.580166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.580251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [232.580332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.580413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.580494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.580579] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.581679] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.581685] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46921, lrc_seqno=46921, guc_id=0, flags=0x73 in no process [-1] <7> [232.581688] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.581758] ------------[ cut here ]------------ <4> [232.581759] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.581760] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:38/3092 <4> [232.581867] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.581939] CPU: 0 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.581942] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.581943] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.581944] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.581950] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.582027] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.582029] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [232.582031] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.582033] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.582034] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.582035] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.582036] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.582038] FS: 0000000000000000(0000) GS:ffff8888daa82000(0000) knlGS:0000000000000000 <4> [232.582039] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.582041] CR2: 0000777b68513008 CR3: 0000000129906004 CR4: 0000000000f72ef0 <4> [232.582042] PKRU: 55555554 <4> [232.582043] Call Trace: <4> [232.582044] <TASK> <4> [232.582048] ? __pfx_lock_acquire+0x10/0x10 <4> [232.582054] ? lock_release+0xd0/0x2b0 <4> [232.582058] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.582064] process_one_work+0x239/0x740 <4> [232.582071] worker_thread+0x200/0x3f0 <4> [232.582074] ? __pfx_worker_thread+0x10/0x10 <4> [232.582076] kthread+0x10d/0x150 <4> [232.582079] ? __pfx_kthread+0x10/0x10 <4> [232.582082] ret_from_fork+0x3bd/0x470 <4> [232.582084] ? __pfx_kthread+0x10/0x10 <4> [232.582087] ret_from_fork_asm+0x1a/0x30 <4> [232.582094] </TASK> <4> [232.582095] irq event stamp: 470021 <4> [232.582096] hardirqs last enabled at (470027): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.582099] hardirqs last disabled at (470032): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.582100] softirqs last enabled at (469284): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.582103] softirqs last disabled at (469275): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.582106] ---[ end trace 0000000000000000 ]--- <6> [232.582108] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.582186] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.582193] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.582898] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [232.583012] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [232.583388] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.583605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.583704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.583802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.583907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.583998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.584089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.584179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.584275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.584363] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.584466] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.584559] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.585597] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.595829] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.596085] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.597182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.597268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.597349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.597435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.597518] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.597599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.597678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.597768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.597862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.597941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.598021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.598098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.598175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.598254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.598334] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.598416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.598494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.598571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.598650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.598737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.598836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [232.598922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.599004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.599086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [232.599168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.599248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.599327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.599408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.599488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.599572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.599659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.599741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.599827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.599908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.599995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.600082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.600170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.600255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [232.600338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.600422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.600507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [232.600591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.600672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.600754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [232.600846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.600929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.601011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [232.601096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.601181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.601266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [232.601351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.601434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.601518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [232.601600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.601683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.601770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [232.601858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.601937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.602016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.602099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.602180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.602263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [232.602349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.602431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.602515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [232.602597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.602677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.602757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.602841] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.602963] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.602967] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46921, lrc_seqno=46921, guc_id=0, flags=0x73 in no process [-1] <7> [232.602970] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.603041] ------------[ cut here ]------------ <4> [232.603042] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.603044] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:38/3092 <4> [232.603123] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.603189] CPU: 0 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.603192] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.603193] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.603195] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.603200] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.603279] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.603281] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [232.603283] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.603284] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.603285] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.603287] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.603288] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.603289] FS: 0000000000000000(0000) GS:ffff8888daa82000(0000) knlGS:0000000000000000 <4> [232.603291] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.603292] CR2: 0000777b68513008 CR3: 0000000129906004 CR4: 0000000000f72ef0 <4> [232.603294] PKRU: 55555554 <4> [232.603295] Call Trace: <4> [232.603296] <TASK> <4> [232.603300] ? __pfx_lock_acquire+0x10/0x10 <4> [232.603305] ? lock_release+0xd0/0x2b0 <4> [232.603309] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.603315] process_one_work+0x239/0x740 <4> [232.603322] worker_thread+0x200/0x3f0 <4> [232.603325] ? __pfx_worker_thread+0x10/0x10 <4> [232.603327] kthread+0x10d/0x150 <4> [232.603330] ? __pfx_kthread+0x10/0x10 <4> [232.603333] ret_from_fork+0x3bd/0x470 <4> [232.603335] ? __pfx_kthread+0x10/0x10 <4> [232.603338] ret_from_fork_asm+0x1a/0x30 <4> [232.603345] </TASK> <4> [232.603346] irq event stamp: 473251 <4> [232.603347] hardirqs last enabled at (473257): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.603350] hardirqs last disabled at (473262): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.603351] softirqs last enabled at (472080): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.603354] softirqs last disabled at (472035): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.603357] ---[ end trace 0000000000000000 ]--- <5> [232.604162] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46976, lrc_seqno=46976, guc_id=0, flags=0x73 in no process [-1] <7> [232.604168] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.604276] ------------[ cut here ]------------ <4> [232.604277] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.604279] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:38/3092 <4> [232.604365] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.604440] CPU: 7 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.604443] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.604444] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.604446] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.604453] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.604540] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.604542] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [232.604545] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.604546] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.604547] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.604549] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.604550] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.604551] FS: 0000000000000000(0000) GS:ffff8888dae02000(0000) knlGS:0000000000000000 <4> [232.604553] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.604554] CR2: 00007ad37e004f58 CR3: 000000012991f002 CR4: 0000000000f72ef0 <4> [232.604555] PKRU: 55555554 <4> [232.604557] Call Trace: <4> [232.604558] <TASK> <4> [232.604562] ? __pfx_lock_acquire+0x10/0x10 <4> [232.604567] ? lock_release+0xd0/0x2b0 <4> [232.604571] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.604577] process_one_work+0x239/0x740 <4> [232.604584] worker_thread+0x200/0x3f0 <4> [232.604587] ? __pfx_worker_thread+0x10/0x10 <4> [232.604590] kthread+0x10d/0x150 <4> [232.604592] ? __pfx_kthread+0x10/0x10 <4> [232.604595] ret_from_fork+0x3bd/0x470 <4> [232.604597] ? __pfx_kthread+0x10/0x10 <4> [232.604600] ret_from_fork_asm+0x1a/0x30 <4> [232.604607] </TASK> <4> [232.604609] irq event stamp: 475193 <4> [232.604610] hardirqs last enabled at (475199): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.604612] hardirqs last disabled at (475204): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.604614] softirqs last enabled at (472080): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.604617] softirqs last disabled at (472035): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.604619] ---[ end trace 0000000000000000 ]--- <6> [232.604621] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.604700] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.604707] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.604677] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [232.604845] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [232.605010] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.605270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.605408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.605553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.605694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.605839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.605978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.606118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.606259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.606397] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.606545] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.606691] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.608030] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.617827] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.618144] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.619320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.619448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.619574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.619702] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.619836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.619965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.620094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.620222] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.620350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.620478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.620606] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.620734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.620866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.621004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.621100] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.621189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.621272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.621354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.621435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.621523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.621610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [232.621698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.621783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.621879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [232.621963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.622044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.622126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.622206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.622287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.622371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.622456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.622539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.622626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.622712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.622802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.622907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.622996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.623080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [232.623164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.623246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.623330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [232.623413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.623495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.623577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [232.623659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.623740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.623824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [232.623906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.623985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.624066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [232.624149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.624232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.624318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [232.624401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.624482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.624564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [232.624647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.624727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.624811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.624908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.624991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.625074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [232.625156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.625236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.625318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [232.625399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.625478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.625557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.625641] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.625764] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.625769] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46976, lrc_seqno=46976, guc_id=0, flags=0x73 in no process [-1] <7> [232.625771] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.626839] ------------[ cut here ]------------ <4> [232.626842] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.626846] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#12: kworker/u64:8/994 <4> [232.627010] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.627111] CPU: 12 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.627115] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.627117] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.627119] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.627128] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <7> [232.627176] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [232.627252] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.627254] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [232.627257] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.627259] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.627260] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.627262] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.627263] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.627265] FS: 0000000000000000(0000) GS:ffff8888db082000(0000) knlGS:0000000000000000 <4> [232.627267] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.627269] CR2: 00007a957400b048 CR3: 000000012991f003 CR4: 0000000000f72ef0 <4> [232.627270] PKRU: 55555554 <4> [232.627272] Call Trace: <4> [232.627273] <TASK> <4> [232.627279] ? __pfx_lock_acquire+0x10/0x10 <4> [232.627287] ? lock_release+0xd0/0x2b0 <4> [232.627295] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.627305] process_one_work+0x239/0x740 <4> [232.627316] worker_thread+0x200/0x3f0 <4> [232.627321] ? __pfx_worker_thread+0x10/0x10 <4> [232.627325] kthread+0x10d/0x150 <4> [232.627328] ? __pfx_kthread+0x10/0x10 <4> [232.627333] ret_from_fork+0x3bd/0x470 <4> [232.627336] ? __pfx_kthread+0x10/0x10 <7> [232.627289] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [232.627340] ret_from_fork_asm+0x1a/0x30 <4> [232.627353] </TASK> <4> [232.627354] irq event stamp: 758593 <4> [232.627356] hardirqs last enabled at (758599): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.627359] hardirqs last disabled at (758604): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.627361] softirqs last enabled at (757606): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.627365] softirqs last disabled at (757599): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.627368] ---[ end trace 0000000000000000 ]--- <6> [232.627379] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.627470] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.627630] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.628044] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.628407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.628510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.628613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.628708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.628800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.628914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.629010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.629103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.629189] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.629288] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.629382] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.630419] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.640820] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.641079] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.642099] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.642184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.642264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.642344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.642439] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.642520] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.642600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.642681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.642765] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.642855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.642936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.643016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.643095] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.643174] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.643252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.643330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.643412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.643494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.643575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.643662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.643750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [232.643841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.643925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.644009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [232.644092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.644173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.644256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.644337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.644418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.644503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.644589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.644672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.644754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.644843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.644931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.645018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.645107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.645196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [232.645283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.645365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.645449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [232.645531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.645611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.645693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [232.645777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.645871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.645958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [232.646044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.646125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.646206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [232.646290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.646371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.646454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [232.646537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.646618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.646699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [232.646780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.646872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.646955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.647039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.647123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.647205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [232.647286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.647370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.647453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [232.647537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.647618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.647699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.647782] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.647912] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.647916] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=46976, lrc_seqno=46976, guc_id=0, flags=0x73 in no process [-1] <7> [232.647919] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.647987] ------------[ cut here ]------------ <4> [232.647988] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.647990] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:37/3091 <4> [232.648067] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.648133] CPU: 10 UID: 0 PID: 3091 Comm: kworker/u64:37 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.648136] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.648137] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.648139] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.648144] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.648221] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.648223] RSP: 0018:ffffc90007bb3ca0 EFLAGS: 00010246 <4> [232.648225] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.648227] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.648228] RBP: ffffc90007bb3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.648229] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.648230] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.648232] FS: 0000000000000000(0000) GS:ffff8888daf82000(0000) knlGS:0000000000000000 <4> [232.648233] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.648235] CR2: 00007dc968a6e000 CR3: 000000012991f006 CR4: 0000000000f72ef0 <4> [232.648236] PKRU: 55555554 <4> [232.648237] Call Trace: <4> [232.648238] <TASK> <4> [232.648242] ? __pfx_lock_acquire+0x10/0x10 <4> [232.648247] ? lock_release+0xd0/0x2b0 <4> [232.648252] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.648258] process_one_work+0x239/0x740 <4> [232.648265] worker_thread+0x200/0x3f0 <4> [232.648268] ? __pfx_worker_thread+0x10/0x10 <4> [232.648270] kthread+0x10d/0x150 <4> [232.648272] ? __pfx_kthread+0x10/0x10 <4> [232.648275] ret_from_fork+0x3bd/0x470 <4> [232.648278] ? __pfx_kthread+0x10/0x10 <4> [232.648280] ret_from_fork_asm+0x1a/0x30 <4> [232.648288] </TASK> <4> [232.648289] irq event stamp: 1810793 <4> [232.648290] hardirqs last enabled at (1810799): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.648292] hardirqs last disabled at (1810804): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.648294] softirqs last enabled at (1809964): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.648297] softirqs last disabled at (1809957): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.648299] ---[ end trace 0000000000000000 ]--- <5> [232.649734] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47031, lrc_seqno=47031, guc_id=0, flags=0x73 in no process [-1] <7> [232.649737] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.649833] ------------[ cut here ]------------ <4> [232.649836] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.649838] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:37/3091 <7> [232.649833] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [232.649973] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me <7> [232.649999] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [232.650073] snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.650094] CPU: 11 UID: 0 PID: 3091 Comm: kworker/u64:37 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.650097] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.650099] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.650101] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.650108] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.650208] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.650210] RSP: 0018:ffffc90007bb3ca0 EFLAGS: 00010246 <4> [232.650212] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.650213] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.650215] RBP: ffffc90007bb3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.650216] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.650217] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.650219] FS: 0000000000000000(0000) GS:ffff8888db002000(0000) knlGS:0000000000000000 <4> [232.650220] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.650221] CR2: 00005ae5e903142c CR3: 000000000364a001 CR4: 0000000000f72ef0 <4> [232.650223] PKRU: 55555554 <4> [232.650224] Call Trace: <4> [232.650225] <TASK> <4> [232.650229] ? __pfx_lock_acquire+0x10/0x10 <4> [232.650234] ? lock_release+0xd0/0x2b0 <4> [232.650239] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.650246] process_one_work+0x239/0x740 <4> [232.650253] worker_thread+0x200/0x3f0 <4> [232.650256] ? __pfx_worker_thread+0x10/0x10 <4> [232.650258] kthread+0x10d/0x150 <4> [232.650260] ? __pfx_kthread+0x10/0x10 <4> [232.650263] ret_from_fork+0x3bd/0x470 <4> [232.650266] ? __pfx_kthread+0x10/0x10 <4> [232.650268] ret_from_fork_asm+0x1a/0x30 <4> [232.650276] </TASK> <4> [232.650277] irq event stamp: 1812689 <4> [232.650278] hardirqs last enabled at (1812695): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.650280] hardirqs last disabled at (1812700): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.650282] softirqs last enabled at (1809964): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.650285] softirqs last disabled at (1809957): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.650287] ---[ end trace 0000000000000000 ]--- <6> [232.650290] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.650370] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.650378] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.650478] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.650694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.650789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.650906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.651000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.651092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.651183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.651275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.651371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.651459] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.651560] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.651655] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.652696] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.662818] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.663076] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.664076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.664161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.664243] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.664327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.664407] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.664488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.664566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.664646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.664725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.664803] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.664898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.664976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.665053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.665131] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.665208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.665286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.665364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.665442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.665521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.665609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.665698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [232.665781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.665876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.665958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [232.666038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.666119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.666200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.666280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.666359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.666443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.666525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.666605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.666687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.666769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.666867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.666955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.667044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.667130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [232.667214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.667295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.667379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [232.667461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.667543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.667625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [232.667708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.667791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.667891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [232.667975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.668056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.668141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [232.668225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.668310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.668396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [232.668481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.668564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.668648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [232.668732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.668821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.668904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.668991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.669074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.669157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [232.669240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.669319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.669403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [232.669484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.669568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.669650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.669735] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.669860] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.669865] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47031, lrc_seqno=47031, guc_id=0, flags=0x73 in no process [-1] <7> [232.669867] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.669935] ------------[ cut here ]------------ <4> [232.669936] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.669937] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:37/3091 <4> [232.670017] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.670083] CPU: 11 UID: 0 PID: 3091 Comm: kworker/u64:37 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.670086] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.670087] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.670089] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.670094] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.670172] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.670174] RSP: 0018:ffffc90007bb3ca0 EFLAGS: 00010246 <4> [232.670176] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.670177] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.670178] RBP: ffffc90007bb3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.670180] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.670181] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.670182] FS: 0000000000000000(0000) GS:ffff8888db002000(0000) knlGS:0000000000000000 <4> [232.670184] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.670185] CR2: 00005ae5e903142c CR3: 000000000364a001 CR4: 0000000000f72ef0 <4> [232.670186] PKRU: 55555554 <4> [232.670188] Call Trace: <4> [232.670189] <TASK> <4> [232.670192] ? __pfx_lock_acquire+0x10/0x10 <4> [232.670197] ? lock_release+0xd0/0x2b0 <4> [232.670202] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.670208] process_one_work+0x239/0x740 <4> [232.670215] worker_thread+0x200/0x3f0 <4> [232.670218] ? __pfx_worker_thread+0x10/0x10 <4> [232.670220] kthread+0x10d/0x150 <4> [232.670223] ? __pfx_kthread+0x10/0x10 <4> [232.670226] ret_from_fork+0x3bd/0x470 <4> [232.670228] ? __pfx_kthread+0x10/0x10 <4> [232.670230] ret_from_fork_asm+0x1a/0x30 <4> [232.670238] </TASK> <4> [232.670239] irq event stamp: 1815837 <4> [232.670240] hardirqs last enabled at (1815843): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.670242] hardirqs last disabled at (1815848): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.670244] softirqs last enabled at (1814856): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.670247] softirqs last disabled at (1814849): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.670250] ---[ end trace 0000000000000000 ]--- <6> [232.670251] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.670328] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.670334] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.671572] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [232.671685] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [232.671797] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.672060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.672159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.672257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.672349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.672439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.672529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.672618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.672708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.672793] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.672906] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.673004] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.674054] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.683822] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.684079] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.685094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.685179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.685261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.685342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.685424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.685505] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.685588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.685671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.685751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.685838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.685917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.685995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.686073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.686151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.686230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.686308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.686390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.686469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.686547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.686636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.686724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [232.686810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.686890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.686975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [232.687056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.687138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.687222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.687305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.687387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.687469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.687558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.687641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.687725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.687812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.687902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.687992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.688082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.688170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [232.688255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.688337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.688419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [232.688501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.688582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.688665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [232.688751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.688841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.688927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [232.689010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.689092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.689174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [232.689258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.689338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.689419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [232.689499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.689581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.689666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [232.689748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.689832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.689912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.689997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.690080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.690164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [232.690250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.690334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.690417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [232.690499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.690579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.690658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.690745] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.690874] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.690879] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47031, lrc_seqno=47031, guc_id=0, flags=0x73 in no process [-1] <7> [232.690881] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.690950] ------------[ cut here ]------------ <4> [232.690951] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.690952] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:38/3092 <4> [232.691032] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.691099] CPU: 7 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.691102] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.691103] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.691104] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.691110] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.691186] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.691188] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [232.691190] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.691192] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.691193] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.691194] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.691195] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.691197] FS: 0000000000000000(0000) GS:ffff8888dae02000(0000) knlGS:0000000000000000 <4> [232.691198] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.691199] CR2: 00007ad37e004f58 CR3: 000000012991f002 CR4: 0000000000f72ef0 <4> [232.691201] PKRU: 55555554 <4> [232.691202] Call Trace: <4> [232.691203] <TASK> <4> [232.691207] ? __pfx_lock_acquire+0x10/0x10 <4> [232.691212] ? lock_release+0xd0/0x2b0 <4> [232.691217] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.691223] process_one_work+0x239/0x740 <4> [232.691229] worker_thread+0x200/0x3f0 <4> [232.691232] ? __pfx_worker_thread+0x10/0x10 <4> [232.691235] kthread+0x10d/0x150 <4> [232.691237] ? __pfx_kthread+0x10/0x10 <4> [232.691240] ret_from_fork+0x3bd/0x470 <4> [232.691242] ? __pfx_kthread+0x10/0x10 <4> [232.691245] ret_from_fork_asm+0x1a/0x30 <4> [232.691252] </TASK> <4> [232.691253] irq event stamp: 481651 <4> [232.691255] hardirqs last enabled at (481657): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.691257] hardirqs last disabled at (481662): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.691259] softirqs last enabled at (480662): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.691261] softirqs last disabled at (480655): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.691264] ---[ end trace 0000000000000000 ]--- <5> [232.691622] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47086, lrc_seqno=47086, guc_id=0, flags=0x73 in no process [-1] <7> [232.691703] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.692101] ------------[ cut here ]------------ <4> [232.692104] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.692108] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:38/3092 <4> [232.692481] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.692558] CPU: 6 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.692561] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.692562] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.692564] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.692569] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <7> [232.692603] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [232.692688] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.692690] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [232.692694] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.692696] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.692697] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.692699] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.692701] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.692703] FS: 0000000000000000(0000) GS:ffff8888dad82000(0000) knlGS:0000000000000000 <4> [232.692705] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.692706] CR2: 00007fff30088fe0 CR3: 000000000364a005 CR4: 0000000000f72ef0 <4> [232.692708] PKRU: 55555554 <4> [232.692709] Call Trace: <4> [232.692711] <TASK> <4> [232.692717] ? __pfx_lock_acquire+0x10/0x10 <4> [232.692723] ? lock_release+0xd0/0x2b0 <4> [232.692732] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.692742] process_one_work+0x239/0x740 <4> [232.692753] worker_thread+0x200/0x3f0 <4> [232.692757] ? __pfx_worker_thread+0x10/0x10 <4> [232.692761] kthread+0x10d/0x150 <4> [232.692765] ? __pfx_kthread+0x10/0x10 <4> [232.692769] ret_from_fork+0x3bd/0x470 <4> [232.692773] ? __pfx_kthread+0x10/0x10 <4> [232.692777] ret_from_fork_asm+0x1a/0x30 <4> [232.692790] </TASK> <4> [232.692792] irq event stamp: 483549 <4> [232.692794] hardirqs last enabled at (483555): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.692797] hardirqs last disabled at (483560): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.692799] softirqs last enabled at (482792): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.692810] softirqs last disabled at (483571): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.692813] ---[ end trace 0000000000000000 ]--- <7> [232.692774] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [232.692824] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.692912] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.692918] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.693155] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.693369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.693469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.693565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.693654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.693746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.693843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.693933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.694025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.694115] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.694216] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.694311] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.695348] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.705812] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.706072] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.707099] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.707186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.707268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.707350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.707432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.707512] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.707592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.707672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.707754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.707848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.707929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.708008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.708088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.708171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.708252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.708331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.708410] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.708490] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.708568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.708656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.708743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [232.708842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.708926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.709011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [232.709093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.709174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.709255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.709336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.709416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.709500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.709585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.709668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.709751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.709842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.709931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.710019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.710113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.710201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [232.710287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.710369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.710452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [232.710534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.710617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.710702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [232.710788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.710886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.710968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [232.711050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.711132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.711217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [232.711305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.711388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.711474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [232.711558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.711637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.711719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [232.711805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.711884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.711964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.712046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.712127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.712209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [232.712293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.712377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.712461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [232.712543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.712624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.712706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.712792] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.712932] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.712936] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47086, lrc_seqno=47086, guc_id=0, flags=0x73 in no process [-1] <7> [232.712939] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.713007] ------------[ cut here ]------------ <4> [232.713008] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.713009] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:38/3092 <4> [232.713089] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.713155] CPU: 10 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.713158] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.713159] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.713161] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.713166] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.713245] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.713247] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [232.713249] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.713250] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.713252] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.713253] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.713255] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.713258] FS: 0000000000000000(0000) GS:ffff8888daf82000(0000) knlGS:0000000000000000 <4> [232.713261] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.713264] CR2: 00007dc968a6e000 CR3: 000000012991f006 CR4: 0000000000f72ef0 <4> [232.713266] PKRU: 55555554 <4> [232.713269] Call Trace: <4> [232.713271] <TASK> <4> [232.713280] ? __pfx_lock_acquire+0x10/0x10 <4> [232.713290] ? lock_release+0xd0/0x2b0 <4> [232.713301] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.713312] process_one_work+0x239/0x740 <4> [232.713320] worker_thread+0x200/0x3f0 <4> [232.713323] ? __pfx_worker_thread+0x10/0x10 <4> [232.713327] kthread+0x10d/0x150 <4> [232.713329] ? __pfx_kthread+0x10/0x10 <4> [232.713333] ret_from_fork+0x3bd/0x470 <4> [232.713335] ? __pfx_kthread+0x10/0x10 <4> [232.713339] ret_from_fork_asm+0x1a/0x30 <4> [232.713348] </TASK> <4> [232.713349] irq event stamp: 486693 <4> [232.713350] hardirqs last enabled at (486699): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.713353] hardirqs last disabled at (486704): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.713355] softirqs last enabled at (485862): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.713359] softirqs last disabled at (485857): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.713362] ---[ end trace 0000000000000000 ]--- <6> [232.713372] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.713876] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.713890] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.714624] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [232.714735] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [232.714863] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.715076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.715173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.715271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.715363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.715453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.715541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.715634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.715728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.715823] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.715926] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.716023] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.717060] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.726804] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.727061] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.728026] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.728113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.728196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.728282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.728365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.728444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.728526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.728607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.728686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.728765] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.728862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.728940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.729019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.729096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.729173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.729254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.729335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.729415] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.729495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.729581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.729668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [232.729753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.729851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.729935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [232.730021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.730105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.730187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.730270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.730354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.730440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.730524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.730606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.730688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.730770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.730867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.730961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.731052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.731139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [232.731223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.731304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.731386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [232.731469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.731551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.731632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [232.731715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.731805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.731888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [232.731973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.732055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.732137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [232.732223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.732303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.732385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [232.732466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.732546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.732630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [232.732714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.732802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.732883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.732967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.733049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.733133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [232.733221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.733304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.733386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [232.733467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.733550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.733632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.733717] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.733853] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.733857] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47086, lrc_seqno=47086, guc_id=0, flags=0x73 in no process [-1] <7> [232.733860] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.733929] ------------[ cut here ]------------ <4> [232.733930] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.733932] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:38/3092 <4> [232.734011] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.734078] CPU: 2 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.734081] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.734082] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.734083] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.734089] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.734168] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.734170] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [232.734172] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.734173] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.734175] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.734176] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.734177] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.734178] FS: 0000000000000000(0000) GS:ffff8888dab82000(0000) knlGS:0000000000000000 <4> [232.734180] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.734181] CR2: 00007dc968a6d000 CR3: 0000000108194004 CR4: 0000000000f72ef0 <4> [232.734183] PKRU: 55555554 <4> [232.734184] Call Trace: <4> [232.734185] <TASK> <4> [232.734189] ? __pfx_lock_acquire+0x10/0x10 <4> [232.734194] ? lock_release+0xd0/0x2b0 <4> [232.734199] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.734205] process_one_work+0x239/0x740 <4> [232.734211] worker_thread+0x200/0x3f0 <4> [232.734215] ? __pfx_worker_thread+0x10/0x10 <4> [232.734217] kthread+0x10d/0x150 <4> [232.734219] ? __pfx_kthread+0x10/0x10 <4> [232.734222] ret_from_fork+0x3bd/0x470 <4> [232.734225] ? __pfx_kthread+0x10/0x10 <4> [232.734227] ret_from_fork_asm+0x1a/0x30 <4> [232.734235] </TASK> <4> [232.734236] irq event stamp: 489895 <4> [232.734237] hardirqs last enabled at (489901): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.734239] hardirqs last disabled at (489906): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.734241] softirqs last enabled at (489074): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.734244] softirqs last disabled at (489033): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.734246] ---[ end trace 0000000000000000 ]--- <5> [232.734695] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47141, lrc_seqno=47141, guc_id=0, flags=0x73 in no process [-1] <7> [232.734705] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.735112] ------------[ cut here ]------------ <4> [232.735117] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.735121] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:38/3092 <4> [232.735482] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.735558] CPU: 3 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.735561] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.735562] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.735564] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.735569] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.735652] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.735655] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [232.735659] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.735661] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.735663] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.735666] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.735667] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.735669] FS: 0000000000000000(0000) GS:ffff8888dac02000(0000) knlGS:0000000000000000 <4> [232.735672] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.735674] CR2: 000059a1b383f208 CR3: 000000000364a006 CR4: 0000000000f72ef0 <4> [232.735676] PKRU: 55555554 <4> [232.735678] Call Trace: <4> [232.735680] <TASK> <4> [232.735686] ? __pfx_lock_acquire+0x10/0x10 <4> [232.735692] ? lock_release+0xd0/0x2b0 <4> [232.735701] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.735712] process_one_work+0x239/0x740 <4> [232.735723] worker_thread+0x200/0x3f0 <4> [232.735728] ? __pfx_worker_thread+0x10/0x10 <7> [232.735655] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [232.735732] kthread+0x10d/0x150 <4> [232.735735] ? __pfx_kthread+0x10/0x10 <4> [232.735740] ret_from_fork+0x3bd/0x470 <4> [232.735743] ? __pfx_kthread+0x10/0x10 <4> [232.735747] ret_from_fork_asm+0x1a/0x30 <4> [232.735758] </TASK> <4> [232.735759] irq event stamp: 491775 <4> [232.735761] hardirqs last enabled at (491781): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.735763] hardirqs last disabled at (491786): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.735765] softirqs last enabled at (491020): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.735769] softirqs last disabled at (491013): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.735772] ---[ end trace 0000000000000000 ]--- <6> [232.735775] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [232.735822] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [232.735923] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.735937] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.736170] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.736384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.736481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.736582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.736674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.736766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.736899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.737016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.737115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.737204] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.737305] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.737401] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.738441] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.748802] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.749084] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.750263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.750350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.750431] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.750512] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.750591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.750670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.750749] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.750843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.750923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.751004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.751085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.751165] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.751244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.751322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.751400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.751478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.751556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.751633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.751710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.751807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.751896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [232.751982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.752065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.752152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [232.752237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.752318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.752398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.752479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.752563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.752646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.752729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.752824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.752912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.752997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.753087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.753177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.753265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.753350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [232.753433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.753514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.753597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [232.753683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.753767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.753860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [232.753944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.754026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.754108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [232.754190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.754275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.754358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [232.754446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.754529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.754612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [232.754695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.754776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.754872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [232.754954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.755033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.755112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.755195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.755277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.755360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [232.755447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.755532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.755617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [232.755702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.755786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.755886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.755975] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.756099] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.756104] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47141, lrc_seqno=47141, guc_id=0, flags=0x73 in no process [-1] <7> [232.756106] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.756174] ------------[ cut here ]------------ <4> [232.756176] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.756177] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:38/3092 <4> [232.756256] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.756323] CPU: 3 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.756326] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.756327] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.756328] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.756334] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.756410] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.756412] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [232.756414] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.756415] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.756417] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.756418] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.756419] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.756420] FS: 0000000000000000(0000) GS:ffff8888dac02000(0000) knlGS:0000000000000000 <4> [232.756422] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.756423] CR2: 000059a1b383f208 CR3: 000000012991f001 CR4: 0000000000f72ef0 <4> [232.756425] PKRU: 55555554 <4> [232.756426] Call Trace: <4> [232.756427] <TASK> <4> [232.756431] ? __pfx_lock_acquire+0x10/0x10 <4> [232.756436] ? lock_release+0xd0/0x2b0 <4> [232.756441] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.756447] process_one_work+0x239/0x740 <4> [232.756453] worker_thread+0x200/0x3f0 <4> [232.756456] ? __pfx_worker_thread+0x10/0x10 <4> [232.756459] kthread+0x10d/0x150 <4> [232.756461] ? __pfx_kthread+0x10/0x10 <4> [232.756464] ret_from_fork+0x3bd/0x470 <4> [232.756467] ? __pfx_kthread+0x10/0x10 <4> [232.756469] ret_from_fork_asm+0x1a/0x30 <4> [232.756476] </TASK> <4> [232.756478] irq event stamp: 494939 <4> [232.756479] hardirqs last enabled at (494945): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.756481] hardirqs last disabled at (494950): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.756483] softirqs last enabled at (493838): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.756486] softirqs last disabled at (493833): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.756488] ---[ end trace 0000000000000000 ]--- <6> [232.756490] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.756567] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.756572] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.757862] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [232.757971] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [232.758309] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.758524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.758622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.758721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.758819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.758913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.759003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.759092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.759182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.759269] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.759371] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.759469] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.760521] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.770799] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.771060] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.772070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.772155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.772237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.772320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.772402] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.772483] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.772565] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.772646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.772726] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.772814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.772893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.772973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.773053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.773135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.773220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.773299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.773376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.773454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.773531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.773619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.773706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [232.773799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.773886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.773971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [232.774053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.774134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.774213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.774300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.774382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.774466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.774551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.774632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.774714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.774804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.774896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.774987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.775074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.775159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [232.775244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.775328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.775414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [232.775494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.775576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.775658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [232.775743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.775836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.775923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [232.776008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.776090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.776174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [232.776258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.776337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.776419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [232.776504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.776587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.776670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [232.776753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.776842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.776922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.777007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.777090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.777172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [232.777254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.777334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.777416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [232.777500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.777582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.777664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.777749] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.777880] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.777885] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47141, lrc_seqno=47141, guc_id=0, flags=0x73 in no process [-1] <7> [232.777888] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.777955] ------------[ cut here ]------------ <4> [232.777956] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.777957] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:38/3092 <4> [232.778036] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.778102] CPU: 3 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.778105] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.778107] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.778108] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.778113] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.778189] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.778191] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [232.778193] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.778195] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.778196] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.778197] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.778198] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.778200] FS: 0000000000000000(0000) GS:ffff8888dac02000(0000) knlGS:0000000000000000 <4> [232.778201] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.778203] CR2: 000059a1b383f208 CR3: 000000012991f001 CR4: 0000000000f72ef0 <4> [232.778204] PKRU: 55555554 <4> [232.778205] Call Trace: <4> [232.778207] <TASK> <4> [232.778210] ? __pfx_lock_acquire+0x10/0x10 <4> [232.778215] ? lock_release+0xd0/0x2b0 <4> [232.778220] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.778226] process_one_work+0x239/0x740 <4> [232.778233] worker_thread+0x200/0x3f0 <4> [232.778236] ? __pfx_worker_thread+0x10/0x10 <4> [232.778239] kthread+0x10d/0x150 <4> [232.778241] ? __pfx_kthread+0x10/0x10 <4> [232.778244] ret_from_fork+0x3bd/0x470 <4> [232.778246] ? __pfx_kthread+0x10/0x10 <4> [232.778249] ret_from_fork_asm+0x1a/0x30 <4> [232.778256] </TASK> <4> [232.778257] irq event stamp: 498065 <4> [232.778258] hardirqs last enabled at (498071): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.778261] hardirqs last disabled at (498076): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.778263] softirqs last enabled at (496900): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.778265] softirqs last disabled at (496895): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.778268] ---[ end trace 0000000000000000 ]--- <5> [232.778809] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47196, lrc_seqno=47196, guc_id=0, flags=0x73 in no process [-1] <7> [232.778819] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.779188] ------------[ cut here ]------------ <4> [232.779191] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.779194] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:38/3092 <4> [232.779503] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.779572] CPU: 2 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.779574] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.779575] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.779577] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.779584] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <7> [232.779601] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [232.779730] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.779733] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [232.779736] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.779738] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.779740] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.779742] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.779743] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.779745] FS: 0000000000000000(0000) GS:ffff8888dab82000(0000) knlGS:0000000000000000 <4> [232.779748] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.779749] CR2: 00007dc968a6d000 CR3: 0000000108194004 CR4: 0000000000f72ef0 <4> [232.779752] PKRU: 55555554 <4> [232.779753] Call Trace: <4> [232.779755] <TASK> <4> [232.779761] ? __pfx_lock_acquire+0x10/0x10 <4> [232.779769] ? lock_release+0xd0/0x2b0 <4> [232.779778] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.779794] process_one_work+0x239/0x740 <4> [232.779805] worker_thread+0x200/0x3f0 <4> [232.779809] ? __pfx_worker_thread+0x10/0x10 <4> [232.779813] kthread+0x10d/0x150 <4> [232.779816] ? __pfx_kthread+0x10/0x10 <4> [232.779821] ret_from_fork+0x3bd/0x470 <4> [232.779824] ? __pfx_kthread+0x10/0x10 <4> [232.779829] ret_from_fork_asm+0x1a/0x30 <4> [232.779842] </TASK> <4> [232.779844] irq event stamp: 499977 <4> [232.779846] hardirqs last enabled at (499983): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.779850] hardirqs last disabled at (499988): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.779853] softirqs last enabled at (499918): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <7> [232.779773] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [232.779857] softirqs last disabled at (499911): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.779861] ---[ end trace 0000000000000000 ]--- <6> [232.779872] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.779963] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.779971] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.780165] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.780380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.780478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.780578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.780674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.780769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.780877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.780967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.781059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.781147] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.781248] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.781343] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.782440] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.792793] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.793059] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.794078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.794197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.794282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.794366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.794451] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.794534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.794616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.794696] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.794777] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.794876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.794958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.795038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.795118] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.795197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.795277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.795358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.795436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.795514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.795593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.795681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.795770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [232.795869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.795951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.796034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [232.796117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.796197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.796279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.796362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.796445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.796528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.796612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.796694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.796775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.796877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.796970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.797060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.797147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.797232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [232.797317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.797399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.797480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [232.797560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.797639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.797721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [232.797811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.797893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.797975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [232.798056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.798135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.798220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [232.798308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.798390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.798474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [232.798555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.798639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.798721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [232.798811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.798892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.798971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.799054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.799136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.799220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [232.799303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.799385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.799468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [232.799551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.799632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.799712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.799800] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.799920] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.799924] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47196, lrc_seqno=47196, guc_id=0, flags=0x73 in no process [-1] <7> [232.799927] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.799996] ------------[ cut here ]------------ <4> [232.799997] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.799998] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:8/994 <4> [232.800078] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.800144] CPU: 3 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.800147] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.800148] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.800149] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.800155] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.800230] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.800232] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [232.800234] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.800235] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.800236] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.800238] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.800239] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.800240] FS: 0000000000000000(0000) GS:ffff8888dac02000(0000) knlGS:0000000000000000 <4> [232.800242] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.800243] CR2: 000059a1b383f208 CR3: 000000012991f001 CR4: 0000000000f72ef0 <4> [232.800245] PKRU: 55555554 <4> [232.800246] Call Trace: <4> [232.800247] <TASK> <4> [232.800251] ? __pfx_lock_acquire+0x10/0x10 <4> [232.800256] ? lock_release+0xd0/0x2b0 <4> [232.800261] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.800267] process_one_work+0x239/0x740 <4> [232.800274] worker_thread+0x200/0x3f0 <4> [232.800277] ? __pfx_worker_thread+0x10/0x10 <4> [232.800279] kthread+0x10d/0x150 <4> [232.800281] ? __pfx_kthread+0x10/0x10 <4> [232.800284] ret_from_fork+0x3bd/0x470 <4> [232.800287] ? __pfx_kthread+0x10/0x10 <4> [232.800289] ret_from_fork_asm+0x1a/0x30 <4> [232.800296] </TASK> <4> [232.800298] irq event stamp: 766069 <4> [232.800299] hardirqs last enabled at (766075): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.800301] hardirqs last disabled at (766080): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.800303] softirqs last enabled at (764808): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.800306] softirqs last disabled at (764799): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.800308] ---[ end trace 0000000000000000 ]--- <6> [232.800310] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.800387] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.800392] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.801626] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [232.801738] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [232.801864] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.802077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.802175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.802274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.802365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.802454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.802542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.802630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.802721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.802827] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.802934] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.803032] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.804226] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.815099] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.815429] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.816876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.817009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.817137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.817267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.817395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.817524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.817652] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.817786] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.817914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.818041] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.818169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.818296] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.818424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.818551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.818679] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.818810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.818938] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.819065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.819193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.819327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.819461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [232.819594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.819725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.819862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [232.819996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.820127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.820258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.820389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.820519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.820653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.820800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.820902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.820995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.821084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.821178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.821269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.821362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.821450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [232.821537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.821619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.821702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [232.821799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.821881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.821966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [232.822053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.822137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.822221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [232.822303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.822384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.822466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [232.822551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.822663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.822767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [232.822872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.822954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.823038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [232.823125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.823208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.823290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.823375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.823455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.823537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [232.823619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.823698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.823784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [232.823865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.823944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.824023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.824105] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.824232] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.824237] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47196, lrc_seqno=47196, guc_id=0, flags=0x73 in no process [-1] <7> [232.824239] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.824308] ------------[ cut here ]------------ <4> [232.824309] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.824310] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:38/3092 <4> [232.824389] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.824456] CPU: 2 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.824459] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.824460] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.824462] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.824468] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.824547] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.824549] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [232.824551] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.824552] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.824554] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.824555] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.824556] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.824557] FS: 0000000000000000(0000) GS:ffff8888dab82000(0000) knlGS:0000000000000000 <4> [232.824559] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.824561] CR2: 00007dc968a6d000 CR3: 0000000108194004 CR4: 0000000000f72ef0 <4> [232.824562] PKRU: 55555554 <4> [232.824563] Call Trace: <4> [232.824564] <TASK> <4> [232.824568] ? __pfx_lock_acquire+0x10/0x10 <4> [232.824574] ? lock_release+0xd0/0x2b0 <4> [232.824578] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.824584] process_one_work+0x239/0x740 <4> [232.824591] worker_thread+0x200/0x3f0 <4> [232.824594] ? __pfx_worker_thread+0x10/0x10 <4> [232.824597] kthread+0x10d/0x150 <4> [232.824599] ? __pfx_kthread+0x10/0x10 <4> [232.824602] ret_from_fork+0x3bd/0x470 <4> [232.824604] ? __pfx_kthread+0x10/0x10 <4> [232.824607] ret_from_fork_asm+0x1a/0x30 <4> [232.824614] </TASK> <4> [232.824615] irq event stamp: 504241 <4> [232.824616] hardirqs last enabled at (504247): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.824619] hardirqs last disabled at (504252): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.824620] softirqs last enabled at (503308): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.824623] softirqs last disabled at (503301): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.824626] ---[ end trace 0000000000000000 ]--- <5> [232.825142] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47251, lrc_seqno=47251, guc_id=0, flags=0x73 in no process [-1] <7> [232.825147] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.825474] ------------[ cut here ]------------ <4> [232.825476] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.825478] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:37/3091 <4> [232.825568] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.825647] CPU: 11 UID: 0 PID: 3091 Comm: kworker/u64:37 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.825651] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.825652] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.825655] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.825662] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.825761] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.825763] RSP: 0018:ffffc90007bb3ca0 EFLAGS: 00010246 <4> [232.825766] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.825767] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.825769] RBP: ffffc90007bb3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.825770] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.825771] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.825773] FS: 0000000000000000(0000) GS:ffff8888db002000(0000) knlGS:0000000000000000 <4> [232.825781] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.825784] CR2: 00005ae5e903142c CR3: 000000000364a001 CR4: 0000000000f72ef0 <4> [232.825785] PKRU: 55555554 <4> [232.825787] Call Trace: <4> [232.825790] <TASK> <4> [232.825794] ? __pfx_lock_acquire+0x10/0x10 <4> [232.825800] ? lock_release+0xd0/0x2b0 <4> [232.825806] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.825812] process_one_work+0x239/0x740 <4> [232.825820] worker_thread+0x200/0x3f0 <4> [232.825823] ? __pfx_worker_thread+0x10/0x10 <4> [232.825826] kthread+0x10d/0x150 <4> [232.825828] ? __pfx_kthread+0x10/0x10 <4> [232.825831] ret_from_fork+0x3bd/0x470 <4> [232.825834] ? __pfx_kthread+0x10/0x10 <4> [232.825838] ret_from_fork_asm+0x1a/0x30 <4> [232.825845] </TASK> <4> [232.825846] irq event stamp: 1819085 <4> [232.825847] hardirqs last enabled at (1819091): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.825851] hardirqs last disabled at (1819096): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.825852] softirqs last enabled at (1818980): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.825855] softirqs last disabled at (1818973): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.825858] ---[ end trace 0000000000000000 ]--- <6> [232.825861] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.825964] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.825981] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.826271] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [232.826386] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [232.826501] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.826719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.826829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.826930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.827026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.827117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.827211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.827305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.827398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.827484] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.827586] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.827681] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.828716] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.838782] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.839039] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.840180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.840265] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.840347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.840432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.840512] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.840593] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.840671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.840749] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.840837] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.840918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.840997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.841077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.841155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.841233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.841312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.841395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.841474] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.841554] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.841633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.841720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.841814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [232.841900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.841985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.842070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [232.842158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.842243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.842326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.842408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.842489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.842573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.842658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.842743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.842838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.842925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.843014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.843103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.843190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.843278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [232.843365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.843447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.843532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [232.843618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.843701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.843787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [232.843871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.843952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.844034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [232.844115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.844195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.844277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [232.844360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.844440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.844521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [232.844601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.844682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.844763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [232.844855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.844934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.845012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.845100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.845183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.845265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [232.845347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.845427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.845510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [232.845592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.845672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.845755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.845850] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.845973] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.845977] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47251, lrc_seqno=47251, guc_id=0, flags=0x73 in no process [-1] <7> [232.845980] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.846049] ------------[ cut here ]------------ <4> [232.846051] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.846052] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:8/994 <4> [232.846129] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.846196] CPU: 3 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.846199] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.846200] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.846202] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.846207] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.846287] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.846289] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [232.846291] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.846292] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.846294] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.846295] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.846296] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.846297] FS: 0000000000000000(0000) GS:ffff8888dac02000(0000) knlGS:0000000000000000 <4> [232.846299] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.846300] CR2: 000059a1b383f208 CR3: 000000012991f001 CR4: 0000000000f72ef0 <4> [232.846302] PKRU: 55555554 <4> [232.846303] Call Trace: <4> [232.846304] <TASK> <4> [232.846308] ? __pfx_lock_acquire+0x10/0x10 <4> [232.846313] ? lock_release+0xd0/0x2b0 <4> [232.846317] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.846323] process_one_work+0x239/0x740 <4> [232.846333] worker_thread+0x200/0x3f0 <4> [232.846338] ? __pfx_worker_thread+0x10/0x10 <4> [232.846343] kthread+0x10d/0x150 <4> [232.846347] ? __pfx_kthread+0x10/0x10 <4> [232.846353] ret_from_fork+0x3bd/0x470 <4> [232.846358] ? __pfx_kthread+0x10/0x10 <4> [232.846363] ret_from_fork_asm+0x1a/0x30 <4> [232.846379] </TASK> <4> [232.846381] irq event stamp: 769687 <4> [232.846383] hardirqs last enabled at (769693): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.846387] hardirqs last disabled at (769698): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.846390] softirqs last enabled at (768772): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.846393] softirqs last disabled at (768765): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.846396] ---[ end trace 0000000000000000 ]--- <6> [232.846399] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.846491] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.846500] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.847756] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [232.847890] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [232.848002] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.848224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.848324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.848422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.848517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.848608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.848696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.848806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.848898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.848986] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.849090] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.849185] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.850217] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.860776] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.861033] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.862055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.862140] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.862221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.862306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.862387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.862469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.862550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.862632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.862711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.862801] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.862881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.862960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.863040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.863123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.863202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.863282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.863360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.863438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.863515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.863602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.863688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [232.863778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.863867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.863954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [232.864037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.864118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.864198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.864279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.864363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.864447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.864531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.864614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.864697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.864785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.864873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.864964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.865054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.865139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [232.865223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.865304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.865386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [232.865466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.865551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.865636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [232.865720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.865813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.865899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [232.865982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.866062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.866145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [232.866228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.866313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.866398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [232.866481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.866562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.866643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [232.866723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.866812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.866897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.866985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.867068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.867151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [232.867233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.867316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.867399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [232.867484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.867569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.867650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.867734] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.867865] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.867870] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47251, lrc_seqno=47251, guc_id=0, flags=0x73 in no process [-1] <7> [232.867872] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.867940] ------------[ cut here ]------------ <4> [232.867941] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.867942] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:38/3092 <4> [232.868021] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.868088] CPU: 8 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.868091] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.868092] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.868094] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.868100] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.868175] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.868177] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [232.868179] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.868180] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.868182] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.868183] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.868184] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.868185] FS: 0000000000000000(0000) GS:ffff8888dae82000(0000) knlGS:0000000000000000 <4> [232.868187] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.868188] CR2: 00007dc968a6f000 CR3: 0000000108194004 CR4: 0000000000f72ef0 <4> [232.868190] PKRU: 55555554 <4> [232.868191] Call Trace: <4> [232.868192] <TASK> <4> [232.868196] ? __pfx_lock_acquire+0x10/0x10 <4> [232.868201] ? lock_release+0xd0/0x2b0 <4> [232.868206] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.868212] process_one_work+0x239/0x740 <4> [232.868218] worker_thread+0x200/0x3f0 <4> [232.868221] ? __pfx_worker_thread+0x10/0x10 <4> [232.868224] kthread+0x10d/0x150 <4> [232.868226] ? __pfx_kthread+0x10/0x10 <4> [232.868229] ret_from_fork+0x3bd/0x470 <4> [232.868231] ? __pfx_kthread+0x10/0x10 <4> [232.868234] ret_from_fork_asm+0x1a/0x30 <4> [232.868241] </TASK> <4> [232.868242] irq event stamp: 508739 <4> [232.868244] hardirqs last enabled at (508745): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.868246] hardirqs last disabled at (508750): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.868248] softirqs last enabled at (507750): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.868250] softirqs last disabled at (507743): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.868253] ---[ end trace 0000000000000000 ]--- <5> [232.869831] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47306, lrc_seqno=47306, guc_id=0, flags=0x73 in no process [-1] <7> [232.869837] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [232.869826] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [232.869957] ------------[ cut here ]------------ <4> [232.869958] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.869960] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:38/3092 <7> [232.869992] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [232.870086] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.870180] CPU: 9 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.870183] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.870184] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.870185] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.870191] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.870269] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.870271] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [232.870273] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.870274] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.870275] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.870277] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.870278] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.870279] FS: 0000000000000000(0000) GS:ffff8888daf02000(0000) knlGS:0000000000000000 <4> [232.870281] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.870282] CR2: 00007ad37e5c2160 CR3: 000000000364a002 CR4: 0000000000f72ef0 <4> [232.870283] PKRU: 55555554 <4> [232.870285] Call Trace: <4> [232.870286] <TASK> <4> [232.870290] ? __pfx_lock_acquire+0x10/0x10 <4> [232.870295] ? lock_release+0xd0/0x2b0 <4> [232.870300] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.870306] process_one_work+0x239/0x740 <4> [232.870312] worker_thread+0x200/0x3f0 <4> [232.870315] ? __pfx_worker_thread+0x10/0x10 <4> [232.870318] kthread+0x10d/0x150 <4> [232.870320] ? __pfx_kthread+0x10/0x10 <4> [232.870323] ret_from_fork+0x3bd/0x470 <4> [232.870325] ? __pfx_kthread+0x10/0x10 <4> [232.870328] ret_from_fork_asm+0x1a/0x30 <4> [232.870335] </TASK> <4> [232.870336] irq event stamp: 510649 <4> [232.870338] hardirqs last enabled at (510655): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.870340] hardirqs last disabled at (510660): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.870342] softirqs last enabled at (507750): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.870345] softirqs last disabled at (507743): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.870347] ---[ end trace 0000000000000000 ]--- <6> [232.870349] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.870426] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.870434] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.870695] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.870925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.871022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.871121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.871216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.871308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.871397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.871487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.871575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.871661] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.871761] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.871878] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.872915] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.883644] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.883903] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.884912] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.884997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.885080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.885164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.885246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.885331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.885414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.885494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.885575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.885655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.885734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.885825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.885904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.885981] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.886061] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.886139] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.886218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.886295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.886373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.886460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.886546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [232.886634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.886718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.886814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [232.886897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.886978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.887057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.887138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.887221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.887307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.887394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.887476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.887559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.887643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.887733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.887832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.887922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.888007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [232.888091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.888173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.888256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [232.888336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.888418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.888500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [232.888584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.888666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.888757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [232.888853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.888934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.889019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [232.889103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.889185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.889266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [232.889346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.889428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.889509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [232.889590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.889671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.889754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.889852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.889934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.890017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [232.890098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.890180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.890263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [232.890345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.890427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.890507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.890589] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.890710] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.890714] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47306, lrc_seqno=47306, guc_id=0, flags=0x73 in no process [-1] <7> [232.890717] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.890805] ------------[ cut here ]------------ <4> [232.890809] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.890813] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:38/3092 <4> [232.891266] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.891403] CPU: 8 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.891411] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.891414] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.891419] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.891439] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.891673] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.891675] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [232.891677] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.891679] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.891680] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.891681] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.891682] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.891684] FS: 0000000000000000(0000) GS:ffff8888dae82000(0000) knlGS:0000000000000000 <4> [232.891685] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.891687] CR2: 00007dc968a6f000 CR3: 000000000364a006 CR4: 0000000000f72ef0 <4> [232.891688] PKRU: 55555554 <4> [232.891689] Call Trace: <4> [232.891690] <TASK> <4> [232.891694] ? __pfx_lock_acquire+0x10/0x10 <4> [232.891700] ? lock_release+0xd0/0x2b0 <4> [232.891705] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.891711] process_one_work+0x239/0x740 <4> [232.891717] worker_thread+0x200/0x3f0 <4> [232.891722] ? __pfx_worker_thread+0x10/0x10 <4> [232.891727] kthread+0x10d/0x150 <4> [232.891730] ? __pfx_kthread+0x10/0x10 <4> [232.891736] ret_from_fork+0x3bd/0x470 <4> [232.891739] ? __pfx_kthread+0x10/0x10 <4> [232.891744] ret_from_fork_asm+0x1a/0x30 <4> [232.891757] </TASK> <4> [232.891759] irq event stamp: 513805 <4> [232.891760] hardirqs last enabled at (513811): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.891771] hardirqs last disabled at (513828): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.891774] softirqs last enabled at (513824): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.891778] softirqs last disabled at (513815): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.891781] ---[ end trace 0000000000000000 ]--- <7> [232.891740] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [232.891801] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.891887] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.891895] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.891885] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [232.892079] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.892299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.892399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.892503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.892603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.892694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.892792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.892882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.892973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.893059] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.893160] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.893259] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.894298] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.904769] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.905028] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.906009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.906097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.906180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.906263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.906343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.906423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.906503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.906583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.906661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.906741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.906835] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.906913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.906991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.907071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.907149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.907226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.907309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.907391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.907472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.907560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.907644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [232.907727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.907823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.907907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [232.907991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.908073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.908155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.908235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.908316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.908400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.908486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.908571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.908657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.908811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.908908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.909001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.909092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.909178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [232.909265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.909347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.909430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [232.909509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.909591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.909674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [232.909762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.909846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.909931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [232.910013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.910095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.910179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [232.910265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.910348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.910431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [232.910512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.910592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.910674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [232.910755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.910858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.910939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.911023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.911103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.911185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [232.911268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.911349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.911430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [232.911512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.911594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.911672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.911762] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.911886] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.911891] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47306, lrc_seqno=47306, guc_id=0, flags=0x73 in no process [-1] <7> [232.911893] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.911961] ------------[ cut here ]------------ <4> [232.911962] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.911964] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:8/994 <4> [232.912043] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.912110] CPU: 3 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.912113] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.912114] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.912115] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.912121] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.912199] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.912201] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [232.912203] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.912204] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.912206] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.912207] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.912208] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.912209] FS: 0000000000000000(0000) GS:ffff8888dac02000(0000) knlGS:0000000000000000 <4> [232.912211] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.912212] CR2: 000059a1b383f208 CR3: 000000012991f001 CR4: 0000000000f72ef0 <4> [232.912214] PKRU: 55555554 <4> [232.912215] Call Trace: <4> [232.912216] <TASK> <4> [232.912220] ? __pfx_lock_acquire+0x10/0x10 <4> [232.912225] ? lock_release+0xd0/0x2b0 <4> [232.912230] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.912236] process_one_work+0x239/0x740 <4> [232.912242] worker_thread+0x200/0x3f0 <4> [232.912245] ? __pfx_worker_thread+0x10/0x10 <4> [232.912248] kthread+0x10d/0x150 <4> [232.912250] ? __pfx_kthread+0x10/0x10 <4> [232.912253] ret_from_fork+0x3bd/0x470 <4> [232.912255] ? __pfx_kthread+0x10/0x10 <4> [232.912258] ret_from_fork_asm+0x1a/0x30 <4> [232.912265] </TASK> <4> [232.912266] irq event stamp: 773171 <4> [232.912268] hardirqs last enabled at (773177): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.912270] hardirqs last disabled at (773182): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.912272] softirqs last enabled at (772340): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.912274] softirqs last disabled at (772333): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.912277] ---[ end trace 0000000000000000 ]--- <5> [232.913535] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47361, lrc_seqno=47361, guc_id=0, flags=0x73 in no process [-1] <7> [232.913538] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.913608] ------------[ cut here ]------------ <4> [232.913609] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.913611] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:8/994 <4> [232.913686] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.913752] CPU: 3 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.913754] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.913755] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.913762] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.913767] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.913844] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.913846] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [232.913848] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.913849] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.913851] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.913852] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.913853] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.913854] FS: 0000000000000000(0000) GS:ffff8888dac02000(0000) knlGS:0000000000000000 <4> [232.913856] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.913857] CR2: 000059a1b383f208 CR3: 000000012991f001 CR4: 0000000000f72ef0 <4> [232.913858] PKRU: 55555554 <4> [232.913859] Call Trace: <4> [232.913860] <TASK> <4> [232.913864] ? __pfx_lock_acquire+0x10/0x10 <4> [232.913868] ? lock_release+0xd0/0x2b0 <4> [232.913873] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.913879] process_one_work+0x239/0x740 <4> [232.913885] worker_thread+0x200/0x3f0 <4> [232.913888] ? __pfx_worker_thread+0x10/0x10 <4> [232.913890] kthread+0x10d/0x150 <4> [232.913892] ? __pfx_kthread+0x10/0x10 <4> [232.913895] ret_from_fork+0x3bd/0x470 <4> [232.913898] ? __pfx_kthread+0x10/0x10 <4> [232.913900] ret_from_fork_asm+0x1a/0x30 <4> [232.913907] </TASK> <4> [232.913909] irq event stamp: 775037 <4> [232.913910] hardirqs last enabled at (775043): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.913912] hardirqs last disabled at (775048): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.913913] softirqs last enabled at (772340): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.913916] softirqs last disabled at (772333): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.913919] ---[ end trace 0000000000000000 ]--- <6> [232.913921] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.913998] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.914004] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.914161] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [232.914273] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [232.914386] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.914609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.914707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.914817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.914910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.915002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.915093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.915185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.915277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.915363] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.915463] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.915559] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.916595] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.926776] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.927045] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.928014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.928101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.928184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.928268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.928353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.928438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.928518] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.928599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.928678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.928762] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.928842] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.928920] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.928998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.929075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.929154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.929235] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.929318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.929397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.929478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.929565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.929652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [232.929737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.929834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.929921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [232.930008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.930091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.930172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.930253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.930333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.930416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.930500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.930583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.930667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.930749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.930861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.930950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.931039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.931126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [232.931214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.931296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.931379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [232.931460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.931541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.931627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [232.931713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.931811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.931922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [232.932077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.932204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.932331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [232.932464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.932598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.932730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [232.932880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.932996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.933084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [232.933171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.933253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.933335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.933419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.933499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.933582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [232.933664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.933749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.933851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [232.933934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.934015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.934096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.934179] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.934301] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.934306] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47361, lrc_seqno=47361, guc_id=0, flags=0x73 in no process [-1] <7> [232.934309] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.934377] ------------[ cut here ]------------ <4> [232.934379] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.934380] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:37/3091 <4> [232.934459] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.934526] CPU: 11 UID: 0 PID: 3091 Comm: kworker/u64:37 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.934529] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.934530] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.934531] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.934537] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.934616] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.934618] RSP: 0018:ffffc90007bb3ca0 EFLAGS: 00010246 <4> [232.934620] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.934622] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.934623] RBP: ffffc90007bb3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.934624] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.934625] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.934627] FS: 0000000000000000(0000) GS:ffff8888db002000(0000) knlGS:0000000000000000 <4> [232.934628] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.934630] CR2: 00005ae5e903142c CR3: 000000000364a001 CR4: 0000000000f72ef0 <4> [232.934631] PKRU: 55555554 <4> [232.934632] Call Trace: <4> [232.934633] <TASK> <4> [232.934637] ? __pfx_lock_acquire+0x10/0x10 <4> [232.934643] ? lock_release+0xd0/0x2b0 <4> [232.934648] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.934654] process_one_work+0x239/0x740 <4> [232.934660] worker_thread+0x200/0x3f0 <4> [232.934663] ? __pfx_worker_thread+0x10/0x10 <4> [232.934666] kthread+0x10d/0x150 <4> [232.934668] ? __pfx_kthread+0x10/0x10 <4> [232.934671] ret_from_fork+0x3bd/0x470 <4> [232.934673] ? __pfx_kthread+0x10/0x10 <4> [232.934676] ret_from_fork_asm+0x1a/0x30 <4> [232.934683] </TASK> <4> [232.934684] irq event stamp: 1826075 <4> [232.934686] hardirqs last enabled at (1826081): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.934688] hardirqs last disabled at (1826086): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.934690] softirqs last enabled at (1825086): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.934692] softirqs last disabled at (1825079): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.934695] ---[ end trace 0000000000000000 ]--- <6> [232.934697] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.934791] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.934799] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.935205] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.935416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.935513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.935610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.935705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.935808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.935897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.935985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.936079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.936168] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.936268] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.936366] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.937398] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.948110] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.948370] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.949358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.949446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.949529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.949615] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.949697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.949788] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.949867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.949946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.950025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.950104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.950182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.950261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.950342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.950423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.950503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.950582] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.950661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.950741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.950837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.950923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.951010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [232.951097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.951181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.951268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [232.951354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.951438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.951520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.951602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.951681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.951768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.951852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.951934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.952017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.952103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.952192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.952282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.952368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.952457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [232.952545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.952627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.952708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [232.952801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.952883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.952964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [232.953047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.953132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.953215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [232.953296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.953375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.953463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [232.953548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.953629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.953718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [232.953810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.953892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.953976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [232.954058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.954139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.954221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.954308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.954392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.954474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [232.954555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.954638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.954724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [232.954823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.954908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.954993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.955085] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.955276] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.955284] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47361, lrc_seqno=47361, guc_id=0, flags=0x73 in no process [-1] <7> [232.955289] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.955402] ------------[ cut here ]------------ <4> [232.955404] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.955407] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:37/3091 <4> [232.955523] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.955905] CPU: 11 UID: 0 PID: 3091 Comm: kworker/u64:37 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.955909] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.955911] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.955913] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.955923] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.956042] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.956045] RSP: 0018:ffffc90007bb3ca0 EFLAGS: 00010246 <4> [232.956049] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.956052] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.956055] RBP: ffffc90007bb3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.956057] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.956059] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.956062] FS: 0000000000000000(0000) GS:ffff8888db002000(0000) knlGS:0000000000000000 <4> [232.956065] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.956067] CR2: 00005ae5e903142c CR3: 000000000364a001 CR4: 0000000000f72ef0 <4> [232.956070] PKRU: 55555554 <4> [232.956072] Call Trace: <4> [232.956074] <TASK> <4> [232.956081] ? __pfx_lock_acquire+0x10/0x10 <4> [232.956090] ? lock_release+0xd0/0x2b0 <4> [232.956098] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.956109] process_one_work+0x239/0x740 <4> [232.956121] worker_thread+0x200/0x3f0 <4> [232.956126] ? __pfx_worker_thread+0x10/0x10 <4> [232.956130] kthread+0x10d/0x150 <4> [232.956134] ? __pfx_kthread+0x10/0x10 <4> [232.956139] ret_from_fork+0x3bd/0x470 <4> [232.956143] ? __pfx_kthread+0x10/0x10 <4> [232.956147] ret_from_fork_asm+0x1a/0x30 <4> [232.956160] </TASK> <4> [232.956163] irq event stamp: 1829253 <4> [232.956165] hardirqs last enabled at (1829259): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.956168] hardirqs last disabled at (1829264): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.956172] softirqs last enabled at (1828394): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.956176] softirqs last disabled at (1828389): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.956180] ---[ end trace 0000000000000000 ]--- <5> [232.957053] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47416, lrc_seqno=47416, guc_id=0, flags=0x73 in no process [-1] <7> [232.957060] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.957178] ------------[ cut here ]------------ <4> [232.957181] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.957183] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:37/3091 <4> [232.957268] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.957343] CPU: 7 UID: 0 PID: 3091 Comm: kworker/u64:37 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.957347] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.957349] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.957351] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.957359] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.957437] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.957439] RSP: 0018:ffffc90007bb3ca0 EFLAGS: 00010246 <4> [232.957442] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.957443] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.957444] RBP: ffffc90007bb3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.957446] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.957447] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.957448] FS: 0000000000000000(0000) GS:ffff8888dae02000(0000) knlGS:0000000000000000 <4> [232.957450] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.957451] CR2: 00007dc968a72000 CR3: 000000012991f002 CR4: 0000000000f72ef0 <4> [232.957453] PKRU: 55555554 <4> [232.957454] Call Trace: <4> [232.957455] <TASK> <4> [232.957459] ? __pfx_lock_acquire+0x10/0x10 <4> [232.957464] ? lock_release+0xd0/0x2b0 <4> [232.957469] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.957475] process_one_work+0x239/0x740 <4> [232.957481] worker_thread+0x200/0x3f0 <4> [232.957484] ? __pfx_worker_thread+0x10/0x10 <4> [232.957487] kthread+0x10d/0x150 <4> [232.957489] ? __pfx_kthread+0x10/0x10 <4> [232.957492] ret_from_fork+0x3bd/0x470 <4> [232.957494] ? __pfx_kthread+0x10/0x10 <4> [232.957497] ret_from_fork_asm+0x1a/0x30 <4> [232.957504] </TASK> <4> [232.957505] irq event stamp: 1831355 <4> [232.957506] hardirqs last enabled at (1831361): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.957509] hardirqs last disabled at (1831366): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.957511] softirqs last enabled at (1829752): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.957513] softirqs last disabled at (1829747): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.957516] ---[ end trace 0000000000000000 ]--- <7> [232.957480] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [232.957518] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.957595] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.957601] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.957596] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [232.957769] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.958163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.958266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.958368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.958463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.958555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.958645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.958737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.958864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.958954] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.959056] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.959152] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.960197] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.970755] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.971032] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.972055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.972141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.972222] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.972306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.972388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.972467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.972545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.972624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.972702] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.972805] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.972883] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.972961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.973038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.973119] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.973197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.973275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.973352] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.973430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.973507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.973594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.973679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [232.973775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.973868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.973953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [232.974037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.974119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.974199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.974280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.974361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.974444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.974529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.974612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.974694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.974798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.974891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.974982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.975072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.975157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [232.975241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.975322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.975406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [232.975489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.975568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.975650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [232.975736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.975868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.975951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [232.976033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.976117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.976203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [232.976289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.976370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.976452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [232.976533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.976613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.976695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [232.976785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.976865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.976944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.977027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.977110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.977195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [232.977278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.977360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.977443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [232.977523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.977604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.977683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.977771] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.977894] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.977898] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47416, lrc_seqno=47416, guc_id=0, flags=0x73 in no process [-1] <7> [232.977901] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.977968] ------------[ cut here ]------------ <4> [232.977969] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.977971] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:37/3091 <4> [232.978049] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [232.978114] CPU: 7 UID: 0 PID: 3091 Comm: kworker/u64:37 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [232.978116] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [232.978118] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.978119] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.978124] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [232.978201] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [232.978202] RSP: 0018:ffffc90007bb3ca0 EFLAGS: 00010246 <4> [232.978205] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.978206] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [232.978207] RBP: ffffc90007bb3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.978208] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.978210] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [232.978211] FS: 0000000000000000(0000) GS:ffff8888dae02000(0000) knlGS:0000000000000000 <4> [232.978213] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.978214] CR2: 00007dc968a72000 CR3: 000000012991f002 CR4: 0000000000f72ef0 <4> [232.978215] PKRU: 55555554 <4> [232.978217] Call Trace: <4> [232.978218] <TASK> <4> [232.978222] ? __pfx_lock_acquire+0x10/0x10 <4> [232.978227] ? lock_release+0xd0/0x2b0 <4> [232.978231] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.978237] process_one_work+0x239/0x740 <4> [232.978244] worker_thread+0x200/0x3f0 <4> [232.978247] ? __pfx_worker_thread+0x10/0x10 <4> [232.978249] kthread+0x10d/0x150 <4> [232.978251] ? __pfx_kthread+0x10/0x10 <4> [232.978254] ret_from_fork+0x3bd/0x470 <4> [232.978257] ? __pfx_kthread+0x10/0x10 <4> [232.978259] ret_from_fork_asm+0x1a/0x30 <4> [232.978267] </TASK> <4> [232.978268] irq event stamp: 1834515 <4> [232.978269] hardirqs last enabled at (1834521): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [232.978271] hardirqs last disabled at (1834526): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [232.978273] softirqs last enabled at (1833350): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.978276] softirqs last disabled at (1833341): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [232.978278] ---[ end trace 0000000000000000 ]--- <6> [232.978280] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.978355] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.978362] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.979621] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [232.979741] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [232.979873] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.980087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.980185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.980282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.980373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.980463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.980551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.980641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.980734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.980842] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.980944] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.981040] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.982077] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.992752] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.993014] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.994026] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.994112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.994195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.994276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.994358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.994437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.994518] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.994600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.994681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.994766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.994845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.994924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.995003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.995082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.995160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.995238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.995319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.995398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.995477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.995563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.995648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [232.995733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.995831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.995914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [232.995997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.996079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.996159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.996240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.996321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.996407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.996498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.996583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.996670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.996758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.996846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.996934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.997022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.997107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [232.997197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.997282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.997366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [232.997448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.997530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.997612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [232.997697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.997789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.997875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [232.997957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.998040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.998122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [232.998205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.998287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.998367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [232.998448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.998529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.998610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [232.998693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.998784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.998867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.998952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.999034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.999115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [232.999196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.999277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.999357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [232.999437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.999517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.999595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.999677] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.999809] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.999813] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47416, lrc_seqno=47416, guc_id=0, flags=0x73 in no process [-1] <7> [232.999816] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.999885] ------------[ cut here ]------------ <4> [232.999886] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.999887] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:38/3092 <4> [232.999965] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.000032] CPU: 6 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.000035] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.000036] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.000038] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.000043] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.000123] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.000125] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [233.000127] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.000128] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.000130] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.000131] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.000132] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.000134] FS: 0000000000000000(0000) GS:ffff8888dad82000(0000) knlGS:0000000000000000 <4> [233.000135] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.000137] CR2: 00007fff30088fe0 CR3: 000000000364a005 CR4: 0000000000f72ef0 <4> [233.000138] PKRU: 55555554 <4> [233.000139] Call Trace: <4> [233.000140] <TASK> <4> [233.000144] ? __pfx_lock_acquire+0x10/0x10 <4> [233.000149] ? lock_release+0xd0/0x2b0 <4> [233.000154] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.000160] process_one_work+0x239/0x740 <4> [233.000166] worker_thread+0x200/0x3f0 <4> [233.000169] ? __pfx_worker_thread+0x10/0x10 <4> [233.000172] kthread+0x10d/0x150 <4> [233.000174] ? __pfx_kthread+0x10/0x10 <4> [233.000177] ret_from_fork+0x3bd/0x470 <4> [233.000179] ? __pfx_kthread+0x10/0x10 <4> [233.000182] ret_from_fork_asm+0x1a/0x30 <4> [233.000189] </TASK> <4> [233.000190] irq event stamp: 518581 <4> [233.000192] hardirqs last enabled at (518587): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.000194] hardirqs last disabled at (518592): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.000196] softirqs last enabled at (517752): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.000198] softirqs last disabled at (517747): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.000201] ---[ end trace 0000000000000000 ]--- <5> [233.000558] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47471, lrc_seqno=47471, guc_id=0, flags=0x73 in no process [-1] <7> [233.000639] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.001047] ------------[ cut here ]------------ <4> [233.001050] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.001053] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:38/3092 <4> [233.001423] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.001499] CPU: 7 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.001502] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.001503] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.001504] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.001510] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <7> [233.001541] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [233.001628] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.001631] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [233.001634] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.001636] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.001638] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.001640] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.001642] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.001644] FS: 0000000000000000(0000) GS:ffff8888dae02000(0000) knlGS:0000000000000000 <4> [233.001646] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.001648] CR2: 00007dc968a72000 CR3: 000000012991f002 CR4: 0000000000f72ef0 <4> [233.001650] PKRU: 55555554 <4> [233.001651] Call Trace: <4> [233.001653] <TASK> <4> [233.001658] ? __pfx_lock_acquire+0x10/0x10 <4> [233.001666] ? lock_release+0xd0/0x2b0 <4> [233.001674] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.001685] process_one_work+0x239/0x740 <4> [233.001696] worker_thread+0x200/0x3f0 <4> [233.001707] ? __pfx_worker_thread+0x10/0x10 <4> [233.001712] kthread+0x10d/0x150 <4> [233.001716] ? __pfx_kthread+0x10/0x10 <4> [233.001721] ret_from_fork+0x3bd/0x470 <4> [233.001724] ? __pfx_kthread+0x10/0x10 <4> [233.001728] ret_from_fork_asm+0x1a/0x30 <4> [233.001746] </TASK> <4> [233.001748] irq event stamp: 520493 <4> [233.001750] hardirqs last enabled at (520499): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.001754] hardirqs last disabled at (520504): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.001757] softirqs last enabled at (519736): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.001761] softirqs last disabled at (519711): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.001765] ---[ end trace 0000000000000000 ]--- <7> [233.001708] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [233.001768] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.001893] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.001899] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.002102] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.002316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.002412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.002508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.002600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.002693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.002795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.002885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.002976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.003062] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.003164] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.003258] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.004294] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.014747] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.015004] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.016112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.016202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.016284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.016365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.016446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.016525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.016607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.016686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.016782] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.016860] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.016939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.017018] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.017100] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.017180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.017259] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.017338] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.017415] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.017493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.017571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.017660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.017756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.017842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.017926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.018009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.018093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.018174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.018258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.018338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.018421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.018504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.018591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.018678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.018771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.018855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.018942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.019030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.019118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.019203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.019286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.019367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.019449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.019528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.019608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.019695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.019788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.019871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.019953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.020034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.020113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.020195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.020281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.020365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.020447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.020529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.020612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.020696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.020787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.020867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.020946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.021028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.021108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.021188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.021268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.021348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.021431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.021515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.021599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.021682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.021775] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.021900] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.021905] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47471, lrc_seqno=47471, guc_id=0, flags=0x73 in no process [-1] <7> [233.021907] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.021976] ------------[ cut here ]------------ <4> [233.021977] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.021978] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:38/3092 <4> [233.022057] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.022122] CPU: 7 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.022124] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.022126] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.022127] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.022132] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.022210] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.022212] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [233.022214] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.022215] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.022217] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.022218] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.022219] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.022220] FS: 0000000000000000(0000) GS:ffff8888dae02000(0000) knlGS:0000000000000000 <4> [233.022222] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.022223] CR2: 00007dc968a72000 CR3: 000000012991f002 CR4: 0000000000f72ef0 <4> [233.022225] PKRU: 55555554 <4> [233.022226] Call Trace: <4> [233.022227] <TASK> <4> [233.022231] ? __pfx_lock_acquire+0x10/0x10 <4> [233.022236] ? lock_release+0xd0/0x2b0 <4> [233.022241] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.022247] process_one_work+0x239/0x740 <4> [233.022253] worker_thread+0x200/0x3f0 <4> [233.022256] ? __pfx_worker_thread+0x10/0x10 <4> [233.022259] kthread+0x10d/0x150 <4> [233.022261] ? __pfx_kthread+0x10/0x10 <4> [233.022264] ret_from_fork+0x3bd/0x470 <4> [233.022266] ? __pfx_kthread+0x10/0x10 <4> [233.022269] ret_from_fork_asm+0x1a/0x30 <4> [233.022276] </TASK> <4> [233.022277] irq event stamp: 523677 <4> [233.022279] hardirqs last enabled at (523683): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.022281] hardirqs last disabled at (523688): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.022283] softirqs last enabled at (522506): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.022285] softirqs last disabled at (522497): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.022288] ---[ end trace 0000000000000000 ]--- <6> [233.022290] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.022367] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.022374] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.023627] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.023745] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.023857] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.024067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.024162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.024262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.024353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.024443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.024531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.024622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.024716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.024821] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.024921] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.025017] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.026059] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.037077] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.037335] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.038355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.038441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.038523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.038608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.038693] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.038786] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.038865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.038943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.039021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.039099] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.039180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.039261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.039342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.039421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.039499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.039577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.039655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.039739] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.039818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.039908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.039995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.040082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.040165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.040248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.040331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.040412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.040491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.040571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.040653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.040743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.040828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.040909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.040993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.041078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.041170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.041260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.041349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.041434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.041519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.041600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.041682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.041773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.041857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.041944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.042030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.042112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.042195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.042275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.042355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.042436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.042520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.042600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.042683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.042776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.042862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.042948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.043032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.043112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.043194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.043278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.043361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.043449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.043532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.043615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.043700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.043791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.043872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.043952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.044036] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.044162] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.044165] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47471, lrc_seqno=47471, guc_id=0, flags=0x73 in no process [-1] <7> [233.044168] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.044236] ------------[ cut here ]------------ <4> [233.044237] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.044238] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:37/3091 <4> [233.044317] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.044383] CPU: 6 UID: 0 PID: 3091 Comm: kworker/u64:37 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.044386] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.044387] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.044389] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.044394] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.044470] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.044471] RSP: 0018:ffffc90007bb3ca0 EFLAGS: 00010246 <4> [233.044474] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.044475] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.044477] RBP: ffffc90007bb3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.044478] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.044479] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.044480] FS: 0000000000000000(0000) GS:ffff8888dad82000(0000) knlGS:0000000000000000 <4> [233.044482] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.044483] CR2: 00007fff30088fe0 CR3: 000000000364a005 CR4: 0000000000f72ef0 <4> [233.044485] PKRU: 55555554 <4> [233.044486] Call Trace: <4> [233.044487] <TASK> <4> [233.044491] ? __pfx_lock_acquire+0x10/0x10 <4> [233.044496] ? lock_release+0xd0/0x2b0 <4> [233.044501] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.044507] process_one_work+0x239/0x740 <4> [233.044513] worker_thread+0x200/0x3f0 <4> [233.044516] ? __pfx_worker_thread+0x10/0x10 <4> [233.044519] kthread+0x10d/0x150 <4> [233.044521] ? __pfx_kthread+0x10/0x10 <4> [233.044524] ret_from_fork+0x3bd/0x470 <4> [233.044526] ? __pfx_kthread+0x10/0x10 <4> [233.044529] ret_from_fork_asm+0x1a/0x30 <4> [233.044536] </TASK> <4> [233.044537] irq event stamp: 1838095 <4> [233.044539] hardirqs last enabled at (1838101): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.044541] hardirqs last disabled at (1838106): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.044543] softirqs last enabled at (1837080): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.044545] softirqs last disabled at (1837073): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.044548] ---[ end trace 0000000000000000 ]--- <5> [233.045925] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47526, lrc_seqno=47526, guc_id=0, flags=0x73 in no process [-1] <7> [233.045929] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.046007] ------------[ cut here ]------------ <4> [233.046008] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.046009] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:8/994 <4> [233.046090] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi <7> [233.046039] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [233.046094] mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.046157] CPU: 3 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.046160] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.046162] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.046163] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [233.046150] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [233.046169] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.046244] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.046246] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.046248] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.046249] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.046250] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.046253] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.046254] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.046256] FS: 0000000000000000(0000) GS:ffff8888dac02000(0000) knlGS:0000000000000000 <4> [233.046257] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.046258] CR2: 000059a1b383f208 CR3: 000000000364a006 CR4: 0000000000f72ef0 <4> [233.046260] PKRU: 55555554 <4> [233.046261] Call Trace: <4> [233.046262] <TASK> <4> [233.046266] ? __pfx_lock_acquire+0x10/0x10 <4> [233.046271] ? lock_release+0xd0/0x2b0 <4> [233.046276] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.046282] process_one_work+0x239/0x740 <4> [233.046288] worker_thread+0x200/0x3f0 <4> [233.046291] ? __pfx_worker_thread+0x10/0x10 <4> [233.046294] kthread+0x10d/0x150 <4> [233.046296] ? __pfx_kthread+0x10/0x10 <4> [233.046299] ret_from_fork+0x3bd/0x470 <4> [233.046301] ? __pfx_kthread+0x10/0x10 <4> [233.046304] ret_from_fork_asm+0x1a/0x30 <4> [233.046311] </TASK> <4> [233.046312] irq event stamp: 780507 <4> [233.046313] hardirqs last enabled at (780513): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.046316] hardirqs last disabled at (780518): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.046317] softirqs last enabled at (779024): [<ffffffff8133bd03>] kernel_fpu_end+0x53/0x70 <4> [233.046320] softirqs last disabled at (779022): [<ffffffff8133c414>] kernel_fpu_begin_mask+0xc4/0x120 <4> [233.046323] ---[ end trace 0000000000000000 ]--- <6> [233.046324] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.046400] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.046407] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.046454] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.046669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.046775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.046873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.046965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.047054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.047147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.047254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.047346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.047431] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.047531] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.047629] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.048667] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.058738] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.058996] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.060008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.060092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.060172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.060253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.060334] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.060417] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.060498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.060577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.060658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.060757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.060837] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.060917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.060997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.061074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.061152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.061229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.061306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.061388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.061469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.061555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.061642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.061732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.061819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.061905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.061987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.062073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.062153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.062233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.062311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.062395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.062477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.062562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.062646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.062936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.063027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.063115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.063204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.063289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.063380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.063464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.063548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.063631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.063714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.063812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.063896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.063978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.064059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.064139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.064219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.064300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.064383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.064463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.064544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.064625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.064707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.064802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.064884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.064964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.065044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.065130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.065217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.065299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.065383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.065464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.065544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.065626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.065706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.065801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.065888] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.066009] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.066014] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47526, lrc_seqno=47526, guc_id=0, flags=0x73 in no process [-1] <7> [233.066016] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.066085] ------------[ cut here ]------------ <4> [233.066086] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.066087] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:37/3091 <4> [233.066166] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.066232] CPU: 7 UID: 0 PID: 3091 Comm: kworker/u64:37 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.066235] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.066236] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.066237] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.066243] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.066321] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.066323] RSP: 0018:ffffc90007bb3ca0 EFLAGS: 00010246 <4> [233.066325] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.066327] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.066328] RBP: ffffc90007bb3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.066329] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.066330] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.066332] FS: 0000000000000000(0000) GS:ffff8888dae02000(0000) knlGS:0000000000000000 <4> [233.066333] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.066335] CR2: 00007dc968a72000 CR3: 000000012991f002 CR4: 0000000000f72ef0 <4> [233.066336] PKRU: 55555554 <4> [233.066337] Call Trace: <4> [233.066338] <TASK> <4> [233.066342] ? __pfx_lock_acquire+0x10/0x10 <4> [233.066347] ? lock_release+0xd0/0x2b0 <4> [233.066352] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.066358] process_one_work+0x239/0x740 <4> [233.066364] worker_thread+0x200/0x3f0 <4> [233.066367] ? __pfx_worker_thread+0x10/0x10 <4> [233.066370] kthread+0x10d/0x150 <4> [233.066372] ? __pfx_kthread+0x10/0x10 <4> [233.066375] ret_from_fork+0x3bd/0x470 <4> [233.066378] ? __pfx_kthread+0x10/0x10 <4> [233.066380] ret_from_fork_asm+0x1a/0x30 <4> [233.066388] </TASK> <4> [233.066389] irq event stamp: 1842007 <4> [233.066390] hardirqs last enabled at (1842013): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.066392] hardirqs last disabled at (1842018): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.066394] softirqs last enabled at (1841004): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.066397] softirqs last disabled at (1840999): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.066399] ---[ end trace 0000000000000000 ]--- <6> [233.066401] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.066477] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.066483] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.067721] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.067844] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.067955] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.068165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.068260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.068357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.068453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.068546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.068635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.068724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.068833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.068920] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.069021] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.069118] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.070157] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.080732] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.080993] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.082011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.082097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.082179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.082262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.082343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.082421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.082498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.082575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.082654] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.082745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.082830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.082908] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.082989] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.083068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.083146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.083224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.083303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.083380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.083458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.083543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.083629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.083713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.083815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.083900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.083984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.084065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.084147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.084230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.084311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.084393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.084478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.084561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.084643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.084728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.084819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.084910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.085002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.085086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.085171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.085251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.085334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.085415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.085496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.085579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.085662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.085749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.085832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.085914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.085994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.086077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.086162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.086242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.086323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.086405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.086484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.086566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.086647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.086729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.086808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.086892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.086974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.087056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.087140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.087226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.087310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.087393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.087472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.087554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.087642] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.087778] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.087782] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47526, lrc_seqno=47526, guc_id=0, flags=0x73 in no process [-1] <7> [233.087785] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.087853] ------------[ cut here ]------------ <4> [233.087854] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.087856] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:8/994 <4> [233.087934] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.088001] CPU: 3 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.088003] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.088005] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.088006] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.088011] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.088087] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.088089] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.088091] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.088093] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.088094] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.088095] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.088096] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.088098] FS: 0000000000000000(0000) GS:ffff8888dac02000(0000) knlGS:0000000000000000 <4> [233.088099] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.088101] CR2: 000059a1b383f208 CR3: 000000012b66c002 CR4: 0000000000f72ef0 <4> [233.088102] PKRU: 55555554 <4> [233.088103] Call Trace: <4> [233.088104] <TASK> <4> [233.088108] ? __pfx_lock_acquire+0x10/0x10 <4> [233.088113] ? lock_release+0xd0/0x2b0 <4> [233.088118] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.088124] process_one_work+0x239/0x740 <4> [233.088130] worker_thread+0x200/0x3f0 <4> [233.088133] ? __pfx_worker_thread+0x10/0x10 <4> [233.088136] kthread+0x10d/0x150 <4> [233.088138] ? __pfx_kthread+0x10/0x10 <4> [233.088141] ret_from_fork+0x3bd/0x470 <4> [233.088143] ? __pfx_kthread+0x10/0x10 <4> [233.088146] ret_from_fork_asm+0x1a/0x30 <4> [233.088153] </TASK> <4> [233.088154] irq event stamp: 784749 <4> [233.088155] hardirqs last enabled at (784755): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.088158] hardirqs last disabled at (784760): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.088159] softirqs last enabled at (783938): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.088162] softirqs last disabled at (783881): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.088165] ---[ end trace 0000000000000000 ]--- <5> [233.089373] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47581, lrc_seqno=47581, guc_id=0, flags=0x73 in no process [-1] <7> [233.089376] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.089447] ------------[ cut here ]------------ <4> [233.089449] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.089450] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:8/994 <4> [233.089526] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.089591] CPU: 3 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.089593] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.089594] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.089596] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.089601] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.089676] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.089678] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.089680] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.089681] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.089682] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.089683] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.089684] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.089686] FS: 0000000000000000(0000) GS:ffff8888dac02000(0000) knlGS:0000000000000000 <4> [233.089687] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.089688] CR2: 000059a1b383f208 CR3: 000000012b66c002 CR4: 0000000000f72ef0 <4> [233.089690] PKRU: 55555554 <4> [233.089691] Call Trace: <4> [233.089692] <TASK> <4> [233.089695] ? __pfx_lock_acquire+0x10/0x10 <4> [233.089700] ? lock_release+0xd0/0x2b0 <4> [233.089705] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.089710] process_one_work+0x239/0x740 <4> [233.089716] worker_thread+0x200/0x3f0 <4> [233.089719] ? __pfx_worker_thread+0x10/0x10 <4> [233.089726] kthread+0x10d/0x150 <4> [233.089728] ? __pfx_kthread+0x10/0x10 <4> [233.089731] ret_from_fork+0x3bd/0x470 <4> [233.089734] ? __pfx_kthread+0x10/0x10 <4> [233.089737] ret_from_fork_asm+0x1a/0x30 <4> [233.089744] </TASK> <4> [233.089745] irq event stamp: 786633 <4> [233.089746] hardirqs last enabled at (786639): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.089748] hardirqs last disabled at (786644): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.089750] softirqs last enabled at (783938): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.089753] softirqs last disabled at (783881): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.089755] ---[ end trace 0000000000000000 ]--- <7> [233.089769] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.089880] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [233.089984] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.090066] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.090071] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.090304] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.090515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.090610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.090709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.090817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.090907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.090994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.091085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.091175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.091262] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.091364] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.091461] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.092496] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.102727] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.102984] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.103959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.104046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.104130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.104210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.104290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.104370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.104448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.104526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.104605] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.104683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.104774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.104853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.104931] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.105010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.105089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.105168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.105248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.105326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.105406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.105492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.105582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.105668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.105758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.105842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.105923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.106003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.106081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.106161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.106241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.106326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.106411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.106492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.106575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.106660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.106754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.106846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.106935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.107019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.107107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.107192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.107274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.107355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.107434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.107517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.107601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.107685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.107789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.107872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.107952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.108033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.108119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.108200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.108283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.108369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.108450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.108532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.108614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.108694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.108782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.108865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.108948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.109033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.109116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.109198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.109280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.109362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.109442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.109522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.109607] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.110576] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.110581] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47581, lrc_seqno=47581, guc_id=0, flags=0x73 in no process [-1] <7> [233.110583] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.110656] ------------[ cut here ]------------ <4> [233.110657] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.110658] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:8/994 <4> [233.110742] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.110809] CPU: 3 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.110811] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.110813] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.110814] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.110819] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.110896] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.110898] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.110900] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.110901] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.110903] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.110904] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.110905] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.110906] FS: 0000000000000000(0000) GS:ffff8888dac02000(0000) knlGS:0000000000000000 <4> [233.110908] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.110909] CR2: 000059a1b383f208 CR3: 000000012b66c002 CR4: 0000000000f72ef0 <4> [233.110911] PKRU: 55555554 <4> [233.110912] Call Trace: <4> [233.110913] <TASK> <4> [233.110916] ? __pfx_lock_acquire+0x10/0x10 <4> [233.110921] ? lock_release+0xd0/0x2b0 <4> [233.110926] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.110932] process_one_work+0x239/0x740 <4> [233.110938] worker_thread+0x200/0x3f0 <4> [233.110941] ? __pfx_worker_thread+0x10/0x10 <4> [233.110944] kthread+0x10d/0x150 <4> [233.110946] ? __pfx_kthread+0x10/0x10 <4> [233.110949] ret_from_fork+0x3bd/0x470 <4> [233.110951] ? __pfx_kthread+0x10/0x10 <4> [233.110954] ret_from_fork_asm+0x1a/0x30 <4> [233.110961] </TASK> <4> [233.110962] irq event stamp: 789777 <4> [233.110963] hardirqs last enabled at (789783): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.110966] hardirqs last disabled at (789788): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.110967] softirqs last enabled at (788614): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.110970] softirqs last disabled at (788607): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.110973] ---[ end trace 0000000000000000 ]--- <6> [233.110974] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.111049] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.111054] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.111068] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.111176] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.111466] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.111685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.111804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.111904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.111998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.112089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.112182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.112272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.112364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.112451] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.112552] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.112649] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.114025] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.124722] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.124991] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.125997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.126083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.126167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.126250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.126333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.126415] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.126498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.126580] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.126659] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.126768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.126846] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.126924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.127001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.127078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.127156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.127237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.127315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.127393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.127471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.127559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.127646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.127735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.127821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.127908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.127991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.128071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.128154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.128235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.128315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.128398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.128483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.128570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.128656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.128748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.128838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.128927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.129017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.129102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.129187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.129268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.129351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.129433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.129516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.129600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.129682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.129769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.129852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.129933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.130014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.130101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.130188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.130271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.130354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.130434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.130513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.130594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.130675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.130767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.130848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.130931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.131014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.131099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.131183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.131265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.131347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.131429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.131511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.131593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.131675] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.131809] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.131814] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47581, lrc_seqno=47581, guc_id=0, flags=0x73 in no process [-1] <7> [233.131816] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.131884] ------------[ cut here ]------------ <4> [233.131886] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.131887] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:38/3092 <4> [233.131966] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.132032] CPU: 8 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.132035] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.132036] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.132037] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.132043] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.132121] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.132122] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [233.132125] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.132126] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.132127] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.132129] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.132130] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.132131] FS: 0000000000000000(0000) GS:ffff8888dae82000(0000) knlGS:0000000000000000 <4> [233.132133] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.132134] CR2: 00007dc968a74000 CR3: 000000012991f001 CR4: 0000000000f72ef0 <4> [233.132136] PKRU: 55555554 <4> [233.132137] Call Trace: <4> [233.132138] <TASK> <4> [233.132142] ? __pfx_lock_acquire+0x10/0x10 <4> [233.132147] ? lock_release+0xd0/0x2b0 <4> [233.132152] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.132158] process_one_work+0x239/0x740 <4> [233.132164] worker_thread+0x200/0x3f0 <4> [233.132167] ? __pfx_worker_thread+0x10/0x10 <4> [233.132170] kthread+0x10d/0x150 <4> [233.132172] ? __pfx_kthread+0x10/0x10 <4> [233.132175] ret_from_fork+0x3bd/0x470 <4> [233.132177] ? __pfx_kthread+0x10/0x10 <4> [233.132180] ret_from_fork_asm+0x1a/0x30 <4> [233.132187] </TASK> <4> [233.132188] irq event stamp: 528035 <4> [233.132190] hardirqs last enabled at (528041): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.132192] hardirqs last disabled at (528046): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.132194] softirqs last enabled at (527206): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.132196] softirqs last disabled at (527189): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.132199] ---[ end trace 0000000000000000 ]--- <5> [233.133571] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47636, lrc_seqno=47636, guc_id=0, flags=0x73 in no process [-1] <7> [233.133574] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.133645] ------------[ cut here ]------------ <4> [233.133646] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.133647] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:38/3092 <4> [233.133730] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.133810] CPU: 8 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.133813] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.133814] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.133815] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.133820] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.133897] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.133899] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [233.133901] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.133903] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.133904] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.133905] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.133906] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.133907] FS: 0000000000000000(0000) GS:ffff8888dae82000(0000) knlGS:0000000000000000 <4> [233.133909] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.133910] CR2: 00007dc968a74000 CR3: 000000012991f001 CR4: 0000000000f72ef0 <4> [233.133912] PKRU: 55555554 <4> [233.133913] Call Trace: <4> [233.133914] <TASK> <4> [233.133917] ? __pfx_lock_acquire+0x10/0x10 <4> [233.133922] ? lock_release+0xd0/0x2b0 <4> [233.133926] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.133932] process_one_work+0x239/0x740 <4> [233.133939] worker_thread+0x200/0x3f0 <4> [233.133942] ? __pfx_worker_thread+0x10/0x10 <4> [233.133944] kthread+0x10d/0x150 <4> [233.133947] ? __pfx_kthread+0x10/0x10 <4> [233.133949] ret_from_fork+0x3bd/0x470 <4> [233.133952] ? __pfx_kthread+0x10/0x10 <4> [233.133954] ret_from_fork_asm+0x1a/0x30 <4> [233.133962] </TASK> <4> [233.133963] irq event stamp: 529913 <4> [233.133964] hardirqs last enabled at (529919): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.133966] hardirqs last disabled at (529924): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.133968] softirqs last enabled at (527206): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.133970] softirqs last disabled at (527189): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.133973] ---[ end trace 0000000000000000 ]--- <6> [233.133975] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.134048] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.134054] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.134210] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.134320] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.134431] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.134644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.134769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.134900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.134998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.135093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.135185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.135275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.135365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.135451] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.135553] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.135649] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.136700] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.146720] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.146978] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.147992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.148080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.148162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.148243] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.148324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.148406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.148487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.148566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.148643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.148728] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.148810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.148890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.148970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.149049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.149126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.149202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.149278] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.149357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.149439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.149526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.149613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.149696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.149792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.149878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.149961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.150040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.150120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.150199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.150277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.150360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.150444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.150526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.150608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.150690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.150789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.150877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.150965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.151048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.151130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.151210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.151290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.151369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.151447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.151526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.151607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.151689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.151777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.151855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.151934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.152015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.152098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.152179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.152260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.152338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.152415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.152497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.152580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.152660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.152747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.152831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.152913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.152993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.153078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.153162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.153247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.153328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.153410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.153493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.153576] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.153696] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.153700] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47636, lrc_seqno=47636, guc_id=0, flags=0x73 in no process [-1] <7> [233.153703] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.155157] ------------[ cut here ]------------ <4> [233.155158] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.155160] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:37/3091 <4> [233.155247] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.155315] CPU: 8 UID: 0 PID: 3091 Comm: kworker/u64:37 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.155317] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.155319] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.155320] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.155326] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.155403] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.155405] RSP: 0018:ffffc90007bb3ca0 EFLAGS: 00010246 <4> [233.155407] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.155408] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.155410] RBP: ffffc90007bb3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.155411] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.155412] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.155413] FS: 0000000000000000(0000) GS:ffff8888dae82000(0000) knlGS:0000000000000000 <4> [233.155415] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.155416] CR2: 00007dc968a74000 CR3: 0000000108194004 CR4: 0000000000f72ef0 <4> [233.155418] PKRU: 55555554 <4> [233.155419] Call Trace: <4> [233.155420] <TASK> <4> [233.155424] ? __pfx_lock_acquire+0x10/0x10 <4> [233.155429] ? lock_release+0xd0/0x2b0 <4> [233.155433] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.155439] process_one_work+0x239/0x740 <4> [233.155446] worker_thread+0x200/0x3f0 <4> [233.155449] ? __pfx_worker_thread+0x10/0x10 <4> [233.155452] kthread+0x10d/0x150 <4> [233.155454] ? __pfx_kthread+0x10/0x10 <4> [233.155457] ret_from_fork+0x3bd/0x470 <4> [233.155459] ? __pfx_kthread+0x10/0x10 <4> [233.155462] ret_from_fork_asm+0x1a/0x30 <4> [233.155469] </TASK> <4> [233.155470] irq event stamp: 1848317 <4> [233.155472] hardirqs last enabled at (1848323): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.155474] hardirqs last disabled at (1848328): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.155476] softirqs last enabled at (1847234): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.155479] softirqs last disabled at (1847229): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.155481] ---[ end trace 0000000000000000 ]--- <6> [233.155483] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.155562] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.155568] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.156113] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.156225] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.156338] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.156553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.156647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.156763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.156857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.156949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.157039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.157132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.157228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.157316] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.157416] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.157511] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.158562] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.168713] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.168971] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.169952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.170037] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.170119] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.170200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.170283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.170362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.170443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.170522] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.170600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.170678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.170765] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.170845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.170924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.171005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.171085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.171164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.171242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.171321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.171399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.171485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.171569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.171654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.171743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.171831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.171918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.171999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.172080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.172163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.172247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.172332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.172418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.172502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.172584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.172666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.172763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.172852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.172939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.173023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.173105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.173184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.173266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.173352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.173436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.173521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.173606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.173689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.173783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.173869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.173949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.174032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.174116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.174198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.174286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.174369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.174453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.174534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.174615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.174693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.174784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.174867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.174952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.175037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.175119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.175202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.175286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.175367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.175445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.175524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.175610] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.175957] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.175962] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47636, lrc_seqno=47636, guc_id=0, flags=0x73 in no process [-1] <7> [233.175964] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.176034] ------------[ cut here ]------------ <4> [233.176035] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.176036] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:37/3091 <4> [233.176116] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.176182] CPU: 8 UID: 0 PID: 3091 Comm: kworker/u64:37 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.176185] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.176186] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.176188] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.176193] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.176269] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.176271] RSP: 0018:ffffc90007bb3ca0 EFLAGS: 00010246 <4> [233.176273] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.176274] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.176276] RBP: ffffc90007bb3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.176277] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.176278] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.176279] FS: 0000000000000000(0000) GS:ffff8888dae82000(0000) knlGS:0000000000000000 <4> [233.176281] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.176282] CR2: 00007dc968a74000 CR3: 0000000108194004 CR4: 0000000000f72ef0 <4> [233.176284] PKRU: 55555554 <4> [233.176285] Call Trace: <4> [233.176286] <TASK> <4> [233.176290] ? __pfx_lock_acquire+0x10/0x10 <4> [233.176295] ? lock_release+0xd0/0x2b0 <4> [233.176300] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.176306] process_one_work+0x239/0x740 <4> [233.176313] worker_thread+0x200/0x3f0 <4> [233.176316] ? __pfx_worker_thread+0x10/0x10 <4> [233.176318] kthread+0x10d/0x150 <4> [233.176321] ? __pfx_kthread+0x10/0x10 <4> [233.176323] ret_from_fork+0x3bd/0x470 <4> [233.176326] ? __pfx_kthread+0x10/0x10 <4> [233.176329] ret_from_fork_asm+0x1a/0x30 <4> [233.176336] </TASK> <4> [233.176337] irq event stamp: 1851545 <4> [233.176338] hardirqs last enabled at (1851551): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.176341] hardirqs last disabled at (1851556): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.176343] softirqs last enabled at (1850386): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.176345] softirqs last disabled at (1850379): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.176348] ---[ end trace 0000000000000000 ]--- <5> [233.177759] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47691, lrc_seqno=47691, guc_id=0, flags=0x73 in no process [-1] <7> [233.177765] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.177839] ------------[ cut here ]------------ <4> [233.177840] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.177841] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:37/3091 <7> [233.177876] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [233.177961] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.178075] CPU: 9 UID: 0 PID: 3091 Comm: kworker/u64:37 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.178079] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.178081] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.178084] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [233.178037] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [233.178093] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.178211] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.178213] RSP: 0018:ffffc90007bb3ca0 EFLAGS: 00010246 <4> [233.178215] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.178216] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.178218] RBP: ffffc90007bb3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.178219] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.178220] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.178221] FS: 0000000000000000(0000) GS:ffff8888daf02000(0000) knlGS:0000000000000000 <4> [233.178223] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.178224] CR2: 00007ad37e5c2160 CR3: 000000000364a002 CR4: 0000000000f72ef0 <4> [233.178226] PKRU: 55555554 <4> [233.178227] Call Trace: <4> [233.178228] <TASK> <4> [233.178232] ? __pfx_lock_acquire+0x10/0x10 <4> [233.178237] ? lock_release+0xd0/0x2b0 <4> [233.178242] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.178248] process_one_work+0x239/0x740 <4> [233.178255] worker_thread+0x200/0x3f0 <4> [233.178258] ? __pfx_worker_thread+0x10/0x10 <4> [233.178260] kthread+0x10d/0x150 <4> [233.178262] ? __pfx_kthread+0x10/0x10 <4> [233.178265] ret_from_fork+0x3bd/0x470 <4> [233.178268] ? __pfx_kthread+0x10/0x10 <4> [233.178270] ret_from_fork_asm+0x1a/0x30 <4> [233.178278] </TASK> <4> [233.178279] irq event stamp: 1853403 <4> [233.178280] hardirqs last enabled at (1853409): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.178282] hardirqs last disabled at (1853414): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.178284] softirqs last enabled at (1850386): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.178287] softirqs last disabled at (1850379): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.178289] ---[ end trace 0000000000000000 ]--- <6> [233.178291] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.178371] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.178378] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.178450] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.178666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.178774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.178874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.178970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.179063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.179155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.179245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.179336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.179421] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.179521] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.179617] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.180662] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.191401] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.191660] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.192680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.192777] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.192858] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.192943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.193026] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.193107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.193186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.193266] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.193353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.193436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.193516] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.193594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.193673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.193763] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.193841] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.193918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.193995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.194072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.194150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.194236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.194322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.194405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.194487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.194571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.194655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.194751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.194836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.194918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.195000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.195083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.195167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.195248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.195331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.195412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.195499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.195588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.195675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.195772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.195858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.195944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.196028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.196111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.196190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.196272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.196356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.196438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.196520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.196601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.196681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.196774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.196860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.196946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.197031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.197113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.197193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.197276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.197356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.197436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.197515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.197598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.197680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.197775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.197857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.197938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.198020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.198105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.198188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.198269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.198354] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.198475] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.198479] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47691, lrc_seqno=47691, guc_id=0, flags=0x73 in no process [-1] <7> [233.198481] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.198549] ------------[ cut here ]------------ <4> [233.198551] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.198552] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:37/3091 <4> [233.198641] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.198716] CPU: 9 UID: 0 PID: 3091 Comm: kworker/u64:37 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.198719] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.198720] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.198721] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.198727] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.198804] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.198806] RSP: 0018:ffffc90007bb3ca0 EFLAGS: 00010246 <4> [233.198808] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.198809] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.198811] RBP: ffffc90007bb3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.198812] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.198813] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.198814] FS: 0000000000000000(0000) GS:ffff8888daf02000(0000) knlGS:0000000000000000 <4> [233.198816] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.198817] CR2: 00007ad37e5c2160 CR3: 000000000364a002 CR4: 0000000000f72ef0 <4> [233.198819] PKRU: 55555554 <4> [233.198820] Call Trace: <4> [233.198821] <TASK> <4> [233.198825] ? __pfx_lock_acquire+0x10/0x10 <4> [233.198830] ? lock_release+0xd0/0x2b0 <4> [233.198835] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.198840] process_one_work+0x239/0x740 <4> [233.198847] worker_thread+0x200/0x3f0 <4> [233.198850] ? __pfx_worker_thread+0x10/0x10 <4> [233.198853] kthread+0x10d/0x150 <4> [233.198855] ? __pfx_kthread+0x10/0x10 <4> [233.198858] ret_from_fork+0x3bd/0x470 <4> [233.198860] ? __pfx_kthread+0x10/0x10 <4> [233.198863] ret_from_fork_asm+0x1a/0x30 <4> [233.198870] </TASK> <4> [233.198871] irq event stamp: 1856551 <4> [233.198872] hardirqs last enabled at (1856557): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.198875] hardirqs last disabled at (1856562): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.198876] softirqs last enabled at (1855502): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.198879] softirqs last disabled at (1855495): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.198882] ---[ end trace 0000000000000000 ]--- <6> [233.199717] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.199935] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.199948] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.200129] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.200243] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.200351] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.200565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.200662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.200769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.200864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.200957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.201047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.201139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.201230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.201315] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.201415] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.201511] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.202544] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.213272] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.213529] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.214528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.214614] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.214701] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.214784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.214863] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.214941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.215020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.215098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.215177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.215256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.215335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.215414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.215492] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.215570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.215649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.215736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.215817] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.215896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.215975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.216061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.216148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.216235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.216317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.216400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.216481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.216561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.216641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.216727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.216807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.216895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.216982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.217067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.217151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.217235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.217323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.217416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.217509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.217597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.217682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.217775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.217857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.217937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.218017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.218106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.218193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.218277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.218360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.218443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.218525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.218606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.218693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.218788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.218875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.218961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.219043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.219126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.219209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.219291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.219372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.219456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.219538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.219620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.219705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.219788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.219872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.219954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.220035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.220116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.220201] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.220321] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.220326] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47691, lrc_seqno=47691, guc_id=0, flags=0x73 in no process [-1] <7> [233.220328] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.220396] ------------[ cut here ]------------ <4> [233.220397] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.220398] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:8/994 <4> [233.220477] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.220544] CPU: 3 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.220547] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.220548] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.220549] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.220555] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.220641] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.220643] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.220645] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.220646] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.220647] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.220649] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.220650] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.220651] FS: 0000000000000000(0000) GS:ffff8888dac02000(0000) knlGS:0000000000000000 <4> [233.220653] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.220654] CR2: 000059a1b383f208 CR3: 000000000364a006 CR4: 0000000000f72ef0 <4> [233.220655] PKRU: 55555554 <4> [233.220657] Call Trace: <4> [233.220658] <TASK> <4> [233.220662] ? __pfx_lock_acquire+0x10/0x10 <4> [233.220667] ? lock_release+0xd0/0x2b0 <4> [233.220672] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.220678] process_one_work+0x239/0x740 <4> [233.220684] worker_thread+0x200/0x3f0 <4> [233.220687] ? __pfx_worker_thread+0x10/0x10 <4> [233.220690] kthread+0x10d/0x150 <4> [233.220692] ? __pfx_kthread+0x10/0x10 <4> [233.220700] ret_from_fork+0x3bd/0x470 <4> [233.220702] ? __pfx_kthread+0x10/0x10 <4> [233.220705] ret_from_fork_asm+0x1a/0x30 <4> [233.220712] </TASK> <4> [233.220713] irq event stamp: 793769 <4> [233.220715] hardirqs last enabled at (793775): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.220717] hardirqs last disabled at (793780): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.220719] softirqs last enabled at (793744): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.220722] softirqs last disabled at (793739): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.220725] ---[ end trace 0000000000000000 ]--- <5> [233.221688] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47746, lrc_seqno=47746, guc_id=0, flags=0x73 in no process [-1] <7> [233.221693] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.221842] ------------[ cut here ]------------ <4> [233.221845] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.221847] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:8/994 <4> [233.221935] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.222009] CPU: 11 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.222012] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.222014] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.222015] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [233.221978] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [233.222020] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.222099] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.222101] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.222103] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.222105] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.222106] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.222107] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.222109] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.222110] FS: 0000000000000000(0000) GS:ffff8888db002000(0000) knlGS:0000000000000000 <4> [233.222112] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.222113] CR2: 00007dc968a76000 CR3: 000000012991f006 CR4: 0000000000f72ef0 <4> [233.222114] PKRU: 55555554 <4> [233.222116] Call Trace: <4> [233.222117] <TASK> <4> [233.222120] ? __pfx_lock_acquire+0x10/0x10 <4> [233.222126] ? lock_release+0xd0/0x2b0 <4> [233.222131] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.222137] process_one_work+0x239/0x740 <7> [233.222094] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [233.222144] worker_thread+0x200/0x3f0 <4> [233.222147] ? __pfx_worker_thread+0x10/0x10 <4> [233.222149] kthread+0x10d/0x150 <4> [233.222151] ? __pfx_kthread+0x10/0x10 <4> [233.222154] ret_from_fork+0x3bd/0x470 <4> [233.222156] ? __pfx_kthread+0x10/0x10 <4> [233.222158] ret_from_fork_asm+0x1a/0x30 <4> [233.222165] </TASK> <4> [233.222166] irq event stamp: 795833 <4> [233.222167] hardirqs last enabled at (795839): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.222169] hardirqs last disabled at (795844): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.222171] softirqs last enabled at (795076): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.222173] softirqs last disabled at (795069): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.222176] ---[ end trace 0000000000000000 ]--- <6> [233.222178] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.222254] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.222260] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.222307] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.222647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.222757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.222857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.222952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.223043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.223134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.223224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.223317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.223404] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.223510] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.223605] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.224642] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.234703] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.234963] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.235965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.236056] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.236139] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.236223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.236305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.236386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.236466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.236547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.236628] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.236715] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.236794] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.236875] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.236954] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.237031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.237112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.237189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.237268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.237345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.237423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.237511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.237597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.237681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.237785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.237871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.237956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.238036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.238117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.238200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.238285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.238370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.238458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.238538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.238624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.238714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.238803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.238893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.238982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.239069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.239152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.239232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.239315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.239397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.239477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.239559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.239643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.239738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.239822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.239904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.239986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.240070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.240154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.240236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.240317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.240399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.240481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.240565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.240649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.240737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.240816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.240899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.240981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.241061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.241143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.241221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.241305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.241391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.241473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.241552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.241638] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.241769] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.241773] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47746, lrc_seqno=47746, guc_id=0, flags=0x73 in no process [-1] <7> [233.241776] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.241844] ------------[ cut here ]------------ <4> [233.241845] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.241846] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:8/994 <4> [233.241927] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.241993] CPU: 11 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.241996] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.241997] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.241999] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.242004] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.242082] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.242084] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.242086] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.242088] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.242089] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.242090] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.242091] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.242093] FS: 0000000000000000(0000) GS:ffff8888db002000(0000) knlGS:0000000000000000 <4> [233.242094] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.242095] CR2: 00007dc968a76000 CR3: 000000012991f006 CR4: 0000000000f72ef0 <4> [233.242097] PKRU: 55555554 <4> [233.242098] Call Trace: <4> [233.242099] <TASK> <4> [233.242103] ? __pfx_lock_acquire+0x10/0x10 <4> [233.242108] ? lock_release+0xd0/0x2b0 <4> [233.242113] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.242119] process_one_work+0x239/0x740 <4> [233.242126] worker_thread+0x200/0x3f0 <4> [233.242129] ? __pfx_worker_thread+0x10/0x10 <4> [233.242131] kthread+0x10d/0x150 <4> [233.242133] ? __pfx_kthread+0x10/0x10 <4> [233.242136] ret_from_fork+0x3bd/0x470 <4> [233.242139] ? __pfx_kthread+0x10/0x10 <4> [233.242141] ret_from_fork_asm+0x1a/0x30 <4> [233.242149] </TASK> <4> [233.242150] irq event stamp: 798965 <4> [233.242151] hardirqs last enabled at (798971): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.242153] hardirqs last disabled at (798976): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.242155] softirqs last enabled at (797976): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.242158] softirqs last disabled at (797971): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.242160] ---[ end trace 0000000000000000 ]--- <6> [233.242162] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.242241] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.242246] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.243506] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.243620] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.244012] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.244228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.244326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.244425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.244517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.244607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.244702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.244792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.244884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.244971] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.245072] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.245168] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.246217] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.256697] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.256959] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.257978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.258064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.258146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.258230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.258313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.258394] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.258476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.258556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.258635] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.258721] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.258800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.258881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.258961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.259041] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.259121] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.259204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.259283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.259361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.259441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.259526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.259613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.259702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.259786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.259871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.259955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.260036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.260120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.260203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.260285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.260368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.260453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.260536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.260622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.260711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.260802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.260891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.260979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.261064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.261148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.261232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.261317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.261397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.261479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.261566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.261650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.261739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.261823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.261905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.261984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.262065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.262150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.262231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.262314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.262395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.262473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.262552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.262634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.262721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.262806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.262892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.262975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.263059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.263140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.263220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.263301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.263382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.263463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.263543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.263627] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.263755] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.263760] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47746, lrc_seqno=47746, guc_id=0, flags=0x73 in no process [-1] <7> [233.263762] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.263830] ------------[ cut here ]------------ <4> [233.263831] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.263833] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:38/3092 <4> [233.263910] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.263978] CPU: 8 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.263980] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.263982] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.263983] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.263989] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.264066] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.264068] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [233.264070] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.264072] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.264073] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.264074] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.264075] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.264076] FS: 0000000000000000(0000) GS:ffff8888dae82000(0000) knlGS:0000000000000000 <4> [233.264078] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.264079] CR2: 00007dc968a74000 CR3: 0000000108194004 CR4: 0000000000f72ef0 <4> [233.264081] PKRU: 55555554 <4> [233.264082] Call Trace: <4> [233.264083] <TASK> <4> [233.264087] ? __pfx_lock_acquire+0x10/0x10 <4> [233.264092] ? lock_release+0xd0/0x2b0 <4> [233.264097] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.264103] process_one_work+0x239/0x740 <4> [233.264110] worker_thread+0x200/0x3f0 <4> [233.264113] ? __pfx_worker_thread+0x10/0x10 <4> [233.264116] kthread+0x10d/0x150 <4> [233.264118] ? __pfx_kthread+0x10/0x10 <4> [233.264121] ret_from_fork+0x3bd/0x470 <4> [233.264123] ? __pfx_kthread+0x10/0x10 <4> [233.264126] ret_from_fork_asm+0x1a/0x30 <4> [233.264133] </TASK> <4> [233.264134] irq event stamp: 537063 <4> [233.264135] hardirqs last enabled at (537069): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.264138] hardirqs last disabled at (537074): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.264139] softirqs last enabled at (536234): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.264142] softirqs last disabled at (536215): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.264145] ---[ end trace 0000000000000000 ]--- <5> [233.265369] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47801, lrc_seqno=47801, guc_id=0, flags=0x73 in no process [-1] <7> [233.265372] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.265721] ------------[ cut here ]------------ <4> [233.265722] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.265723] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:38/3092 <4> [233.265801] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.265867] CPU: 8 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.265870] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.265871] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.265872] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.265877] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.265954] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.265956] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [233.265958] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.265959] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.265960] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.265961] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.265963] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.265964] FS: 0000000000000000(0000) GS:ffff8888dae82000(0000) knlGS:0000000000000000 <4> [233.265965] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.265967] CR2: 00007dc968a74000 CR3: 0000000108194004 CR4: 0000000000f72ef0 <4> [233.265968] PKRU: 55555554 <4> [233.265969] Call Trace: <4> [233.265970] <TASK> <4> [233.265974] ? __pfx_lock_acquire+0x10/0x10 <4> [233.265979] ? lock_release+0xd0/0x2b0 <4> [233.265984] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.265989] process_one_work+0x239/0x740 <4> [233.265996] worker_thread+0x200/0x3f0 <4> [233.265999] ? __pfx_worker_thread+0x10/0x10 <4> [233.266001] kthread+0x10d/0x150 <4> [233.266003] ? __pfx_kthread+0x10/0x10 <4> [233.266006] ret_from_fork+0x3bd/0x470 <4> [233.266009] ? __pfx_kthread+0x10/0x10 <4> [233.266011] ret_from_fork_asm+0x1a/0x30 <4> [233.266018] </TASK> <4> [233.266020] irq event stamp: 538941 <4> [233.266021] hardirqs last enabled at (538947): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.266023] hardirqs last disabled at (538952): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.266025] softirqs last enabled at (536234): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.266027] softirqs last disabled at (536215): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.266030] ---[ end trace 0000000000000000 ]--- <6> [233.266032] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.266109] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.266117] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.266272] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.266381] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.266495] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.266788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.266883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.266980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.267074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.267170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.267264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.267355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.267446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.267533] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.267633] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.267737] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.268962] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.278693] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.278953] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.280040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.280126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.280207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.280290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.280370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.280450] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.280529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.280608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.280692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.280769] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.280847] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.280924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.281006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.281085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.281164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.281246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.281328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.281406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.281484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.281573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.281659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.281750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.281832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.281913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.281995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.282075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.282156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.282236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.282315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.282397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.282483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.282565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.282648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.282739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.282828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.282920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.283011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.283097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.283182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.283262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.283343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.283424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.283503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.283585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.283669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.283761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.283842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.283927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.284006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.284088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.284171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.284251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.284333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.284415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.284494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.284576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.284660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.284749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.284831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.284914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.284995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.285081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.285163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.285243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.285325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.285407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.285488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.285571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.285659] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.285790] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.285794] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47801, lrc_seqno=47801, guc_id=0, flags=0x73 in no process [-1] <7> [233.285797] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.285864] ------------[ cut here ]------------ <4> [233.285865] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.285866] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:8/994 <4> [233.285945] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.286011] CPU: 8 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.286014] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.286015] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.286016] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.286022] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.286099] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.286100] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.286102] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.286104] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.286105] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.286106] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.286107] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.286109] FS: 0000000000000000(0000) GS:ffff8888dae82000(0000) knlGS:0000000000000000 <4> [233.286110] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.286112] CR2: 00007dc968a74000 CR3: 000000012b66c003 CR4: 0000000000f72ef0 <4> [233.286113] PKRU: 55555554 <4> [233.286114] Call Trace: <4> [233.286115] <TASK> <4> [233.286119] ? __pfx_lock_acquire+0x10/0x10 <4> [233.286124] ? lock_release+0xd0/0x2b0 <4> [233.286129] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.286135] process_one_work+0x239/0x740 <4> [233.286142] worker_thread+0x200/0x3f0 <4> [233.286145] ? __pfx_worker_thread+0x10/0x10 <4> [233.286147] kthread+0x10d/0x150 <4> [233.286149] ? __pfx_kthread+0x10/0x10 <4> [233.286152] ret_from_fork+0x3bd/0x470 <4> [233.286155] ? __pfx_kthread+0x10/0x10 <4> [233.286157] ret_from_fork_asm+0x1a/0x30 <4> [233.286165] </TASK> <4> [233.286166] irq event stamp: 802461 <4> [233.286167] hardirqs last enabled at (802467): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.286169] hardirqs last disabled at (802472): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.286171] softirqs last enabled at (801376): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.286174] softirqs last disabled at (801371): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.286176] ---[ end trace 0000000000000000 ]--- <6> [233.286178] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.286255] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.286261] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.286541] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.286932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.287029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.287128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.287223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.287315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.287403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.287493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.287584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.287670] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.287785] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.287879] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.288912] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.299640] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.299906] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.300937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.301021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.301103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.301187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.301272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.301354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.301434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.301514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.301592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.301670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.301761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.301839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.301917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.301999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.302081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.302161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.302239] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.302318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.302397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.302485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.302575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.302663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.302758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.302842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.302925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.303008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.303089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.303171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.303252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.303336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.303423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.303510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.303595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.303683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.303772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.303860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.303948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.304038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.304121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.304202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.304287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.304372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.304455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.304538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.304621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.304708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.304791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.304876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.304959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.305047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.305134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.305220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.305305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.305390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.305472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.305554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.305636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.305722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.305802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.305887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.305971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.306054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.306136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.306216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.306296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.306376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.306454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.306535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.306623] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.306748] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.306752] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47801, lrc_seqno=47801, guc_id=0, flags=0x73 in no process [-1] <7> [233.306754] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.306821] ------------[ cut here ]------------ <4> [233.306822] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.306823] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:8/994 <4> [233.306902] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.306966] CPU: 8 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.306969] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.306970] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.306972] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.306977] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.307053] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.307054] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.307056] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.307058] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.307059] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.307060] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.307062] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.307063] FS: 0000000000000000(0000) GS:ffff8888dae82000(0000) knlGS:0000000000000000 <4> [233.307064] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.307066] CR2: 00007dc968a74000 CR3: 000000000364a006 CR4: 0000000000f72ef0 <4> [233.307067] PKRU: 55555554 <4> [233.307068] Call Trace: <4> [233.307069] <TASK> <4> [233.307073] ? __pfx_lock_acquire+0x10/0x10 <4> [233.307078] ? lock_release+0xd0/0x2b0 <4> [233.307083] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.307089] process_one_work+0x239/0x740 <4> [233.307095] worker_thread+0x200/0x3f0 <4> [233.307098] ? __pfx_worker_thread+0x10/0x10 <4> [233.307101] kthread+0x10d/0x150 <4> [233.307103] ? __pfx_kthread+0x10/0x10 <4> [233.307106] ret_from_fork+0x3bd/0x470 <4> [233.307108] ? __pfx_kthread+0x10/0x10 <4> [233.307111] ret_from_fork_asm+0x1a/0x30 <4> [233.307118] </TASK> <4> [233.307119] irq event stamp: 805633 <4> [233.307120] hardirqs last enabled at (805639): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.307122] hardirqs last disabled at (805644): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.307124] softirqs last enabled at (804554): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.307127] softirqs last disabled at (804549): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.307129] ---[ end trace 0000000000000000 ]--- <5> [233.307504] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47856, lrc_seqno=47856, guc_id=0, flags=0x73 in no process [-1] <7> [233.307511] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.307739] ------------[ cut here ]------------ <4> [233.307743] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.307745] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:37/3091 <4> [233.307883] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.307958] CPU: 2 UID: 0 PID: 3091 Comm: kworker/u64:37 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.307964] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.307965] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.307968] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.307976] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.308070] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.308072] RSP: 0018:ffffc90007bb3ca0 EFLAGS: 00010246 <4> [233.308075] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.308077] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.308078] RBP: ffffc90007bb3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.308079] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.308081] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.308082] FS: 0000000000000000(0000) GS:ffff8888dab82000(0000) knlGS:0000000000000000 <4> [233.308084] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.308085] CR2: 00007dc968a6d000 CR3: 000000012991f003 CR4: 0000000000f72ef0 <4> [233.308086] PKRU: 55555554 <4> [233.308087] Call Trace: <4> [233.308090] <TASK> <4> [233.308093] ? __pfx_lock_acquire+0x10/0x10 <4> [233.308099] ? lock_release+0xd0/0x2b0 <4> [233.308104] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.308111] process_one_work+0x239/0x740 <4> [233.308119] worker_thread+0x200/0x3f0 <4> [233.308122] ? __pfx_worker_thread+0x10/0x10 <4> [233.308125] kthread+0x10d/0x150 <4> [233.308127] ? __pfx_kthread+0x10/0x10 <4> [233.308130] ret_from_fork+0x3bd/0x470 <4> [233.308133] ? __pfx_kthread+0x10/0x10 <4> [233.308135] ret_from_fork_asm+0x1a/0x30 <4> [233.308143] </TASK> <4> [233.308144] irq event stamp: 1860401 <4> [233.308145] hardirqs last enabled at (1860407): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.308149] hardirqs last disabled at (1860412): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.308151] softirqs last enabled at (1859642): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.308154] softirqs last disabled at (1859635): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.308156] ---[ end trace 0000000000000000 ]--- <6> [233.308160] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.308248] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.308408] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.308464] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.308573] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.308691] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.308907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.309001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.309097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.309189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.309280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.309371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.309461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.309555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.309646] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.309759] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.309855] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.310892] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.320684] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.320941] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.321944] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.322032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.322114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.322198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.322280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.322359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.322438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.322516] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.322595] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.322673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.322765] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.322847] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.322928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.323007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.323087] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.323167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.323244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.323322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.323402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.323490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.323577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.323661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.323755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.323839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.323927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.324012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.324095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.324175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.324255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.324339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.324421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.324502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.324586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.324669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.324770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.324863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.324951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.325036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.325119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.325200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.325286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.325369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.325449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.325531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.325614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.325698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.325779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.325863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.325943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.326026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.326109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.326190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.326276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.326357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.326437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.326518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.326600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.326685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.326767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.326851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.326931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.327013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.327093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.327178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.327263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.327344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.327424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.327506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.327591] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.327714] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.327718] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47856, lrc_seqno=47856, guc_id=0, flags=0x73 in no process [-1] <7> [233.327720] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.327788] ------------[ cut here ]------------ <4> [233.327789] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.327790] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:8/994 <4> [233.327867] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.327932] CPU: 8 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.327935] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.327936] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.327938] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.327943] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.328018] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.328020] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.328022] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.328024] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.328025] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.328026] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.328027] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.328029] FS: 0000000000000000(0000) GS:ffff8888dae82000(0000) knlGS:0000000000000000 <4> [233.328030] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.328032] CR2: 00007dc968a74000 CR3: 000000000364a006 CR4: 0000000000f72ef0 <4> [233.328033] PKRU: 55555554 <4> [233.328034] Call Trace: <4> [233.328035] <TASK> <4> [233.328039] ? __pfx_lock_acquire+0x10/0x10 <4> [233.328044] ? lock_release+0xd0/0x2b0 <4> [233.328049] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.328054] process_one_work+0x239/0x740 <4> [233.328061] worker_thread+0x200/0x3f0 <4> [233.328064] ? __pfx_worker_thread+0x10/0x10 <4> [233.328067] kthread+0x10d/0x150 <4> [233.328069] ? __pfx_kthread+0x10/0x10 <4> [233.328072] ret_from_fork+0x3bd/0x470 <4> [233.328074] ? __pfx_kthread+0x10/0x10 <4> [233.328076] ret_from_fork_asm+0x1a/0x30 <4> [233.328084] </TASK> <4> [233.328085] irq event stamp: 809973 <4> [233.328086] hardirqs last enabled at (809979): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.328088] hardirqs last disabled at (809984): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.328090] softirqs last enabled at (808984): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.328093] softirqs last disabled at (808977): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.328095] ---[ end trace 0000000000000000 ]--- <6> [233.328097] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.328174] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.328180] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.329414] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.329528] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.329640] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.329862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.329961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.330061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.330152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.330244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.330331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.330421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.330511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.330597] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.330702] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.330797] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.331848] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.342580] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.342831] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.343837] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.343923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.344004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.344086] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.344166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.344247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.344325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.344405] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.344485] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.344564] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.344644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.344732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.344814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.344895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.344975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.345053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.345131] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.345208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.345287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.345375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.345461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.345548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.345634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.345728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.345813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.345896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.345977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.346058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.346140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.346224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.346309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.346395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.346480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.346567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.346655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.346754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.346843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.346927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.347014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.347099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.347183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.347265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.347347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.347430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.347514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.347599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.347687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.347770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.347851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.347933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.348017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.348099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.348180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.348260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.348339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.348421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.348502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.348587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.348673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.348757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.348839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.348921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.349002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.349084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.349170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.349254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.349334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.349413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.349498] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.349619] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.349623] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47856, lrc_seqno=47856, guc_id=0, flags=0x73 in no process [-1] <7> [233.349625] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.350560] ------------[ cut here ]------------ <4> [233.350562] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.350563] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:37/3091 <4> [233.350647] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.350731] CPU: 2 UID: 0 PID: 3091 Comm: kworker/u64:37 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.350735] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.350736] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.350738] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.350744] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.350822] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.350824] RSP: 0018:ffffc90007bb3ca0 EFLAGS: 00010246 <4> [233.350826] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.350828] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.350829] RBP: ffffc90007bb3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.350830] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.350832] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.350833] FS: 0000000000000000(0000) GS:ffff8888dab82000(0000) knlGS:0000000000000000 <4> [233.350835] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.350836] CR2: 00007dc968a6d000 CR3: 000000000364a002 CR4: 0000000000f72ef0 <4> [233.350837] PKRU: 55555554 <4> [233.350839] Call Trace: <4> [233.350840] <TASK> <4> [233.350844] ? __pfx_lock_acquire+0x10/0x10 <4> [233.350849] ? lock_release+0xd0/0x2b0 <4> [233.350854] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.350859] process_one_work+0x239/0x740 <4> [233.350866] worker_thread+0x200/0x3f0 <4> [233.350869] ? __pfx_worker_thread+0x10/0x10 <4> [233.350872] kthread+0x10d/0x150 <4> [233.350874] ? __pfx_kthread+0x10/0x10 <4> [233.350877] ret_from_fork+0x3bd/0x470 <4> [233.350880] ? __pfx_kthread+0x10/0x10 <4> [233.350882] ret_from_fork_asm+0x1a/0x30 <4> [233.350890] </TASK> <4> [233.350891] irq event stamp: 1863663 <4> [233.350892] hardirqs last enabled at (1863669): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.350895] hardirqs last disabled at (1863674): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.350896] softirqs last enabled at (1863082): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.350899] softirqs last disabled at (1863075): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.350902] ---[ end trace 0000000000000000 ]--- <5> [233.351262] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47911, lrc_seqno=47911, guc_id=0, flags=0x73 in no process [-1] <7> [233.351267] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [233.351271] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [233.351344] ------------[ cut here ]------------ <4> [233.351345] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.351346] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:38/3092 <4> [233.351430] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy <7> [233.351382] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [233.351434] mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.351498] CPU: 7 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.351501] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.351503] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.351504] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.351510] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.351588] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.351590] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [233.351592] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.351594] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.351595] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.351596] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.351598] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.351599] FS: 0000000000000000(0000) GS:ffff8888dae02000(0000) knlGS:0000000000000000 <4> [233.351600] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.351602] CR2: 00007dc968a72000 CR3: 000000000364a003 CR4: 0000000000f72ef0 <4> [233.351603] PKRU: 55555554 <4> [233.351604] Call Trace: <4> [233.351605] <TASK> <4> [233.351609] ? __pfx_lock_acquire+0x10/0x10 <4> [233.351615] ? lock_release+0xd0/0x2b0 <4> [233.351619] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.351626] process_one_work+0x239/0x740 <4> [233.351633] worker_thread+0x200/0x3f0 <4> [233.351636] ? __pfx_worker_thread+0x10/0x10 <4> [233.351638] kthread+0x10d/0x150 <4> [233.351641] ? __pfx_kthread+0x10/0x10 <4> [233.351644] ret_from_fork+0x3bd/0x470 <4> [233.351646] ? __pfx_kthread+0x10/0x10 <4> [233.351649] ret_from_fork_asm+0x1a/0x30 <4> [233.351656] </TASK> <4> [233.351657] irq event stamp: 542519 <4> [233.351658] hardirqs last enabled at (542525): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.351661] hardirqs last disabled at (542530): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.351662] softirqs last enabled at (540888): [<ffffffff8133bd03>] kernel_fpu_end+0x53/0x70 <4> [233.351665] softirqs last disabled at (540886): [<ffffffff8133c414>] kernel_fpu_begin_mask+0xc4/0x120 <4> [233.351667] ---[ end trace 0000000000000000 ]--- <6> [233.351677] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.351762] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.351768] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.351907] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.352119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.352216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.352313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.352408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.352499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.352589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.352688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.352786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.352878] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.352981] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.353076] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.354114] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.364679] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.364942] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.365956] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.366043] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.366125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.366213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.366297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.366379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.366460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.366540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.366619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.366710] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.366795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.366876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.366956] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.367036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.367114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.367191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.367269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.367348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.367428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.367515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.367600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.367691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.367774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.367859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.367948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.368031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.368116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.368198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.368279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.368364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.368449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.368533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.368616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.368709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.368798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.368889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.368978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.369066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.369152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.369234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.369318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.369402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.369482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.369563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.369645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.369745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.369828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.369908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.369988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.370072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.370159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.370244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.370328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.370410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.370492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.370576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.370659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.370751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.370831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.370914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.370995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.371078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.371159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.371240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.371322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.371404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.371488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.371571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.371655] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.371794] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.371798] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47911, lrc_seqno=47911, guc_id=0, flags=0x73 in no process [-1] <7> [233.371801] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.371869] ------------[ cut here ]------------ <4> [233.371870] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.371871] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:38/3092 <4> [233.371950] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.372015] CPU: 7 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.372018] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.372019] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.372021] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.372026] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.372102] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.372104] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [233.372106] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.372108] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.372109] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.372110] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.372111] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.372113] FS: 0000000000000000(0000) GS:ffff8888dae02000(0000) knlGS:0000000000000000 <4> [233.372114] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.372116] CR2: 00007dc968a72000 CR3: 000000000364a003 CR4: 0000000000f72ef0 <4> [233.372117] PKRU: 55555554 <4> [233.372118] Call Trace: <4> [233.372119] <TASK> <4> [233.372123] ? __pfx_lock_acquire+0x10/0x10 <4> [233.372128] ? lock_release+0xd0/0x2b0 <4> [233.372133] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.372139] process_one_work+0x239/0x740 <4> [233.372145] worker_thread+0x200/0x3f0 <4> [233.372148] ? __pfx_worker_thread+0x10/0x10 <4> [233.372151] kthread+0x10d/0x150 <4> [233.372153] ? __pfx_kthread+0x10/0x10 <4> [233.372156] ret_from_fork+0x3bd/0x470 <4> [233.372159] ? __pfx_kthread+0x10/0x10 <4> [233.372161] ret_from_fork_asm+0x1a/0x30 <4> [233.372168] </TASK> <4> [233.372170] irq event stamp: 545681 <4> [233.372171] hardirqs last enabled at (545687): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.372173] hardirqs last disabled at (545692): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.372175] softirqs last enabled at (544692): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.372177] softirqs last disabled at (544685): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.372180] ---[ end trace 0000000000000000 ]--- <6> [233.372182] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.372260] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.372267] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.373521] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.373634] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.373795] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.374025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.374118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.374216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.374312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.374405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.374496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.374584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.374680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.374767] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.374870] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.374966] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.376002] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.387009] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.387265] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.388269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.388358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.388440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.388522] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.388602] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.388696] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.388778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.388859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.388937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.389014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.389093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.389170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.389252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.389332] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.389412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.389489] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.389567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.389647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.389742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.389829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.389916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.390002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.390084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.390172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.390256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.390338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.390419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.390500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.390582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.390675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.390761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.390845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.390929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.391012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.391102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.391191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.391283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.391369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.391454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.391537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.391619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.391710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.391790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.391876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.391961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.392046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.392129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.392209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.392287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.392368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.392452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.392533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.392615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.392704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.392784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.392865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.392946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.393026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.393105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.393188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.393269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.393349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.393430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.393516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.393600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.393692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.393773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.393853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.393936] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.394060] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.394065] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47911, lrc_seqno=47911, guc_id=0, flags=0x73 in no process [-1] <7> [233.394067] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.394135] ------------[ cut here ]------------ <4> [233.394136] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.394137] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:8/994 <4> [233.394216] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.394282] CPU: 6 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.394285] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.394286] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.394288] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.394293] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.394373] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.394375] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.394377] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.394379] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.394380] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.394381] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.394383] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.394384] FS: 0000000000000000(0000) GS:ffff8888dad82000(0000) knlGS:0000000000000000 <4> [233.394385] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.394387] CR2: 00007fff30088fe0 CR3: 000000000364a005 CR4: 0000000000f72ef0 <4> [233.394388] PKRU: 55555554 <4> [233.394389] Call Trace: <4> [233.394391] <TASK> <4> [233.394394] ? __pfx_lock_acquire+0x10/0x10 <4> [233.394400] ? lock_release+0xd0/0x2b0 <4> [233.394404] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.394410] process_one_work+0x239/0x740 <4> [233.394417] worker_thread+0x200/0x3f0 <4> [233.394420] ? __pfx_worker_thread+0x10/0x10 <4> [233.394422] kthread+0x10d/0x150 <4> [233.394425] ? __pfx_kthread+0x10/0x10 <4> [233.394427] ret_from_fork+0x3bd/0x470 <4> [233.394430] ? __pfx_kthread+0x10/0x10 <4> [233.394432] ret_from_fork_asm+0x1a/0x30 <4> [233.394440] </TASK> <4> [233.394441] irq event stamp: 814539 <4> [233.394442] hardirqs last enabled at (814545): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.394444] hardirqs last disabled at (814550): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.394446] softirqs last enabled at (813424): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.394449] softirqs last disabled at (813417): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.394451] ---[ end trace 0000000000000000 ]--- <5> [233.395566] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47966, lrc_seqno=47966, guc_id=0, flags=0x73 in no process [-1] <7> [233.395572] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.395959] ------------[ cut here ]------------ <4> [233.395960] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.395962] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:8/994 <4> [233.396074] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm <7> [233.396006] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [233.396088] drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.396190] CPU: 7 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.396194] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.396196] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.396198] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [233.396166] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [233.396206] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.396330] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.396332] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.396334] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.396336] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.396337] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.396338] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.396339] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.396341] FS: 0000000000000000(0000) GS:ffff8888dae02000(0000) knlGS:0000000000000000 <4> [233.396342] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.396343] CR2: 00007dc968a72000 CR3: 000000000364a003 CR4: 0000000000f72ef0 <4> [233.396345] PKRU: 55555554 <4> [233.396346] Call Trace: <4> [233.396347] <TASK> <4> [233.396351] ? __pfx_lock_acquire+0x10/0x10 <4> [233.396356] ? lock_release+0xd0/0x2b0 <4> [233.396360] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.396366] process_one_work+0x239/0x740 <4> [233.396373] worker_thread+0x200/0x3f0 <4> [233.396376] ? __pfx_worker_thread+0x10/0x10 <4> [233.396378] kthread+0x10d/0x150 <4> [233.396381] ? __pfx_kthread+0x10/0x10 <4> [233.396384] ret_from_fork+0x3bd/0x470 <4> [233.396386] ? __pfx_kthread+0x10/0x10 <4> [233.396388] ret_from_fork_asm+0x1a/0x30 <4> [233.396396] </TASK> <4> [233.396397] irq event stamp: 816255 <4> [233.396398] hardirqs last enabled at (816261): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.396400] hardirqs last disabled at (816266): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.396402] softirqs last enabled at (815500): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.396404] softirqs last disabled at (815313): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.396407] ---[ end trace 0000000000000000 ]--- <6> [233.396409] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.396487] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.396493] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.396560] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.396773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.396869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.396966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.397060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.397153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.397246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.397339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.397432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.397518] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.397622] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.397729] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.398779] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.409508] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.409765] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.410785] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.410872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.410954] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.411035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.411116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.411195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.411273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.411350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.411430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.411513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.411594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.411685] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.411764] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.411844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.411926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.412007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.412085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.412164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.412241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.412328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.412415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.412501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.412585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.412671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.412753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.412834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.412915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.412996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.413076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.413163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.413246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.413327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.413414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.413503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.413592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.413687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.413776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.413861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.413947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.414029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.414117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.414203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.414288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.414370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.414454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.414536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.414617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.414704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.414783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.414864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.414947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.415027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.415112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.415199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.415281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.415363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.415444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.415525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.415605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.415700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.415786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.415871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.415954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.416038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.416122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.416204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.416285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.416364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.416448] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.416569] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.416573] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47966, lrc_seqno=47966, guc_id=0, flags=0x73 in no process [-1] <7> [233.416575] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.416642] ------------[ cut here ]------------ <4> [233.416643] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.416645] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:8/994 <4> [233.416734] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.416800] CPU: 7 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.416803] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.416804] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.416806] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.416811] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.416890] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.416891] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.416894] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.416895] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.416896] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.416898] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.416899] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.416900] FS: 0000000000000000(0000) GS:ffff8888dae02000(0000) knlGS:0000000000000000 <4> [233.416902] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.416903] CR2: 00007dc968a72000 CR3: 000000000364a003 CR4: 0000000000f72ef0 <4> [233.416904] PKRU: 55555554 <4> [233.416906] Call Trace: <4> [233.416907] <TASK> <4> [233.416911] ? __pfx_lock_acquire+0x10/0x10 <4> [233.416916] ? lock_release+0xd0/0x2b0 <4> [233.416920] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.416926] process_one_work+0x239/0x740 <4> [233.416933] worker_thread+0x200/0x3f0 <4> [233.416936] ? __pfx_worker_thread+0x10/0x10 <4> [233.416938] kthread+0x10d/0x150 <4> [233.416941] ? __pfx_kthread+0x10/0x10 <4> [233.416943] ret_from_fork+0x3bd/0x470 <4> [233.416946] ? __pfx_kthread+0x10/0x10 <4> [233.416948] ret_from_fork_asm+0x1a/0x30 <4> [233.416955] </TASK> <4> [233.416957] irq event stamp: 819377 <4> [233.416958] hardirqs last enabled at (819383): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.416960] hardirqs last disabled at (819388): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.416962] softirqs last enabled at (818480): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.416964] softirqs last disabled at (818475): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.416967] ---[ end trace 0000000000000000 ]--- <6> [233.417701] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.417874] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.417889] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.418261] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.418375] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.418489] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.418731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.418831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.418934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.419028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.419118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.419208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.419298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.419389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.419473] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.419574] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.419676] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.420719] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.430666] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.430941] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.431954] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.432039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.432121] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.432201] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.432283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.432365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.432449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.432529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.432608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.432711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.432790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.432869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.432948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.433025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.433101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.433176] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.433252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.433330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.433409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.433496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.433582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.433673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.433757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.433843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.433928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.434009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.434091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.434177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.434260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.434346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.434431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.434516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.434599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.434705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.434794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.434881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.434971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.435056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.435139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.435220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.435313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.435419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.435500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.435580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.435671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.435759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.435842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.435926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.436011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.436095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.436182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.436263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.436345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.436427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.436507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.436588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.436675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.436772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.436856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.436940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.437020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.437102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.437183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.437264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.437350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.437435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.437516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.437597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.437691] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.437816] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.437820] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=47966, lrc_seqno=47966, guc_id=0, flags=0x73 in no process [-1] <7> [233.437822] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.437891] ------------[ cut here ]------------ <4> [233.437892] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.437894] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:8/994 <4> [233.437974] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.438040] CPU: 11 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.438043] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.438045] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.438046] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.438052] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.438129] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.438131] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.438134] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.438135] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.438136] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.438137] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.438139] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.438140] FS: 0000000000000000(0000) GS:ffff8888db002000(0000) knlGS:0000000000000000 <4> [233.438142] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.438143] CR2: 00007dc968a77000 CR3: 000000012991f006 CR4: 0000000000f72ef0 <4> [233.438144] PKRU: 55555554 <4> [233.438146] Call Trace: <4> [233.438147] <TASK> <4> [233.438151] ? __pfx_lock_acquire+0x10/0x10 <4> [233.438156] ? lock_release+0xd0/0x2b0 <4> [233.438160] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.438166] process_one_work+0x239/0x740 <4> [233.438173] worker_thread+0x200/0x3f0 <4> [233.438176] ? __pfx_worker_thread+0x10/0x10 <4> [233.438178] kthread+0x10d/0x150 <4> [233.438180] ? __pfx_kthread+0x10/0x10 <4> [233.438183] ret_from_fork+0x3bd/0x470 <4> [233.438186] ? __pfx_kthread+0x10/0x10 <4> [233.438188] ret_from_fork_asm+0x1a/0x30 <4> [233.438196] </TASK> <4> [233.438197] irq event stamp: 822575 <4> [233.438198] hardirqs last enabled at (822581): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.438200] hardirqs last disabled at (822586): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.438202] softirqs last enabled at (821738): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.438205] softirqs last disabled at (821733): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.438208] ---[ end trace 0000000000000000 ]--- <5> [233.439622] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48021, lrc_seqno=48021, guc_id=0, flags=0x73 in no process [-1] <7> [233.439573] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.439629] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [233.439702] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [233.439758] ------------[ cut here ]------------ <4> [233.439760] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.439762] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#12: kworker/u64:8/994 <4> [233.439892] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.439990] CPU: 12 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.439994] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.439995] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.439997] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.440006] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.440128] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.440130] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.440133] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.440136] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.440138] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.440140] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.440141] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.440143] FS: 0000000000000000(0000) GS:ffff8888db082000(0000) knlGS:0000000000000000 <4> [233.440146] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.440148] CR2: 00007dc95c08e2b8 CR3: 000000012991f003 CR4: 0000000000f72ef0 <4> [233.440150] PKRU: 55555554 <4> [233.440152] Call Trace: <4> [233.440153] <TASK> <4> [233.440160] ? __pfx_lock_acquire+0x10/0x10 <4> [233.440168] ? lock_release+0xd0/0x2b0 <4> [233.440176] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.440185] process_one_work+0x239/0x740 <4> [233.440196] worker_thread+0x200/0x3f0 <4> [233.440201] ? __pfx_worker_thread+0x10/0x10 <4> [233.440204] kthread+0x10d/0x150 <4> [233.440207] ? __pfx_kthread+0x10/0x10 <4> [233.440212] ret_from_fork+0x3bd/0x470 <4> [233.440215] ? __pfx_kthread+0x10/0x10 <4> [233.440219] ret_from_fork_asm+0x1a/0x30 <4> [233.440231] </TASK> <4> [233.440233] irq event stamp: 824973 <4> [233.440234] hardirqs last enabled at (824979): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.440238] hardirqs last disabled at (824984): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.440240] softirqs last enabled at (824218): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.440244] softirqs last disabled at (824213): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.440248] ---[ end trace 0000000000000000 ]--- <6> [233.440250] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.440372] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.440382] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.440432] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.440700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.440847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.440994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.441136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.441276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.441416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.441557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.441711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.441850] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.442000] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.442147] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.443557] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.453663] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.453981] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.455159] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.455288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.455414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.455542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.455688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.455783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.455867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.455948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.456029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.456109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.456187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.456266] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.456345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.456423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.456502] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.456580] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.456674] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.456757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.456838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.456927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.457016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.457099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.457181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.457263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.457347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.457428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.457509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.457588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.457676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.457764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.457850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.457934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.458017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.458102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.458190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.458277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.458366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.458481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.458588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.458693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.458776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.458859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.458938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.459019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.459105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.459193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.459279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.459362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.459442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.459525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.459608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.459697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.459783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.459867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.459949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.460032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.460113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.460192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.460272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.460356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.460437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.460518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.460602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.460696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.460780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.460866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.460946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.461026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.461109] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.461235] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.461239] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48021, lrc_seqno=48021, guc_id=0, flags=0x73 in no process [-1] <7> [233.461242] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.461311] ------------[ cut here ]------------ <4> [233.461313] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.461314] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:8/994 <4> [233.461394] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.461459] CPU: 10 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.461462] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.461463] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.461465] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.461470] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.461557] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.461559] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.461561] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.461562] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.461564] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.461565] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.461566] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.461567] FS: 0000000000000000(0000) GS:ffff8888daf82000(0000) knlGS:0000000000000000 <4> [233.461569] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.461570] CR2: 00007dc968a6e000 CR3: 000000000364a002 CR4: 0000000000f72ef0 <4> [233.461572] PKRU: 55555554 <4> [233.461573] Call Trace: <4> [233.461574] <TASK> <4> [233.461578] ? __pfx_lock_acquire+0x10/0x10 <4> [233.461583] ? lock_release+0xd0/0x2b0 <4> [233.461588] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.461594] process_one_work+0x239/0x740 <4> [233.461601] worker_thread+0x200/0x3f0 <4> [233.461604] ? __pfx_worker_thread+0x10/0x10 <4> [233.461607] kthread+0x10d/0x150 <4> [233.461609] ? __pfx_kthread+0x10/0x10 <4> [233.461612] ret_from_fork+0x3bd/0x470 <4> [233.461614] ? __pfx_kthread+0x10/0x10 <4> [233.461617] ret_from_fork_asm+0x1a/0x30 <4> [233.461624] </TASK> <4> [233.461625] irq event stamp: 828151 <4> [233.461626] hardirqs last enabled at (828157): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.461629] hardirqs last disabled at (828162): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.461630] softirqs last enabled at (827028): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.461633] softirqs last disabled at (827021): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.461636] ---[ end trace 0000000000000000 ]--- <6> [233.462563] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.462663] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.462670] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.462726] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.462837] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.462949] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.463161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.463257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.463355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.463448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.463540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.463633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.463738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.463830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.463918] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.464018] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.464114] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.465151] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.475657] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.475913] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.476914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.476998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.477080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.477162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.477245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.477325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.477404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.477487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.477568] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.477658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.477739] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.477819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.477899] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.477978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.478054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.478132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.478211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.478288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.478366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.478451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.478540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.478626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.478724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.478813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.478898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.478980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.479062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.479143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.479224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.479307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.479391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.479474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.479557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.479644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.479751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.479842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.479932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.480016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.480099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.480180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.480262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.480344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.480428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.480512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.480597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.480688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.480770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.480852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.480935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.481018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.481101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.481184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.481265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.481353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.481458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.481553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.481637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.481734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.481816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.481900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.481983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.482069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.482152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.482233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.482315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.482396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.482478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.482559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.482651] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.482777] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.482781] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48021, lrc_seqno=48021, guc_id=0, flags=0x73 in no process [-1] <7> [233.482783] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.482850] ------------[ cut here ]------------ <4> [233.482851] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.482852] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:8/994 <4> [233.482930] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.482995] CPU: 10 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.482998] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.482999] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.483001] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.483006] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.483086] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.483087] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.483090] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.483091] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.483092] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.483093] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.483095] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.483096] FS: 0000000000000000(0000) GS:ffff8888daf82000(0000) knlGS:0000000000000000 <4> [233.483098] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.483099] CR2: 00007dc968a6e000 CR3: 000000000364a002 CR4: 0000000000f72ef0 <4> [233.483100] PKRU: 55555554 <4> [233.483101] Call Trace: <4> [233.483102] <TASK> <4> [233.483106] ? __pfx_lock_acquire+0x10/0x10 <4> [233.483111] ? lock_release+0xd0/0x2b0 <4> [233.483116] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.483122] process_one_work+0x239/0x740 <4> [233.483128] worker_thread+0x200/0x3f0 <4> [233.483131] ? __pfx_worker_thread+0x10/0x10 <4> [233.483134] kthread+0x10d/0x150 <4> [233.483136] ? __pfx_kthread+0x10/0x10 <4> [233.483139] ret_from_fork+0x3bd/0x470 <4> [233.483141] ? __pfx_kthread+0x10/0x10 <4> [233.483144] ret_from_fork_asm+0x1a/0x30 <4> [233.483151] </TASK> <4> [233.483152] irq event stamp: 831359 <4> [233.483154] hardirqs last enabled at (831365): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.483156] hardirqs last disabled at (831370): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.483157] softirqs last enabled at (830282): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.483160] softirqs last disabled at (830275): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.483163] ---[ end trace 0000000000000000 ]--- <5> [233.483601] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48076, lrc_seqno=48076, guc_id=0, flags=0x73 in no process [-1] <7> [233.483609] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.484012] ------------[ cut here ]------------ <4> [233.484014] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.484017] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:8/994 <4> [233.484383] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.484463] CPU: 11 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.484466] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.484467] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.484468] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.484474] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.484568] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.484570] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.484572] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.484574] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.484575] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.484576] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.484577] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.484578] FS: 0000000000000000(0000) GS:ffff8888db002000(0000) knlGS:0000000000000000 <4> [233.484580] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.484581] CR2: 00007dc968a77000 CR3: 000000012991f006 CR4: 0000000000f72ef0 <4> [233.484583] PKRU: 55555554 <4> [233.484584] Call Trace: <4> [233.484585] <TASK> <4> [233.484588] ? __pfx_lock_acquire+0x10/0x10 <4> [233.484593] ? lock_release+0xd0/0x2b0 <4> [233.484598] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.484604] process_one_work+0x239/0x740 <4> [233.484610] worker_thread+0x200/0x3f0 <4> [233.484613] ? __pfx_worker_thread+0x10/0x10 <4> [233.484616] kthread+0x10d/0x150 <4> [233.484620] ? __pfx_kthread+0x10/0x10 <4> [233.484625] ret_from_fork+0x3bd/0x470 <4> [233.484628] ? __pfx_kthread+0x10/0x10 <4> [233.484633] ret_from_fork_asm+0x1a/0x30 <4> [233.484652] </TASK> <4> [233.484654] irq event stamp: 833263 <4> [233.484656] hardirqs last enabled at (833269): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.484659] hardirqs last disabled at (833274): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.484662] softirqs last enabled at (832504): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.484665] softirqs last disabled at (832477): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.484669] ---[ end trace 0000000000000000 ]--- <7> [233.484638] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [233.484671] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.484801] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.484816] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.484827] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.484944] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.485157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.485254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.485356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.485454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.485546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.485636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.485743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.485834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.485923] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.486023] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.486119] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.487155] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.497661] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.497918] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.499299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.499386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.499472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.499556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.499637] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.499734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.499816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.499896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.499976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.500055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.500133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.500215] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.500296] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.500376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.500453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.500530] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.500609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.500699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.500777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.500864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.500956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.501043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.501128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.501211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.501294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.501374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.501455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.501537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.501619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.501712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.501802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.501886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.501970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.502057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.502150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.502239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.502330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.502416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.502500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.502581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.502668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.502751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.502832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.502916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.503003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.503087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.503171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.503252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.503332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.503412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.503495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.503576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.503660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.503740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.503820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.503904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.503987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.504069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.504150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.504233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.504315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.504396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.504477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.504558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.504646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.504730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.504813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.504895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.504980] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.505101] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.505105] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48076, lrc_seqno=48076, guc_id=0, flags=0x73 in no process [-1] <7> [233.505108] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.505176] ------------[ cut here ]------------ <4> [233.505177] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.505178] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:8/994 <4> [233.505256] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.505322] CPU: 11 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.505324] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.505326] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.505327] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.505332] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.505407] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.505409] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.505411] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.505413] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.505414] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.505415] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.505417] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.505418] FS: 0000000000000000(0000) GS:ffff8888db002000(0000) knlGS:0000000000000000 <4> [233.505419] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.505421] CR2: 00007dc968a77000 CR3: 000000012991f006 CR4: 0000000000f72ef0 <4> [233.505422] PKRU: 55555554 <4> [233.505423] Call Trace: <4> [233.505424] <TASK> <4> [233.505428] ? __pfx_lock_acquire+0x10/0x10 <4> [233.505433] ? lock_release+0xd0/0x2b0 <4> [233.505438] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.505444] process_one_work+0x239/0x740 <4> [233.505450] worker_thread+0x200/0x3f0 <4> [233.505454] ? __pfx_worker_thread+0x10/0x10 <4> [233.505456] kthread+0x10d/0x150 <4> [233.505458] ? __pfx_kthread+0x10/0x10 <4> [233.505461] ret_from_fork+0x3bd/0x470 <4> [233.505463] ? __pfx_kthread+0x10/0x10 <4> [233.505718] ret_from_fork_asm+0x1a/0x30 <4> [233.505726] </TASK> <4> [233.505727] irq event stamp: 836427 <4> [233.505729] hardirqs last enabled at (836433): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.505731] hardirqs last disabled at (836438): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.505733] softirqs last enabled at (836412): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.505736] softirqs last disabled at (836407): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.505739] ---[ end trace 0000000000000000 ]--- <6> [233.506651] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.506787] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.506797] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.506996] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.507117] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.507226] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.507440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.507539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.507640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.507746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.507836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.507925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.508015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.508104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.508191] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.508292] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.508388] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.509426] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.519647] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.519905] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.520914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.521007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.521093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.521179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.521263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.521347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.521430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.521509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.521587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.521676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.521765] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.521846] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.521926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.522006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.522084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.522162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.522240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.522316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.522393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.522480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.522569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.522666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.522765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.522851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.522936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.523017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.523103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.523185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.523265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.523349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.523434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.523517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.523601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.523705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.523805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.523893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.523981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.524066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.524150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.524232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.524314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.524394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.524473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.524555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.524644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.524740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.524825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.524909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.524989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.525070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.525154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.525239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.525324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.525406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.525486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.525569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.525658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.525748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.525828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.525915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.525999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.526082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.526163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.526241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.526323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.526403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.526483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.526562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.526652] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.526782] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.526787] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48076, lrc_seqno=48076, guc_id=0, flags=0x73 in no process [-1] <7> [233.526789] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.526857] ------------[ cut here ]------------ <4> [233.526858] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.526859] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:8/994 <4> [233.526938] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.527004] CPU: 10 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.527007] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.527008] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.527010] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.527015] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.527091] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.527093] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.527095] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.527097] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.527098] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.527099] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.527100] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.527102] FS: 0000000000000000(0000) GS:ffff8888daf82000(0000) knlGS:0000000000000000 <4> [233.527103] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.527105] CR2: 00007dc968a6e000 CR3: 000000000364a002 CR4: 0000000000f72ef0 <4> [233.527106] PKRU: 55555554 <4> [233.527107] Call Trace: <4> [233.527108] <TASK> <4> [233.527112] ? __pfx_lock_acquire+0x10/0x10 <4> [233.527117] ? lock_release+0xd0/0x2b0 <4> [233.527122] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.527128] process_one_work+0x239/0x740 <4> [233.527134] worker_thread+0x200/0x3f0 <4> [233.527137] ? __pfx_worker_thread+0x10/0x10 <4> [233.527140] kthread+0x10d/0x150 <4> [233.527142] ? __pfx_kthread+0x10/0x10 <4> [233.527145] ret_from_fork+0x3bd/0x470 <4> [233.527147] ? __pfx_kthread+0x10/0x10 <4> [233.527150] ret_from_fork_asm+0x1a/0x30 <4> [233.527157] </TASK> <4> [233.527158] irq event stamp: 839587 <4> [233.527159] hardirqs last enabled at (839593): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.527161] hardirqs last disabled at (839598): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.527163] softirqs last enabled at (838502): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.527166] softirqs last disabled at (838493): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.527168] ---[ end trace 0000000000000000 ]--- <5> [233.527656] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48131, lrc_seqno=48131, guc_id=0, flags=0x73 in no process [-1] <7> [233.527664] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.528035] ------------[ cut here ]------------ <4> [233.528038] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.528040] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:8/994 <4> [233.528383] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.528458] CPU: 11 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.528461] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.528462] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.528470] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.528477] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <7> [233.528495] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [233.528602] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.528604] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.528607] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.528609] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.528610] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.528612] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.528613] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.528615] FS: 0000000000000000(0000) GS:ffff8888db002000(0000) knlGS:0000000000000000 <4> [233.528617] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.528619] CR2: 00007dc968a77000 CR3: 000000012991f006 CR4: 0000000000f72ef0 <4> [233.528621] PKRU: 55555554 <4> [233.528622] Call Trace: <4> [233.528624] <TASK> <4> [233.528630] ? __pfx_lock_acquire+0x10/0x10 <4> [233.528647] ? lock_release+0xd0/0x2b0 <4> [233.528655] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.528665] process_one_work+0x239/0x740 <4> [233.528676] worker_thread+0x200/0x3f0 <4> [233.528681] ? __pfx_worker_thread+0x10/0x10 <4> [233.528685] kthread+0x10d/0x150 <4> [233.528688] ? __pfx_kthread+0x10/0x10 <4> [233.528693] ret_from_fork+0x3bd/0x470 <4> [233.528696] ? __pfx_kthread+0x10/0x10 <4> [233.528700] ret_from_fork_asm+0x1a/0x30 <4> [233.528711] </TASK> <4> [233.528713] irq event stamp: 841517 <4> [233.528715] hardirqs last enabled at (841523): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.528718] hardirqs last disabled at (841528): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.528721] softirqs last enabled at (841450): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.528725] softirqs last disabled at (841443): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.528729] ---[ end trace 0000000000000000 ]--- <7> [233.528673] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [233.528732] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.528849] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.528855] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.529050] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.529263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.529359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.529455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.529547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.529644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.529738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.529826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.529917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.530002] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.530101] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.530198] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.531235] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.541645] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.541903] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.542915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.542999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.543079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.543162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.543246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.543327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.543406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.543489] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.543567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.543647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.543724] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.543804] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.543883] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.543961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.544038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.544115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.544193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.544269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.544347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.544434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.544520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.544605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.544696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.544778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.544862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.544947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.545031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.545112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.545193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.545275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.545359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.545441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.545523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.545605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.545701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.545789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.545878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.545967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.546054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.546137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.546224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.546306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.546387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.546469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.546553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.546633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.546727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.546807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.546890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.546976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.547061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.547142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.547225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.547306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.547385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.547467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.547549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.547628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.547719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.547808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.547892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.547974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.548056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.548136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.548217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.548298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.548378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.548455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.548537] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.548660] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.548664] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48131, lrc_seqno=48131, guc_id=0, flags=0x73 in no process [-1] <7> [233.548667] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.548736] ------------[ cut here ]------------ <4> [233.548737] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.548738] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:8/994 <4> [233.548817] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.548882] CPU: 11 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.548885] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.548886] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.548887] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.548893] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.548971] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.548972] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.548974] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.548976] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.548977] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.548978] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.548979] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.548981] FS: 0000000000000000(0000) GS:ffff8888db002000(0000) knlGS:0000000000000000 <4> [233.548982] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.548983] CR2: 00007dc968a77000 CR3: 000000012991f006 CR4: 0000000000f72ef0 <4> [233.548985] PKRU: 55555554 <4> [233.548986] Call Trace: <4> [233.548987] <TASK> <4> [233.548991] ? __pfx_lock_acquire+0x10/0x10 <4> [233.548996] ? lock_release+0xd0/0x2b0 <4> [233.549001] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.549006] process_one_work+0x239/0x740 <4> [233.549013] worker_thread+0x200/0x3f0 <4> [233.549016] ? __pfx_worker_thread+0x10/0x10 <4> [233.549018] kthread+0x10d/0x150 <4> [233.549020] ? __pfx_kthread+0x10/0x10 <4> [233.549023] ret_from_fork+0x3bd/0x470 <4> [233.549025] ? __pfx_kthread+0x10/0x10 <4> [233.549028] ret_from_fork_asm+0x1a/0x30 <4> [233.549035] </TASK> <4> [233.549036] irq event stamp: 844659 <4> [233.549038] hardirqs last enabled at (844665): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.549040] hardirqs last disabled at (844670): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.549041] softirqs last enabled at (843678): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.549044] softirqs last disabled at (843671): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.549047] ---[ end trace 0000000000000000 ]--- <6> [233.549049] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.549122] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.549128] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.550368] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.550479] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.550591] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.550815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.550912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.551012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.551105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.551198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.551287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.551377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.551467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.551554] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.551661] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.551756] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.552789] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.562642] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.562897] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.563893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.563977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.564058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.564141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.564224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.564308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.564390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.564470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.564549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.564627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.564720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.564797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.564876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.564954] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.565032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.565110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.565190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.565268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.565346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.565435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.565525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.565608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.565699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.565784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.565871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.565955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.566039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.566120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.566200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.566283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.566367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.566450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.566533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.566617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.566721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.566810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.566901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.566992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.567077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.567159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.567242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.567324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.567405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.567488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.567572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.567660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.567745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.567829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.567909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.567991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.568075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.568160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.568246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.568329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.568409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.568493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.568576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.568666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.568749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.568835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.568917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.569000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.569080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.569162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.569244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.569326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.569406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.569487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.569569] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.569692] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.569696] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48131, lrc_seqno=48131, guc_id=0, flags=0x73 in no process [-1] <7> [233.569699] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.569767] ------------[ cut here ]------------ <4> [233.569768] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.569769] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:37/3091 <4> [233.569848] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.569914] CPU: 8 UID: 0 PID: 3091 Comm: kworker/u64:37 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.569918] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.569919] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.569920] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.569925] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.570003] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.570005] RSP: 0018:ffffc90007bb3ca0 EFLAGS: 00010246 <4> [233.570007] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.570008] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.570010] RBP: ffffc90007bb3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.570011] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.570012] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.570013] FS: 0000000000000000(0000) GS:ffff8888dae82000(0000) knlGS:0000000000000000 <4> [233.570015] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.570016] CR2: 00007dc968a7a000 CR3: 000000012991f001 CR4: 0000000000f72ef0 <4> [233.570018] PKRU: 55555554 <4> [233.570019] Call Trace: <4> [233.570020] <TASK> <4> [233.570024] ? __pfx_lock_acquire+0x10/0x10 <4> [233.570029] ? lock_release+0xd0/0x2b0 <4> [233.570034] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.570039] process_one_work+0x239/0x740 <4> [233.570046] worker_thread+0x200/0x3f0 <4> [233.570049] ? __pfx_worker_thread+0x10/0x10 <4> [233.570052] kthread+0x10d/0x150 <4> [233.570054] ? __pfx_kthread+0x10/0x10 <4> [233.570057] ret_from_fork+0x3bd/0x470 <4> [233.570059] ? __pfx_kthread+0x10/0x10 <4> [233.570062] ret_from_fork_asm+0x1a/0x30 <4> [233.570069] </TASK> <4> [233.570070] irq event stamp: 1870445 <4> [233.570071] hardirqs last enabled at (1870451): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.570074] hardirqs last disabled at (1870456): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.570075] softirqs last enabled at (1869536): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.570078] softirqs last disabled at (1869529): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.570081] ---[ end trace 0000000000000000 ]--- <5> [233.570444] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48186, lrc_seqno=48186, guc_id=0, flags=0x73 in no process [-1] <7> [233.570450] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.570712] ------------[ cut here ]------------ <4> [233.570715] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.570717] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:8/994 <4> [233.570849] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.570926] CPU: 6 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.570931] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.570932] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.570934] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.570943] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.571031] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.571033] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.571035] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.571038] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.571039] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.571041] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.571042] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.571043] FS: 0000000000000000(0000) GS:ffff8888dad82000(0000) knlGS:0000000000000000 <4> [233.571045] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.571046] CR2: 00007fff30088fe0 CR3: 000000000364a005 CR4: 0000000000f72ef0 <4> [233.571048] PKRU: 55555554 <4> [233.571049] Call Trace: <4> [233.571052] <TASK> <4> [233.571057] ? __pfx_lock_acquire+0x10/0x10 <4> [233.571063] ? lock_release+0xd0/0x2b0 <4> [233.571068] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.571075] process_one_work+0x239/0x740 <4> [233.571083] worker_thread+0x200/0x3f0 <4> [233.571086] ? __pfx_worker_thread+0x10/0x10 <4> [233.571089] kthread+0x10d/0x150 <4> [233.571091] ? __pfx_kthread+0x10/0x10 <4> [233.571094] ret_from_fork+0x3bd/0x470 <4> [233.571096] ? __pfx_kthread+0x10/0x10 <4> [233.571099] ret_from_fork_asm+0x1a/0x30 <4> [233.571108] </TASK> <4> [233.571109] irq event stamp: 846411 <4> [233.571110] hardirqs last enabled at (846417): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.571113] hardirqs last disabled at (846422): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.571114] softirqs last enabled at (845652): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.571118] softirqs last disabled at (845647): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.571121] ---[ end trace 0000000000000000 ]--- <6> [233.571124] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.571216] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.571506] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.571662] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.571775] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.571887] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.572105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.572203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.572301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.572395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.572487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.572582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.572689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.572782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.572871] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.572970] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.573069] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.574109] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.584638] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.584897] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.585897] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.585984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.586067] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.586152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.586235] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.586314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.586394] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.586474] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.586553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.586639] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.586723] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.586803] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.586885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.586966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.587044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.587127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.587205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.587287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.587369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.587455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.587542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.587634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.587720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.587804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.587887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.587971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.588056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.588139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.588222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.588305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.588388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.588471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.588554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.588642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.588731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.588819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.588909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.589000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.589090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.589174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.589257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.589343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.589426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.589511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.589595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.589688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.589773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.589854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.589935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.590018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.590103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.590185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.590268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.590348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.590429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.590511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.590593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.590686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.590771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.590857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.590941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.591025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.591110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.591191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.591274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.591361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.591447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.591529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.591615] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.591760] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.591764] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48186, lrc_seqno=48186, guc_id=0, flags=0x73 in no process [-1] <7> [233.591767] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.591837] ------------[ cut here ]------------ <4> [233.591838] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.591839] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:38/3092 <4> [233.591919] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.591986] CPU: 7 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.591989] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.591990] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.591992] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.591997] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.592074] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.592075] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [233.592078] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.592079] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.592080] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.592082] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.592083] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.592084] FS: 0000000000000000(0000) GS:ffff8888dae02000(0000) knlGS:0000000000000000 <4> [233.592086] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.592087] CR2: 00007dc968a72000 CR3: 000000012991f002 CR4: 0000000000f72ef0 <4> [233.592089] PKRU: 55555554 <4> [233.592090] Call Trace: <4> [233.592091] <TASK> <4> [233.592095] ? __pfx_lock_acquire+0x10/0x10 <4> [233.592100] ? lock_release+0xd0/0x2b0 <4> [233.592105] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.592111] process_one_work+0x239/0x740 <4> [233.592118] worker_thread+0x200/0x3f0 <4> [233.592121] ? __pfx_worker_thread+0x10/0x10 <4> [233.592123] kthread+0x10d/0x150 <4> [233.592126] ? __pfx_kthread+0x10/0x10 <4> [233.592129] ret_from_fork+0x3bd/0x470 <4> [233.592131] ? __pfx_kthread+0x10/0x10 <4> [233.592133] ret_from_fork_asm+0x1a/0x30 <4> [233.592141] </TASK> <4> [233.592142] irq event stamp: 555781 <4> [233.592143] hardirqs last enabled at (555787): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.592145] hardirqs last disabled at (555792): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.592147] softirqs last enabled at (554952): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.592150] softirqs last disabled at (554939): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.592153] ---[ end trace 0000000000000000 ]--- <6> [233.592155] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.592233] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.592239] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.593472] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.593586] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.593708] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.593920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.594016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.594113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.594210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.594301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.594391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.594480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.594571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.594662] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.594762] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.594858] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.595890] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.605664] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.605920] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.606879] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.606966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.607046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.607129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.607210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.607290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.607369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.607448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.607525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.607604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.607694] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.607773] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.607849] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.607927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.608005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.608085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.608165] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.608246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.608324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.608410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.608499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.608583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.608674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.608758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.608840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.608922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.609002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.609084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.609167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.609252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.609336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.609418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.609500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.609583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.609681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.609767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.609858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.609947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.610031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.610115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.610197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.610281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.610363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.610446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.610529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.610612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.610707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.610787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.610867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.610949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.611033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.611114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.611197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.611283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.611364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.611447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.611528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.611609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.611706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.611791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.611873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.611955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.612035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.612116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.612197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.612278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.612359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.612437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.612520] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.612645] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.612649] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48186, lrc_seqno=48186, guc_id=0, flags=0x73 in no process [-1] <7> [233.612651] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.612720] ------------[ cut here ]------------ <4> [233.612721] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.612722] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:37/3091 <4> [233.612800] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.612865] CPU: 8 UID: 0 PID: 3091 Comm: kworker/u64:37 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.612868] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.612869] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.612870] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.612876] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.612952] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.612953] RSP: 0018:ffffc90007bb3ca0 EFLAGS: 00010246 <4> [233.612955] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.612957] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.612958] RBP: ffffc90007bb3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.612959] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.612960] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.612962] FS: 0000000000000000(0000) GS:ffff8888dae82000(0000) knlGS:0000000000000000 <4> [233.612963] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.612965] CR2: 00007dc968a7a000 CR3: 000000012991f001 CR4: 0000000000f72ef0 <4> [233.612966] PKRU: 55555554 <4> [233.612967] Call Trace: <4> [233.612968] <TASK> <4> [233.612972] ? __pfx_lock_acquire+0x10/0x10 <4> [233.612977] ? lock_release+0xd0/0x2b0 <4> [233.612982] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.612988] process_one_work+0x239/0x740 <4> [233.612994] worker_thread+0x200/0x3f0 <4> [233.612997] ? __pfx_worker_thread+0x10/0x10 <4> [233.613000] kthread+0x10d/0x150 <4> [233.613002] ? __pfx_kthread+0x10/0x10 <4> [233.613005] ret_from_fork+0x3bd/0x470 <4> [233.613007] ? __pfx_kthread+0x10/0x10 <4> [233.613010] ret_from_fork_asm+0x1a/0x30 <4> [233.613017] </TASK> <4> [233.613018] irq event stamp: 1876113 <4> [233.613020] hardirqs last enabled at (1876119): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.613022] hardirqs last disabled at (1876124): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.613024] softirqs last enabled at (1875318): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.613026] softirqs last disabled at (1875313): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.613029] ---[ end trace 0000000000000000 ]--- <5> [233.613888] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48241, lrc_seqno=48241, guc_id=0, flags=0x73 in no process [-1] <7> [233.613895] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.614015] ------------[ cut here ]------------ <4> [233.614016] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.614019] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:37/3091 <4> [233.614105] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.614184] CPU: 2 UID: 0 PID: 3091 Comm: kworker/u64:37 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.614189] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.614190] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.614192] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.614199] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.614279] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.614280] RSP: 0018:ffffc90007bb3ca0 EFLAGS: 00010246 <4> [233.614283] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.614284] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.614285] RBP: ffffc90007bb3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.614286] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.614288] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.614289] FS: 0000000000000000(0000) GS:ffff8888dab82000(0000) knlGS:0000000000000000 <4> [233.614291] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.614292] CR2: 00007dc968a6d000 CR3: 0000000108194004 CR4: 0000000000f72ef0 <4> [233.614293] PKRU: 55555554 <4> [233.614295] Call Trace: <4> [233.614296] <TASK> <4> [233.614299] ? __pfx_lock_acquire+0x10/0x10 <4> [233.614304] ? lock_release+0xd0/0x2b0 <4> [233.614309] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.614315] process_one_work+0x239/0x740 <4> [233.614321] worker_thread+0x200/0x3f0 <4> [233.614325] ? __pfx_worker_thread+0x10/0x10 <4> [233.614327] kthread+0x10d/0x150 <4> [233.614329] ? __pfx_kthread+0x10/0x10 <4> [233.614332] ret_from_fork+0x3bd/0x470 <4> [233.614334] ? __pfx_kthread+0x10/0x10 <4> [233.614337] ret_from_fork_asm+0x1a/0x30 <4> [233.614344] </TASK> <4> [233.614346] irq event stamp: 1877995 <4> [233.614347] hardirqs last enabled at (1878001): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.614349] hardirqs last disabled at (1878006): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.614351] softirqs last enabled at (1875318): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.614354] softirqs last disabled at (1875313): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.614356] ---[ end trace 0000000000000000 ]--- <7> [233.614329] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [233.614358] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.614434] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.614440] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.614440] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.614614] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.614850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.614946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.615045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.615140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.615236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.615327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.615418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.615510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.615596] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.615713] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.615811] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.616848] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.626629] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.626887] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.627904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.627988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.628070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.628154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.628237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.628319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.628400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.628480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.628561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.628664] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.628747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.628827] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.628905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.628984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.629063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.629142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.629221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.629301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.629381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.629471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.629560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.629657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.629744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.629828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.629911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.629994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.630079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.630164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.630244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.630330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.630412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.630494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.630578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.630675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.630767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.630858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.630947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.631033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.631118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.631202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.631290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.631376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.631459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.631545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.631637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.631721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.631803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.631884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.631965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.632052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.632138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.632221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.632304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.632387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.632469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.632554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.632650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.632735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.632818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.632905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.632987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.633070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.633152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.633231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.633314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.633397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.633481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.633563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.633653] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.633776] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.633780] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48241, lrc_seqno=48241, guc_id=0, flags=0x73 in no process [-1] <7> [233.633782] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.633851] ------------[ cut here ]------------ <4> [233.633852] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.633853] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:37/3091 <4> [233.633933] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.633998] CPU: 2 UID: 0 PID: 3091 Comm: kworker/u64:37 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.634001] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.634002] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.634003] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.634009] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.634085] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.634087] RSP: 0018:ffffc90007bb3ca0 EFLAGS: 00010246 <4> [233.634089] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.634090] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.634092] RBP: ffffc90007bb3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.634093] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.634094] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.634095] FS: 0000000000000000(0000) GS:ffff8888dab82000(0000) knlGS:0000000000000000 <4> [233.634097] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.634098] CR2: 00007dc968a6d000 CR3: 0000000108194004 CR4: 0000000000f72ef0 <4> [233.634100] PKRU: 55555554 <4> [233.634101] Call Trace: <4> [233.634102] <TASK> <4> [233.634106] ? __pfx_lock_acquire+0x10/0x10 <4> [233.634111] ? lock_release+0xd0/0x2b0 <4> [233.634115] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.634121] process_one_work+0x239/0x740 <4> [233.634128] worker_thread+0x200/0x3f0 <4> [233.634131] ? __pfx_worker_thread+0x10/0x10 <4> [233.634133] kthread+0x10d/0x150 <4> [233.634136] ? __pfx_kthread+0x10/0x10 <4> [233.634139] ret_from_fork+0x3bd/0x470 <4> [233.634141] ? __pfx_kthread+0x10/0x10 <4> [233.634143] ret_from_fork_asm+0x1a/0x30 <4> [233.634151] </TASK> <4> [233.634152] irq event stamp: 1881255 <4> [233.634153] hardirqs last enabled at (1881261): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.634155] hardirqs last disabled at (1881266): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.634157] softirqs last enabled at (1880340): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.634159] softirqs last disabled at (1880333): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.634162] ---[ end trace 0000000000000000 ]--- <6> [233.634164] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.634240] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.634245] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.635487] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.635598] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.635720] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.635937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.636038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.636142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.636239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.636333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.636426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.636517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.636609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.636711] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.636813] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.636912] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.637946] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.648625] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.648881] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.649855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.649940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.650023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.650106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.650187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.650270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.650354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.650435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.650514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.650594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.650690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.650770] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.650849] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.650931] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.651011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.651090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.651168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.651248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.651326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.651414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.651501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.651588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.651685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.651772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.651857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.651942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.652028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.652113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.652195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.652279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.652363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.652447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.652534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.652623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.652719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.652811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.652901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.652991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.653080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.653165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.653248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.653331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.653412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.653496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.653581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.653673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.653757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.653843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.653928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.654012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.654098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.654179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.654262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.654344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.654429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.654515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.654602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.654699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.654782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.654867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.654951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.655037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.655119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.655201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.655283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.655366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.655447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.655528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.655613] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.655750] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.655755] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48241, lrc_seqno=48241, guc_id=0, flags=0x73 in no process [-1] <7> [233.655758] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.655825] ------------[ cut here ]------------ <4> [233.655827] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.655828] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:8/994 <4> [233.655908] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.655975] CPU: 6 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.655978] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.655980] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.655981] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.655986] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.656063] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.656065] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.656067] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.656068] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.656069] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.656071] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.656072] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.656073] FS: 0000000000000000(0000) GS:ffff8888dad82000(0000) knlGS:0000000000000000 <4> [233.656075] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.656076] CR2: 00007fff30088fe0 CR3: 000000000364a005 CR4: 0000000000f72ef0 <4> [233.656078] PKRU: 55555554 <4> [233.656079] Call Trace: <4> [233.656080] <TASK> <4> [233.656084] ? __pfx_lock_acquire+0x10/0x10 <4> [233.656089] ? lock_release+0xd0/0x2b0 <4> [233.656094] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.656100] process_one_work+0x239/0x740 <4> [233.656107] worker_thread+0x200/0x3f0 <4> [233.656110] ? __pfx_worker_thread+0x10/0x10 <4> [233.656112] kthread+0x10d/0x150 <4> [233.656115] ? __pfx_kthread+0x10/0x10 <4> [233.656117] ret_from_fork+0x3bd/0x470 <4> [233.656120] ? __pfx_kthread+0x10/0x10 <4> [233.656123] ret_from_fork_asm+0x1a/0x30 <4> [233.656130] </TASK> <4> [233.656131] irq event stamp: 850811 <4> [233.656132] hardirqs last enabled at (850817): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.656135] hardirqs last disabled at (850822): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.656136] softirqs last enabled at (849902): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.656139] softirqs last disabled at (849895): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.656142] ---[ end trace 0000000000000000 ]--- <5> [233.656504] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48296, lrc_seqno=48296, guc_id=0, flags=0x73 in no process [-1] <7> [233.656572] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.656983] ------------[ cut here ]------------ <4> [233.656986] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.656989] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:8/994 <4> [233.657353] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.657429] CPU: 7 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.657431] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.657433] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.657434] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.657440] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <7> [233.657470] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [233.657559] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.657562] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.657565] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.657567] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.657568] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.657570] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.657572] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.657573] FS: 0000000000000000(0000) GS:ffff8888dae02000(0000) knlGS:0000000000000000 <4> [233.657575] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.657577] CR2: 00007dc968a72000 CR3: 000000000364a003 CR4: 0000000000f72ef0 <4> [233.657579] PKRU: 55555554 <4> [233.657580] Call Trace: <4> [233.657582] <TASK> <4> [233.657587] ? __pfx_lock_acquire+0x10/0x10 <4> [233.657594] ? lock_release+0xd0/0x2b0 <4> [233.657602] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.657613] process_one_work+0x239/0x740 <4> [233.657630] worker_thread+0x200/0x3f0 <4> [233.657641] ? __pfx_worker_thread+0x10/0x10 <4> [233.657646] kthread+0x10d/0x150 <4> [233.657649] ? __pfx_kthread+0x10/0x10 <4> [233.657654] ret_from_fork+0x3bd/0x470 <4> [233.657657] ? __pfx_kthread+0x10/0x10 <4> [233.657662] ret_from_fork_asm+0x1a/0x30 <4> [233.657673] </TASK> <4> [233.657675] irq event stamp: 852721 <4> [233.657677] hardirqs last enabled at (852727): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.657680] hardirqs last disabled at (852732): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.657682] softirqs last enabled at (852668): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.657687] softirqs last disabled at (852663): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.657691] ---[ end trace 0000000000000000 ]--- <7> [233.657644] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [233.657693] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.657817] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.657823] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.658049] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.658263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.658361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.658460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.658552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.658655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.658748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.658840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.658935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.659024] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.659128] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.659228] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.660269] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.670969] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.671226] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.672231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.672313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.672389] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.672464] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.672539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.672617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.672696] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.672777] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.672860] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.672939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.673020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.673097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.673176] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.673255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.673333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.673413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.673492] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.673571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.673663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.673751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.673842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.673928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.674012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.674096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.674179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.674260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.674341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.674422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.674503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.674593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.674695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.674781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.674866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.674953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.675044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.675134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.675227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.675314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.675400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.675486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.675567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.675656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.675737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.675819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.675904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.675989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.676075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.676161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.676244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.676332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.676421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.676505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.676588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.676677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.676760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.676844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.676928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.677010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.677093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.677178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.677265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.677352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.677440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.677524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.677608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.677702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.677784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.677866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.677951] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.678073] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.678077] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48296, lrc_seqno=48296, guc_id=0, flags=0x73 in no process [-1] <7> [233.678079] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.678147] ------------[ cut here ]------------ <4> [233.678148] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.678149] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:8/994 <4> [233.678229] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.678295] CPU: 7 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.678298] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.678299] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.678300] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.678306] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.678384] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.678386] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.678388] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.678389] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.678391] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.678392] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.678393] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.678394] FS: 0000000000000000(0000) GS:ffff8888dae02000(0000) knlGS:0000000000000000 <4> [233.678396] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.678397] CR2: 00007dc968a72000 CR3: 000000000364a003 CR4: 0000000000f72ef0 <4> [233.678399] PKRU: 55555554 <4> [233.678400] Call Trace: <4> [233.678401] <TASK> <4> [233.678405] ? __pfx_lock_acquire+0x10/0x10 <4> [233.678410] ? lock_release+0xd0/0x2b0 <4> [233.678414] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.678420] process_one_work+0x239/0x740 <4> [233.678426] worker_thread+0x200/0x3f0 <4> [233.678429] ? __pfx_worker_thread+0x10/0x10 <4> [233.678432] kthread+0x10d/0x150 <4> [233.678434] ? __pfx_kthread+0x10/0x10 <4> [233.678437] ret_from_fork+0x3bd/0x470 <4> [233.678439] ? __pfx_kthread+0x10/0x10 <4> [233.678442] ret_from_fork_asm+0x1a/0x30 <4> [233.678449] </TASK> <4> [233.678450] irq event stamp: 855885 <4> [233.678451] hardirqs last enabled at (855891): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.678456] hardirqs last disabled at (855898): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.678458] softirqs last enabled at (854870): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.678460] softirqs last disabled at (854863): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.678463] ---[ end trace 0000000000000000 ]--- <6> [233.678637] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.679068] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.679082] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.679482] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.679602] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.679735] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.680000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.680145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.680293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.680435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.680576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.680729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.680832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.680930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.681028] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.681136] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.681236] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.682274] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.692963] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.693215] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.694220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.694304] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.694387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.694470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.694550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.694637] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.694718] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.694804] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.694885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.694965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.695044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.695124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.695203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.695282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.695360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.695437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.695515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.695593] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.695683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.695771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.695862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.695949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.696033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.696117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.696200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.696281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.696366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.696452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.696535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.696631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.696719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.696803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.696887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.696972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.697065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.697157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.697247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.697332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.697421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.697510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.697594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.697688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.697770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.697852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.697936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.698020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.698102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.698184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.698265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.698351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.698439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.698524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.698610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.698692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.698773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.698858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.698945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.699028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.699110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.699193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.699275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.699356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.699443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.699528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.699615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.699700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.699787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.699869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.699955] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.700077] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.700081] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48296, lrc_seqno=48296, guc_id=0, flags=0x73 in no process [-1] <7> [233.700083] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.700153] ------------[ cut here ]------------ <4> [233.700154] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.700155] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:8/994 <4> [233.700238] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.700303] CPU: 6 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.700306] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.700307] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.700309] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.700314] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.700393] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.700395] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.700397] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.700398] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.700399] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.700401] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.700402] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.700403] FS: 0000000000000000(0000) GS:ffff8888dad82000(0000) knlGS:0000000000000000 <4> [233.700405] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.700406] CR2: 00007fff30088fe0 CR3: 000000000364a005 CR4: 0000000000f72ef0 <4> [233.700407] PKRU: 55555554 <4> [233.700409] Call Trace: <4> [233.700410] <TASK> <4> [233.700413] ? __pfx_lock_acquire+0x10/0x10 <4> [233.700418] ? lock_release+0xd0/0x2b0 <4> [233.700423] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.700429] process_one_work+0x239/0x740 <4> [233.700435] worker_thread+0x200/0x3f0 <4> [233.700439] ? __pfx_worker_thread+0x10/0x10 <4> [233.700441] kthread+0x10d/0x150 <4> [233.700443] ? __pfx_kthread+0x10/0x10 <4> [233.700446] ret_from_fork+0x3bd/0x470 <4> [233.700448] ? __pfx_kthread+0x10/0x10 <4> [233.700451] ret_from_fork_asm+0x1a/0x30 <4> [233.700459] </TASK> <4> [233.700460] irq event stamp: 859043 <4> [233.700461] hardirqs last enabled at (859049): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.700463] hardirqs last disabled at (859054): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.700465] softirqs last enabled at (857750): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.700468] softirqs last disabled at (857741): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.700470] ---[ end trace 0000000000000000 ]--- <5> [233.701600] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48351, lrc_seqno=48351, guc_id=0, flags=0x73 in no process [-1] <7> [233.701615] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.701703] ------------[ cut here ]------------ <4> [233.701704] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.701706] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:8/994 <4> [233.701818] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper <7> [233.701751] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [233.701832] drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.701936] CPU: 7 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.701939] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.701941] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.701943] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [233.701913] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [233.701951] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.702077] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.702079] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.702081] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.702083] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.702084] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.702085] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.702086] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.702087] FS: 0000000000000000(0000) GS:ffff8888dae02000(0000) knlGS:0000000000000000 <4> [233.702089] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.702090] CR2: 00007dc968a72000 CR3: 000000000364a003 CR4: 0000000000f72ef0 <4> [233.702091] PKRU: 55555554 <4> [233.702092] Call Trace: <4> [233.702093] <TASK> <4> [233.702097] ? __pfx_lock_acquire+0x10/0x10 <4> [233.702102] ? lock_release+0xd0/0x2b0 <4> [233.702107] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.702113] process_one_work+0x239/0x740 <4> [233.702120] worker_thread+0x200/0x3f0 <4> [233.702123] ? __pfx_worker_thread+0x10/0x10 <4> [233.702125] kthread+0x10d/0x150 <4> [233.702127] ? __pfx_kthread+0x10/0x10 <4> [233.702130] ret_from_fork+0x3bd/0x470 <4> [233.702133] ? __pfx_kthread+0x10/0x10 <4> [233.702135] ret_from_fork_asm+0x1a/0x30 <4> [233.702142] </TASK> <4> [233.702144] irq event stamp: 860575 <4> [233.702145] hardirqs last enabled at (860581): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.702147] hardirqs last disabled at (860586): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.702148] softirqs last enabled at (859816): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.702151] softirqs last disabled at (859811): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.702154] ---[ end trace 0000000000000000 ]--- <6> [233.702155] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.702238] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.702243] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.702316] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.702529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.702633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.702734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.702829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.702926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.703018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.703110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.703204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.703294] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.703397] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.703497] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.704533] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.715265] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.715523] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.716542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.716625] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.716708] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.716782] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.716856] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.716929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.717004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.717081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.717154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.717228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.717300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.717372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.717446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.717519] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.717592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.717683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.717761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.717840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.717917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.718004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.718090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.718175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.718262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.718347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.718430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.718513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.718594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.718691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.718775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.718863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.718949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.719032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.719114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.719197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.719286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.719376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.719465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.719548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.719641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.719723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.719807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.719890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.719971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.720054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.720140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.720222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.720305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.720386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.720467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.720550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.720645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.720727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.720809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.720891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.720972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.721053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.721137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.721222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.721304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.721389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.721471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.721555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.721642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.721722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.721805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.721888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.721971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.722055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.722143] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.722265] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.722269] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48351, lrc_seqno=48351, guc_id=0, flags=0x73 in no process [-1] <7> [233.722271] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.722339] ------------[ cut here ]------------ <4> [233.722340] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.722342] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:8/994 <4> [233.722420] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.722487] CPU: 7 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.722490] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.722491] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.722493] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.722498] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.722576] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.722578] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.722580] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.722581] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.722582] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.722583] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.722585] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.722586] FS: 0000000000000000(0000) GS:ffff8888dae02000(0000) knlGS:0000000000000000 <4> [233.722588] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.722589] CR2: 00007dc968a72000 CR3: 000000000364a003 CR4: 0000000000f72ef0 <4> [233.722590] PKRU: 55555554 <4> [233.722592] Call Trace: <4> [233.722593] <TASK> <4> [233.722597] ? __pfx_lock_acquire+0x10/0x10 <4> [233.722605] ? lock_release+0xd0/0x2b0 <4> [233.722610] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.722616] process_one_work+0x239/0x740 <4> [233.722622] worker_thread+0x200/0x3f0 <4> [233.722626] ? __pfx_worker_thread+0x10/0x10 <4> [233.722628] kthread+0x10d/0x150 <4> [233.722631] ? __pfx_kthread+0x10/0x10 <4> [233.722634] ret_from_fork+0x3bd/0x470 <4> [233.722636] ? __pfx_kthread+0x10/0x10 <4> [233.722639] ret_from_fork_asm+0x1a/0x30 <4> [233.722646] </TASK> <4> [233.722648] irq event stamp: 863729 <4> [233.722649] hardirqs last enabled at (863735): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.722651] hardirqs last disabled at (863740): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.722653] softirqs last enabled at (862598): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.722656] softirqs last disabled at (862593): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.722659] ---[ end trace 0000000000000000 ]--- <6> [233.723585] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.723694] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.723699] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.723753] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.723865] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.723977] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.724190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.724285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.724383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.724478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.724570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.724670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.724763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.724855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.724943] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.725045] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.725142] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.726175] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.736606] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.736863] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.737866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.737953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.738036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.738118] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.738199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.738279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.738360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.738442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.738525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.738612] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.738693] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.738771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.738849] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.738930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.739011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.739094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.739175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.739249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.739323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.739404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.739484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.739564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.739648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.739725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.739803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.739879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.739956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.740031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.740106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.740183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.740261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.740339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.740420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.740501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.740585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.740677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.740759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.740843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.740923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.741001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.741078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.741153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.741229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.741308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.741387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.741464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.741540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.741620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.741696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.741783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.741863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.741939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.742015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.742089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.742163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.742238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.742313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.742388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.742461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.742538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.742615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.742693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.742768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.742845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.742924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.743001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.743075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.743151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.743227] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.743339] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.743343] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48351, lrc_seqno=48351, guc_id=0, flags=0x73 in no process [-1] <7> [233.743345] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.743415] ------------[ cut here ]------------ <4> [233.743416] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.743417] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:8/994 <4> [233.743496] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.743555] CPU: 7 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.743557] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.743558] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.743560] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.743565] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.743643] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.743645] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.743647] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.743648] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.743650] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.743651] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.743652] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.743654] FS: 0000000000000000(0000) GS:ffff8888dae02000(0000) knlGS:0000000000000000 <4> [233.743655] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.743656] CR2: 00007dc968a72000 CR3: 000000000364a003 CR4: 0000000000f72ef0 <4> [233.743658] PKRU: 55555554 <4> [233.743659] Call Trace: <4> [233.743660] <TASK> <4> [233.743663] ? __pfx_lock_acquire+0x10/0x10 <4> [233.743668] ? lock_release+0xd0/0x2b0 <4> [233.743672] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.743677] process_one_work+0x239/0x740 <4> [233.743683] worker_thread+0x200/0x3f0 <4> [233.743686] ? __pfx_worker_thread+0x10/0x10 <4> [233.743689] kthread+0x10d/0x150 <4> [233.743691] ? __pfx_kthread+0x10/0x10 <4> [233.743693] ret_from_fork+0x3bd/0x470 <4> [233.743695] ? __pfx_kthread+0x10/0x10 <4> [233.743698] ret_from_fork_asm+0x1a/0x30 <4> [233.743705] </TASK> <4> [233.743706] irq event stamp: 866901 <4> [233.743707] hardirqs last enabled at (866907): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.743709] hardirqs last disabled at (866912): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.743710] softirqs last enabled at (866740): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.743713] softirqs last disabled at (866735): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.743715] ---[ end trace 0000000000000000 ]--- <7> [233.744736] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.744860] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [233.745376] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48406, lrc_seqno=48406, guc_id=0, flags=0x73 in no process [-1] <7> [233.745381] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.745465] ------------[ cut here ]------------ <4> [233.745467] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.745469] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:8/994 <4> [233.745558] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.745644] CPU: 2 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.745647] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.745648] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.745649] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.745655] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.745732] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.745734] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.745737] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.745738] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.745739] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.745741] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.745742] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.745743] FS: 0000000000000000(0000) GS:ffff8888dab82000(0000) knlGS:0000000000000000 <4> [233.745745] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.745746] CR2: 00007dc968a6d000 CR3: 000000000364a002 CR4: 0000000000f72ef0 <4> [233.745748] PKRU: 55555554 <4> [233.745749] Call Trace: <4> [233.745750] <TASK> <4> [233.745754] ? __pfx_lock_acquire+0x10/0x10 <4> [233.745759] ? lock_release+0xd0/0x2b0 <4> [233.745764] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.745770] process_one_work+0x239/0x740 <4> [233.745777] worker_thread+0x200/0x3f0 <4> [233.745780] ? __pfx_worker_thread+0x10/0x10 <4> [233.745783] kthread+0x10d/0x150 <4> [233.745785] ? __pfx_kthread+0x10/0x10 <4> [233.745788] ret_from_fork+0x3bd/0x470 <4> [233.745790] ? __pfx_kthread+0x10/0x10 <4> [233.745793] ret_from_fork_asm+0x1a/0x30 <4> [233.745800] </TASK> <4> [233.745801] irq event stamp: 869113 <4> [233.745802] hardirqs last enabled at (869119): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.745805] hardirqs last disabled at (869124): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.745806] softirqs last enabled at (868622): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.745809] softirqs last disabled at (868615): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.745812] ---[ end trace 0000000000000000 ]--- <6> [233.745814] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.745891] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.745898] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.745949] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.746269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.746368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.746469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.746563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.746671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.746755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.746843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.746933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.747017] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.747111] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.747207] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.748239] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.758604] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.758863] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.759950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.760045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.760133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.760211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.760285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.760357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.760431] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.760504] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.760575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.760663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.760742] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.760820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.760898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.760976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.761054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.761130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.761211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.761292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.761373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.761462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.761549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.761646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.761732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.761816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.761903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.761989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.762071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.762151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.762231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.762314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.762400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.762488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.762574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.762672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.762764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.762853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.762941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.763027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.763115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.763200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.763285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.763368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.763450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.763533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.763625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.763710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.763799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.763884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.763966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.764053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.764142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.764225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.764308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.764391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.764473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.764555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.764648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.764729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.764808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.764896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.764980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.765064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.765145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.765226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.765308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.765390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.765470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.765549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.765642] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.765762] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.765766] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48406, lrc_seqno=48406, guc_id=0, flags=0x73 in no process [-1] <7> [233.765768] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.765836] ------------[ cut here ]------------ <4> [233.765837] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.765839] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:37/3091 <4> [233.765917] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.765984] CPU: 6 UID: 0 PID: 3091 Comm: kworker/u64:37 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.765987] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.765988] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.765990] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.765995] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.766073] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.766075] RSP: 0018:ffffc90007bb3ca0 EFLAGS: 00010246 <4> [233.766077] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.766079] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.766080] RBP: ffffc90007bb3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.766081] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.766082] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.766084] FS: 0000000000000000(0000) GS:ffff8888dad82000(0000) knlGS:0000000000000000 <4> [233.766085] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.766087] CR2: 00007fff30088fe0 CR3: 000000000364a005 CR4: 0000000000f72ef0 <4> [233.766088] PKRU: 55555554 <4> [233.766089] Call Trace: <4> [233.766091] <TASK> <4> [233.766095] ? __pfx_lock_acquire+0x10/0x10 <4> [233.766100] ? lock_release+0xd0/0x2b0 <4> [233.766105] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.766110] process_one_work+0x239/0x740 <4> [233.766117] worker_thread+0x200/0x3f0 <4> [233.766120] ? __pfx_worker_thread+0x10/0x10 <4> [233.766123] kthread+0x10d/0x150 <4> [233.766125] ? __pfx_kthread+0x10/0x10 <4> [233.766128] ret_from_fork+0x3bd/0x470 <4> [233.766130] ? __pfx_kthread+0x10/0x10 <4> [233.766133] ret_from_fork_asm+0x1a/0x30 <4> [233.766140] </TASK> <4> [233.766141] irq event stamp: 1886879 <4> [233.766142] hardirqs last enabled at (1886885): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.766145] hardirqs last disabled at (1886890): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.766146] softirqs last enabled at (1885964): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.766149] softirqs last disabled at (1885957): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.766152] ---[ end trace 0000000000000000 ]--- <6> [233.766154] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.766230] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.766236] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.767484] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.767602] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.767716] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.767944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.768049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.768153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.768251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.768348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.768441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.768535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.768637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.768730] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.768838] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.768941] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.769981] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.780599] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.780863] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.781905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.781998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.782085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.782171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.782258] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.782344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.782429] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.782514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.782604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.782689] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.782777] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.782864] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.782951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.783034] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.783119] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.783201] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.783286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.783370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.783453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.783545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.783645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.783737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.783827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.783916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.784004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.784095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.784185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.784272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.784360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.784449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.784539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.784635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.784724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.784815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.784911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.785004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.785098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.785189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.785278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.785366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.785454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.785541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.785634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.785724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.785812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.785900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.785987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.786073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.786159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.786249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.786344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.786434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.786522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.786614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.786705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.786796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.786885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.786970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.787054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.787146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.787235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.787323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.787413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.787505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.787598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.787685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.787773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.787858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.787948] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.788073] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.788078] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48406, lrc_seqno=48406, guc_id=0, flags=0x73 in no process [-1] <7> [233.788080] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.788153] ------------[ cut here ]------------ <4> [233.788154] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.788156] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:8/994 <4> [233.788240] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.788307] CPU: 2 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.788311] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.788312] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.788313] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.788319] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.788400] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.788402] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.788404] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.788405] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.788407] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.788408] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.788409] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.788410] FS: 0000000000000000(0000) GS:ffff8888dab82000(0000) knlGS:0000000000000000 <4> [233.788412] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.788413] CR2: 00007dc968a6d000 CR3: 000000000364a002 CR4: 0000000000f72ef0 <4> [233.788415] PKRU: 55555554 <4> [233.788416] Call Trace: <4> [233.788417] <TASK> <4> [233.788421] ? __pfx_lock_acquire+0x10/0x10 <4> [233.788427] ? lock_release+0xd0/0x2b0 <4> [233.788431] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.788440] process_one_work+0x239/0x740 <4> [233.788447] worker_thread+0x200/0x3f0 <4> [233.788450] ? __pfx_worker_thread+0x10/0x10 <4> [233.788452] kthread+0x10d/0x150 <4> [233.788455] ? __pfx_kthread+0x10/0x10 <4> [233.788457] ret_from_fork+0x3bd/0x470 <4> [233.788460] ? __pfx_kthread+0x10/0x10 <4> [233.788462] ret_from_fork_asm+0x1a/0x30 <4> [233.788470] </TASK> <4> [233.788471] irq event stamp: 873369 <4> [233.788472] hardirqs last enabled at (873375): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.788475] hardirqs last disabled at (873380): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.788476] softirqs last enabled at (872098): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.788479] softirqs last disabled at (872089): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.788482] ---[ end trace 0000000000000000 ]--- <5> [233.789411] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48461, lrc_seqno=48461, guc_id=0, flags=0x73 in no process [-1] <7> [233.789417] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.789497] ------------[ cut here ]------------ <4> [233.789498] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.789500] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:8/994 <7> [233.789526] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [233.789641] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.789756] CPU: 3 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.789760] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.789762] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.789765] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [233.789702] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [233.789773] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.789887] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.789889] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.789891] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.789892] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.789894] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.789895] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.789896] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.789897] FS: 0000000000000000(0000) GS:ffff8888dac02000(0000) knlGS:0000000000000000 <4> [233.789899] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.789900] CR2: 000059a1b383f208 CR3: 000000000364a006 CR4: 0000000000f72ef0 <4> [233.789902] PKRU: 55555554 <4> [233.789903] Call Trace: <4> [233.789904] <TASK> <4> [233.789909] ? __pfx_lock_acquire+0x10/0x10 <4> [233.789913] ? lock_release+0xd0/0x2b0 <4> [233.789918] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.789924] process_one_work+0x239/0x740 <4> [233.789931] worker_thread+0x200/0x3f0 <4> [233.789934] ? __pfx_worker_thread+0x10/0x10 <4> [233.789937] kthread+0x10d/0x150 <4> [233.789939] ? __pfx_kthread+0x10/0x10 <4> [233.789942] ret_from_fork+0x3bd/0x470 <4> [233.789944] ? __pfx_kthread+0x10/0x10 <4> [233.789947] ret_from_fork_asm+0x1a/0x30 <4> [233.789954] </TASK> <4> [233.789955] irq event stamp: 874907 <4> [233.789956] hardirqs last enabled at (874913): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.789958] hardirqs last disabled at (874918): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.789960] softirqs last enabled at (874170): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.789963] softirqs last disabled at (874165): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.789965] ---[ end trace 0000000000000000 ]--- <6> [233.789967] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.790047] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.790053] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.790103] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.790567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.790703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.790825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.790920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.791013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.791106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.791203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.791297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.791387] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.791490] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.791585] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.792650] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.802598] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.802857] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.803880] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.803968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.804052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.804137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.804219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.804298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.804376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.804455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.804533] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.804621] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.804709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.804787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.804865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.804942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.805021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.805100] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.805177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.805254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.805330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.805418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.805504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.805594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.805676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.805757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.805838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.805919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.805998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.806078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.806160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.806245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.806329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.806413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.806498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.806582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.806685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.806778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.806871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.806958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.807045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.807128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.807212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.807295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.807377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.807461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.807545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.807637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.807719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.807802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.807881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.807964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.808048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.808129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.808211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.808293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.808375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.808459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.808542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.808631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.808712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.808794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.808876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.808963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.809047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.809131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.809215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.809296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.809378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.809461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.809548] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.809680] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.809684] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48461, lrc_seqno=48461, guc_id=0, flags=0x73 in no process [-1] <7> [233.809687] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.809756] ------------[ cut here ]------------ <4> [233.809757] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.809758] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:38/3092 <4> [233.809839] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.809906] CPU: 11 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.809909] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.809910] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.809912] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.809917] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.809993] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.809995] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [233.809997] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.809999] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.810000] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.810001] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.810002] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.810003] FS: 0000000000000000(0000) GS:ffff8888db002000(0000) knlGS:0000000000000000 <4> [233.810005] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.810006] CR2: 00007dc968a7e000 CR3: 000000012991f006 CR4: 0000000000f72ef0 <4> [233.810008] PKRU: 55555554 <4> [233.810009] Call Trace: <4> [233.810010] <TASK> <4> [233.810014] ? __pfx_lock_acquire+0x10/0x10 <4> [233.810019] ? lock_release+0xd0/0x2b0 <4> [233.810024] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.810029] process_one_work+0x239/0x740 <4> [233.810036] worker_thread+0x200/0x3f0 <4> [233.810039] ? __pfx_worker_thread+0x10/0x10 <4> [233.810042] kthread+0x10d/0x150 <4> [233.810044] ? __pfx_kthread+0x10/0x10 <4> [233.810047] ret_from_fork+0x3bd/0x470 <4> [233.810049] ? __pfx_kthread+0x10/0x10 <4> [233.810052] ret_from_fork_asm+0x1a/0x30 <4> [233.810059] </TASK> <4> [233.810060] irq event stamp: 564397 <4> [233.810062] hardirqs last enabled at (564403): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.810064] hardirqs last disabled at (564408): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.810066] softirqs last enabled at (563568): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.810068] softirqs last disabled at (563563): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.810071] ---[ end trace 0000000000000000 ]--- <6> [233.810073] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.810149] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.810155] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.811396] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.811508] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.811629] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.811867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.811967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.812068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.812165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.812260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.812354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.812445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.812538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.812639] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.812749] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.812847] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.813886] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.824594] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.824853] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.825844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.825934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.826016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.826097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.826178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.826260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.826340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.826418] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.826496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.826573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.826676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.826761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.826839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.826916] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.826993] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.827070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.827146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.827226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.827306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.827396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.827483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.827567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.827671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.827769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.827853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.827933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.828013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.828093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.828172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.828257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.828344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.828429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.828513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.828604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.828703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.828790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.828877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.828959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.829042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.829123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.829206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.829286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.829368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.829455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.829541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.829639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.829733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.829819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.829901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.829984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.830068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.830150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.830232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.830314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.830397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.830482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.830567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.830664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.830755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.830839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.830920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.831002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.831082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.831164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.831245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.831326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.831406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.831486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.831571] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.831718] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.831723] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48461, lrc_seqno=48461, guc_id=0, flags=0x73 in no process [-1] <7> [233.831725] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.831794] ------------[ cut here ]------------ <4> [233.831796] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.831797] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:8/994 <4> [233.831878] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.831944] CPU: 3 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.831947] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.831948] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.831950] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.831955] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.832033] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.832035] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.832037] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.832039] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.832040] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.832041] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.832042] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.832044] FS: 0000000000000000(0000) GS:ffff8888dac02000(0000) knlGS:0000000000000000 <4> [233.832045] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.832047] CR2: 000059a1b383f208 CR3: 000000000364a006 CR4: 0000000000f72ef0 <4> [233.832048] PKRU: 55555554 <4> [233.832049] Call Trace: <4> [233.832050] <TASK> <4> [233.832054] ? __pfx_lock_acquire+0x10/0x10 <4> [233.832059] ? lock_release+0xd0/0x2b0 <4> [233.832064] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.832070] process_one_work+0x239/0x740 <4> [233.832076] worker_thread+0x200/0x3f0 <4> [233.832079] ? __pfx_worker_thread+0x10/0x10 <4> [233.832082] kthread+0x10d/0x150 <4> [233.832084] ? __pfx_kthread+0x10/0x10 <4> [233.832087] ret_from_fork+0x3bd/0x470 <4> [233.832089] ? __pfx_kthread+0x10/0x10 <4> [233.832092] ret_from_fork_asm+0x1a/0x30 <4> [233.832099] </TASK> <4> [233.832100] irq event stamp: 879115 <4> [233.832101] hardirqs last enabled at (879121): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.832104] hardirqs last disabled at (879126): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.832106] softirqs last enabled at (878286): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.832109] softirqs last disabled at (878279): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.832111] ---[ end trace 0000000000000000 ]--- <5> [233.833064] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48516, lrc_seqno=48516, guc_id=0, flags=0x73 in no process [-1] <7> [233.833073] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.833244] ------------[ cut here ]------------ <4> [233.833245] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.833247] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#14: kworker/u64:8/994 <4> [233.833373] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.833470] CPU: 14 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.833474] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.833476] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.833478] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [233.833432] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [233.833486] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <7> [233.833547] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [233.833626] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.833628] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.833631] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.833633] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.833635] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.833636] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.833637] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.833639] FS: 0000000000000000(0000) GS:ffff8888db182000(0000) knlGS:0000000000000000 <4> [233.833641] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.833643] CR2: 0000762ab12056f0 CR3: 000000012b66c001 CR4: 0000000000f72ef0 <4> [233.833644] PKRU: 55555554 <4> [233.833646] Call Trace: <4> [233.833647] <TASK> <4> [233.833653] ? __pfx_lock_acquire+0x10/0x10 <4> [233.833661] ? lock_release+0xd0/0x2b0 <4> [233.833669] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.833685] process_one_work+0x239/0x740 <4> [233.833696] worker_thread+0x200/0x3f0 <4> [233.833701] ? __pfx_worker_thread+0x10/0x10 <4> [233.833704] kthread+0x10d/0x150 <4> [233.833708] ? __pfx_kthread+0x10/0x10 <4> [233.833712] ret_from_fork+0x3bd/0x470 <4> [233.833716] ? __pfx_kthread+0x10/0x10 <4> [233.833720] ret_from_fork_asm+0x1a/0x30 <4> [233.833733] </TASK> <4> [233.833734] irq event stamp: 881019 <4> [233.833736] hardirqs last enabled at (881025): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.833739] hardirqs last disabled at (881030): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.833742] softirqs last enabled at (880858): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.833746] softirqs last disabled at (880847): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.833749] ---[ end trace 0000000000000000 ]--- <6> [233.833761] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.833844] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.833855] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.834031] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.834250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.834347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.834452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.834546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.834695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.834794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.834887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.834980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.835070] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.835174] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.835273] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.836313] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.846939] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.847195] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.848212] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.848297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.848380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.848462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.848542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.848633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.848722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.848802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.848881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.848962] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.849044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.849124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.849203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.849280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.849358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.849436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.849515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.849604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.849687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.849776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.849865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.849955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.850039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.850124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.850214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.850298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.850378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.850458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.850539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.850638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.850724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.850808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.850891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.850974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.851065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.851158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.851250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.851336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.851422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.851507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.851600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.851684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.851769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.851857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.851943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.852027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.852109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.852190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.852274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.852362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.852449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.852531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.852628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.852713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.852795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.852878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.852960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.853040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.853124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.853211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.853294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.853377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.853459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.853540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.853631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.853712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.853793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.853876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.853961] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.854085] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.854089] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48516, lrc_seqno=48516, guc_id=0, flags=0x73 in no process [-1] <7> [233.854092] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.854160] ------------[ cut here ]------------ <4> [233.854161] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.854163] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:38/3092 <4> [233.854243] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.854314] CPU: 7 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.854318] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.854319] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.854320] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.854326] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.854406] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.854407] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [233.854410] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.854411] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.854413] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.854414] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.854415] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.854416] FS: 0000000000000000(0000) GS:ffff8888dae02000(0000) knlGS:0000000000000000 <4> [233.854418] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.854419] CR2: 00007dc968a72000 CR3: 000000000364a003 CR4: 0000000000f72ef0 <4> [233.854421] PKRU: 55555554 <4> [233.854422] Call Trace: <4> [233.854423] <TASK> <4> [233.854427] ? __pfx_lock_acquire+0x10/0x10 <4> [233.854433] ? lock_release+0xd0/0x2b0 <4> [233.854437] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.854443] process_one_work+0x239/0x740 <4> [233.854451] worker_thread+0x200/0x3f0 <4> [233.854454] ? __pfx_worker_thread+0x10/0x10 <4> [233.854457] kthread+0x10d/0x150 <4> [233.854459] ? __pfx_kthread+0x10/0x10 <4> [233.854462] ret_from_fork+0x3bd/0x470 <4> [233.854465] ? __pfx_kthread+0x10/0x10 <4> [233.854467] ret_from_fork_asm+0x1a/0x30 <4> [233.854475] </TASK> <4> [233.854476] irq event stamp: 568693 <4> [233.854477] hardirqs last enabled at (568699): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.854480] hardirqs last disabled at (568704): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.854481] softirqs last enabled at (567576): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.854484] softirqs last disabled at (567567): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.854487] ---[ end trace 0000000000000000 ]--- <6> [233.854871] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.855310] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.855323] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.855745] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.855863] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.855975] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.856204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.856313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.856420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.856520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.856637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.856738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.856838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.856937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.857029] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.857137] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.857239] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.858278] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.868583] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.868852] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.869873] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.869966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.870055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.870142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.870233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.870321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.870407] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.870492] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.870581] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.870666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.870751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.870833] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.870917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.871000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.871085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.871168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.871251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.871337] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.871423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.871517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.871617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.871710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.871804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.871898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.871985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.872072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.872160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.872248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.872340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.872433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.872525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.872620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.872707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.872795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.872890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.872984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.873078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.873169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.873258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.873347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.873438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.873525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.873626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.873716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.873807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.873899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.873989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.874075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.874161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.874248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.874336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.874424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.874514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.874611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.874701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.874790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.874878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.874966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.875056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.875146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.875234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.875323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.875410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.875497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.875588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.875676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.875766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.875859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.875956] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.876083] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.876088] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48516, lrc_seqno=48516, guc_id=0, flags=0x73 in no process [-1] <7> [233.876090] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.876164] ------------[ cut here ]------------ <4> [233.876165] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.876167] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:38/3092 <4> [233.876253] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.876321] CPU: 8 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.876324] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.876325] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.876326] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.876332] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.876414] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.876416] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [233.876418] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.876420] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.876421] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.876422] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.876424] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.876425] FS: 0000000000000000(0000) GS:ffff8888dae82000(0000) knlGS:0000000000000000 <4> [233.876427] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.876428] CR2: 00007dc968a7a000 CR3: 0000000108194004 CR4: 0000000000f72ef0 <4> [233.876430] PKRU: 55555554 <4> [233.876431] Call Trace: <4> [233.876432] <TASK> <4> [233.876436] ? __pfx_lock_acquire+0x10/0x10 <4> [233.876441] ? lock_release+0xd0/0x2b0 <4> [233.876446] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.876452] process_one_work+0x239/0x740 <4> [233.876459] worker_thread+0x200/0x3f0 <4> [233.876462] ? __pfx_worker_thread+0x10/0x10 <4> [233.876464] kthread+0x10d/0x150 <4> [233.876466] ? __pfx_kthread+0x10/0x10 <4> [233.876470] ret_from_fork+0x3bd/0x470 <4> [233.876472] ? __pfx_kthread+0x10/0x10 <4> [233.876475] ret_from_fork_asm+0x1a/0x30 <4> [233.876482] </TASK> <4> [233.876483] irq event stamp: 571957 <4> [233.876484] hardirqs last enabled at (571963): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.876487] hardirqs last disabled at (571968): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.876489] softirqs last enabled at (571024): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.876492] softirqs last disabled at (571017): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.876494] ---[ end trace 0000000000000000 ]--- <5> [233.877590] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48571, lrc_seqno=48571, guc_id=0, flags=0x73 in no process [-1] <7> [233.877598] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.877696] ------------[ cut here ]------------ <4> [233.877698] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.877699] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:38/3092 <4> [233.877780] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap <7> [233.877754] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [233.877808] mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.877846] CPU: 6 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.877849] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.877850] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.877851] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.877856] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <7> [233.877865] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [233.877934] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.877936] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [233.877938] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.877939] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.877940] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.877941] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.877942] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.877943] FS: 0000000000000000(0000) GS:ffff8888dad82000(0000) knlGS:0000000000000000 <4> [233.877945] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.877946] CR2: 00007fff30088fe0 CR3: 000000012991f003 CR4: 0000000000f72ef0 <4> [233.877947] PKRU: 55555554 <4> [233.877948] Call Trace: <4> [233.877949] <TASK> <4> [233.877952] ? __pfx_lock_acquire+0x10/0x10 <4> [233.877957] ? lock_release+0xd0/0x2b0 <4> [233.877962] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.877971] process_one_work+0x239/0x740 <4> [233.877978] worker_thread+0x200/0x3f0 <4> [233.877981] ? __pfx_worker_thread+0x10/0x10 <4> [233.877984] kthread+0x10d/0x150 <4> [233.877986] ? __pfx_kthread+0x10/0x10 <4> [233.877989] ret_from_fork+0x3bd/0x470 <4> [233.877991] ? __pfx_kthread+0x10/0x10 <4> [233.877994] ret_from_fork_asm+0x1a/0x30 <4> [233.878001] </TASK> <4> [233.878002] irq event stamp: 573817 <4> [233.878003] hardirqs last enabled at (573823): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.878006] hardirqs last disabled at (573828): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.878007] softirqs last enabled at (571024): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.878010] softirqs last disabled at (571017): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.878013] ---[ end trace 0000000000000000 ]--- <6> [233.878015] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.878093] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.878099] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.878325] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.878538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.878644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.878744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.878841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.878934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.879024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.879115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.879207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.879293] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.879394] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.879491] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.880525] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.890579] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.890838] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.891828] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.891913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.891995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.892078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.892160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.892240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.892320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.892399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.892481] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.892561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.892657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.892737] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.892815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.892893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.892971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.893049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.893129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.893211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.893290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.893377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.893464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.893551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.893648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.893733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.893818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.893902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.893987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.894073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.894154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.894239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.894323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.894404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.894488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.894578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.894670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.894759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.894850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.894939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.895028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.895114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.895196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.895276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.895358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.895446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.895531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.895632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.895718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.895805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.895890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.895976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.896064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.896147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.896229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.896312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.896394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.896477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.896558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.896651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.896733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.896816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.896900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.896982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.897064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.897145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.897230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.897317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.897402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.897485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.897574] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.897696] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.897700] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48571, lrc_seqno=48571, guc_id=0, flags=0x73 in no process [-1] <7> [233.897702] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.897769] ------------[ cut here ]------------ <4> [233.897771] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.897772] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:38/3092 <4> [233.897851] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.897916] CPU: 6 UID: 0 PID: 3092 Comm: kworker/u64:38 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.897919] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.897920] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.897922] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.897927] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.898005] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.898007] RSP: 0018:ffffc90007bbbca0 EFLAGS: 00010246 <4> [233.898009] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.898010] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.898012] RBP: ffffc90007bbbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.898013] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.898014] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.898015] FS: 0000000000000000(0000) GS:ffff8888dad82000(0000) knlGS:0000000000000000 <4> [233.898017] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.898018] CR2: 00007fff30088fe0 CR3: 000000012991f003 CR4: 0000000000f72ef0 <4> [233.898020] PKRU: 55555554 <4> [233.898021] Call Trace: <4> [233.898022] <TASK> <4> [233.898026] ? __pfx_lock_acquire+0x10/0x10 <4> [233.898030] ? lock_release+0xd0/0x2b0 <4> [233.898035] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.898041] process_one_work+0x239/0x740 <4> [233.898047] worker_thread+0x200/0x3f0 <4> [233.898051] ? __pfx_worker_thread+0x10/0x10 <4> [233.898053] kthread+0x10d/0x150 <4> [233.898055] ? __pfx_kthread+0x10/0x10 <4> [233.898058] ret_from_fork+0x3bd/0x470 <4> [233.898061] ? __pfx_kthread+0x10/0x10 <4> [233.898063] ret_from_fork_asm+0x1a/0x30 <4> [233.898071] </TASK> <4> [233.898072] irq event stamp: 577017 <4> [233.898073] hardirqs last enabled at (577023): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.898075] hardirqs last disabled at (577028): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.898077] softirqs last enabled at (576108): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.898079] softirqs last disabled at (576101): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.898082] ---[ end trace 0000000000000000 ]--- <6> [233.898084] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.898161] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.898166] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.899414] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.899530] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.899656] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.899874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.899974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.900076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.900171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.900264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.900358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.900448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.900541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.900637] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.900737] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.900832] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.901874] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.912575] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.912857] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.913879] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.913965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.914046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.914128] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.914210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.914307] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.914393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.914476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.914556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.914649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.914729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.914809] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.914887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.914965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.915043] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.915122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.915206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.915287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.915366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.915452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.915537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.915642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.915726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.915809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.915893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.915973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.916055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.916140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.916224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.916308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.916395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.916478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.916564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.916662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.916754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.916848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.916937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.917024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.917109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.917191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.917272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.917355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.917435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.917520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.917614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.917695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.917778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.917858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.917938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.918022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.918105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.918187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.918267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.918350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.918435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.918520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.918610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.918692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.918772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.918855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.918935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.919016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.919096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.919176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.919257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.919338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.919417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.919496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.919587] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.919707] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.919711] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48571, lrc_seqno=48571, guc_id=0, flags=0x73 in no process [-1] <7> [233.919714] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.919782] ------------[ cut here ]------------ <4> [233.919783] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.919784] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:8/994 <4> [233.919863] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.919928] CPU: 11 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.919931] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.919932] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.919934] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.919939] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.920016] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.920017] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.920020] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.920021] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.920022] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.920023] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.920025] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.920026] FS: 0000000000000000(0000) GS:ffff8888db002000(0000) knlGS:0000000000000000 <4> [233.920028] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.920029] CR2: 00007dc968a7e000 CR3: 000000012991f006 CR4: 0000000000f72ef0 <4> [233.920030] PKRU: 55555554 <4> [233.920031] Call Trace: <4> [233.920033] <TASK> <4> [233.920036] ? __pfx_lock_acquire+0x10/0x10 <4> [233.920041] ? lock_release+0xd0/0x2b0 <4> [233.920046] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.920053] process_one_work+0x239/0x740 <4> [233.920059] worker_thread+0x200/0x3f0 <4> [233.920062] ? __pfx_worker_thread+0x10/0x10 <4> [233.920065] kthread+0x10d/0x150 <4> [233.920067] ? __pfx_kthread+0x10/0x10 <4> [233.920070] ret_from_fork+0x3bd/0x470 <4> [233.920072] ? __pfx_kthread+0x10/0x10 <4> [233.920075] ret_from_fork_asm+0x1a/0x30 <4> [233.920082] </TASK> <4> [233.920083] irq event stamp: 887173 <4> [233.920085] hardirqs last enabled at (887179): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.920087] hardirqs last disabled at (887184): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.920089] softirqs last enabled at (886258): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.920092] softirqs last disabled at (886251): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.920094] ---[ end trace 0000000000000000 ]--- <5> [233.921320] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48626, lrc_seqno=48626, guc_id=0, flags=0x73 in no process [-1] <7> [233.921324] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.921406] ------------[ cut here ]------------ <4> [233.921407] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.921409] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:8/994 <4> [233.921488] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.921553] CPU: 11 UID: 0 PID: 994 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.921556] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.921557] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.921559] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.921564] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.921653] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.921654] RSP: 0018:ffffc900032f3ca0 EFLAGS: 00010246 <4> [233.921657] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.921658] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.921660] RBP: ffffc900032f3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.921661] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.921662] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.921664] FS: 0000000000000000(0000) GS:ffff8888db002000(0000) knlGS:0000000000000000 <4> [233.921665] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.921666] CR2: 00007dc968a7e000 CR3: 000000012991f006 CR4: 0000000000f72ef0 <4> [233.921668] PKRU: 55555554 <4> [233.921669] Call Trace: <4> [233.921670] <TASK> <4> [233.921674] ? __pfx_lock_acquire+0x10/0x10 <4> [233.921679] ? lock_release+0xd0/0x2b0 <4> [233.921683] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.921689] process_one_work+0x239/0x740 <4> [233.921695] worker_thread+0x200/0x3f0 <4> [233.921698] ? __pfx_worker_thread+0x10/0x10 <4> [233.921701] kthread+0x10d/0x150 <4> [233.921704] ? __pfx_kthread+0x10/0x10 <4> [233.921706] ret_from_fork+0x3bd/0x470 <4> [233.921709] ? __pfx_kthread+0x10/0x10 <4> [233.921711] ret_from_fork_asm+0x1a/0x30 <4> [233.921719] </TASK> <4> [233.921720] irq event stamp: 889041 <4> [233.921721] hardirqs last enabled at (889047): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.921723] hardirqs last disabled at (889052): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.921725] softirqs last enabled at (886258): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.921728] softirqs last disabled at (886251): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.921730] ---[ end trace 0000000000000000 ]--- <6> [233.921732] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.921807] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.921813] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.921972] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.922082] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.922196] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.922413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.922512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.922620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.922712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.922801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.922890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.922979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.923070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.923155] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.923261] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.923358] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.924393] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.934581] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.934839] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.935863] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.935951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.936033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.936114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.936200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.936281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.936360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.936439] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.936517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.936603] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.936686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.936768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.936847] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.936926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.937003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.937081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.937159] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.937240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.937319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.937406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.937498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [233.937593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.937680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.937765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [233.937849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.937929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.938010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.938090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.938176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.938265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.938354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.938441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.938527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.938621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.938712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.938801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.938890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.938980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [233.939066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.939151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.939235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [233.939321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.939407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.939492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [233.939580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.939664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.939748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [233.939830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.939916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.940003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [233.940089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.940172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.940255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [233.940341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.940427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.940512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [233.940601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.940688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.940771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.940860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.940941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.941023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [233.941106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.941189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.941272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [233.941353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.941432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.941513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.941611] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.941735] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.941739] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=48626, lrc_seqno=48626, guc_id=0, flags=0x73 in no process [-1] <7> [233.941742] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.941811] ------------[ cut here ]------------ <4> [233.941813] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.941814] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:37/3091 <4> [233.941896] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.941961] CPU: 6 UID: 0 PID: 3091 Comm: kworker/u64:37 Tainted: G S U W 7.1.0-rc6-lgci-xe-xe-pw-167950v1-debug+ #1 PREEMPT(lazy) <4> [233.941964] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [233.941965] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.941967] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.941973] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [233.942050] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [233.942052] RSP: 0018:ffffc90007bb3ca0 EFLAGS: 00010246 <4> [233.942054] RAX: ffffffffa12bc4ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.942056] RDX: ffff888103fac890 RSI: ffffffffa12bc4ec RDI: ffffffffa0c03fd0 <4> [233.942057] RBP: ffffc90007bb3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.942058] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.942059] R13: ffff888103fac890 R14: ffff88812c54a018 R15: 00000000ffffffc2 <4> [233.942061] FS: 0000000000000000(0000) GS:ffff8888dad82000(0000) knlGS:0000000000000000 <4> [233.942062] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.942064] CR2: 00007fff30088fe0 CR3: 000000012991f003 CR4: 0000000000f72ef0 <4> [233.942065] PKRU: 55555554 <4> [233.942067] Call Trace: <4> [233.942068] <TASK> <4> [233.942072] ? __pfx_lock_acquire+0x10/0x10 <4> [233.942077] ? lock_release+0xd0/0x2b0 <4> [233.942081] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.942087] process_one_work+0x239/0x740 <4> [233.942094] worker_thread+0x200/0x3f0 <4> [233.942097] ? __pfx_worker_thread+0x10/0x10 <4> [233.942099] kthread+0x10d/0x150 <4> [233.942102] ? __pfx_kthread+0x10/0x10 <4> [233.942104] ret_from_fork+0x3bd/0x470 <4> [233.942107] ? __pfx_kthread+0x10/0x10 <4> [233.942109] ret_from_fork_asm+0x1a/0x30 <4> [233.942117] </TASK> <4> [233.942118] irq event stamp: 1891533 <4> [233.942119] hardirqs last enabled at (1891539): [<ffffffff814ac5d9>] __up_console_sem+0x79/0xa0 <4> [233.942121] hardirqs last disabled at (1891544): [<ffffffff814ac5be>] __up_console_sem+0x5e/0xa0 <4> [233.942123] softirqs last enabled at (1890696): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.942126] softirqs last disabled at (1890641): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [233.942128] ---[ end trace 0000000000000000 ]--- <6> [233.942130] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.942207] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.942213] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.943455] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.943572] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.943686] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.943901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.943997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.944096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.944188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.944280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.944369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.944460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.944553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.944653] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K

<4> [232.511571] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.511761] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.536079] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer

<4> [232.536133] i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.536240] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.556309] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.556465] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.558697] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.558940] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.581867] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.582027] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.603123] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.603279] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.604365] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.604540] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.627010] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.627252] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.648067] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.648221] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.649973] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me

<4> [232.650208] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.670017] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.670172] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.691032] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.691186] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.692481] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.692688] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.713089] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.713245] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.734011] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.734168] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.735482] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.735652] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.756256] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.756410] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.778036] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.778189] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.779503] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.779730] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.800078] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.800230] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.824389] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.824547] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.825568] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.825761] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.846129] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.846287] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.868021] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.868175] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.870086] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.870269] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.891266] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.891673] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.912043] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.912199] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.913686] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.913844] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.934459] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.934616] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.955523] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.956042] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.957268] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.957437] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.978049] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [232.978201] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [232.999965] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.000123] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.001423] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.001628] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.022057] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.022210] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.044317] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.044470] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.046094] mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.046244] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.066166] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.066321] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.087934] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.088087] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.089526] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.089676] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.110742] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.110896] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.131966] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.132121] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.133730] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.133897] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.155247] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.155403] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.176116] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.176269] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.177961] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.178211] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.198641] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.198804] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.220477] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.220641] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.221935] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.222099] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.241927] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.242082] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.263910] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.264066] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.265801] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.265954] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.285945] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.286099] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.306902] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.307053] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.307883] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.308070] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.327867] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.328018] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.350647] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.350822] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.351434] mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.351588] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.371950] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.372102] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.394216] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.394373] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.396088] drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.396330] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.416734] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.416890] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.437974] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.438129] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.439892] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.440128] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.461394] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.461557] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.482930] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.483086] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.484383] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.484568] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.505256] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.505407] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.526938] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.527091] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.528383] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.528602] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.548817] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.548971] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.569848] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.570003] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.570849] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.571031] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.591919] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.592074] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.612800] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.612952] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.614105] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.614279] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.633933] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.634085] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.655908] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.656063] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.657353] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.657559] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.678229] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.678384] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.700238] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.700393] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.701832] drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.702077] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.722420] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.722576] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.743496] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.743643] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.745558] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.745732] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.765917] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.766073] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.788240] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.788400] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.789641] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.789887] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.809839] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.809993] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.831878] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.832033] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.833373] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.833626] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.854243] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.854406] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.876253] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.876414] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.877780] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap

<4> [233.877808] mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.877934] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.897851] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.898005] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.919863] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.920016] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.921488] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.921653] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [233.941896] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd kvm_intel wmi_bmof kvm irqbypass aesni_intel r8169 gf128mul rapl usbhid intel_cstate nls_iso8859_1 realtek hid phy_package idma64 video snd_hda_intel snd_intel_dspcfg snd_hda_codec intel_pmc_core snd_hda_core i2c_i801 snd_hwdep pmt_telemetry snd_pcm pmt_discovery pmt_class snd_timer i2c_mux intel_pmc_ssram_telemetry acpi_pad pinctrl_alderlake acpi_tad spi_intel_pci mei_me snd i2c_smbus spi_intel soundcore mei intel_vsec wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.942050] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a0 07 3d e1 48 89 c6 48 8d 3d a6 91 d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

Results for igt@xe_pat@pt-caching-update-pat-and-pte