igt@xe_pat@pt-caching-random-offsets on shard-bmg@xe-pw-163606v3 Test details

Detail	Value
Duration	unknown
Hostname	shard-bmg-10
Igt-Version	IGT-Version: 2.4-g6c27cc975 (x86_64) (Linux: 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ x86_64)
Out	Using IGT_SRANDOM=1778662222 for randomisation Opened device: /dev/dri/card0 Test requirement not met in function __igt_unique____real_main2210, file ../tests/intel/xe_pat.c:2298: Test requirement: intel_graphics_ver(dev_id) == IP_VER(35, 10) Last errno: 2, No such file or directory Starting subtest: pt-caching-random-offsets va_bits: 48, num_objs: 16384, spread over pt levels: -> random, seed: 1778662222 Subtest pt-caching-random-offsets: SUCCESS (15.719s) This test caused an abort condition: Kernel badly tainted (0x244, 0x200) (check dmesg for details): TAINT_WARN: WARN_ON has happened.
Err	Starting subtest: pt-caching-random-offsets Subtest pt-caching-random-offsets: SUCCESS (15.719s)
Dmesg Scroll to first warning	<6> [102.709545] Console: switching to colour dummy device 80x25 <6> [102.709784] [IGT] xe_pat: executing <6> [102.735898] [IGT] xe_pat: starting subtest pt-caching-random-offsets <6> [104.144257] xe 0000:03:00.0: [drm] Tile0: GT0: ASID: 0 Faulted Address: 0x0000ff7418800000 FaultType: 0 AccessType: 0 FaultLevel: 3 EngineClass: 3 bcs EngineInstance: 8 <6> [104.144272] xe 0000:03:00.0: [drm] Tile0: GT0: Fault response: Unsuccessful -EINVAL <6> [104.144326] xe 0000:03:00.0: [drm] Tile0: GT0: Engine memory CAT error [18]: class=bcs, logical_mask: 0x2, guc_id=0 <7> [104.144848] xe 0000:03:00.0: [drm:xe_hw_engine_snapshot_capture [xe]] Tile0: GT0: Proceeding with manual engine snapshot <6> [104.145556] xe 0000:03:00.0: [drm] Tile0: GT0: Engine reset: engine_class=bcs, logical_mask: 0x2, guc_id=0, state=0x249 <5> [104.145695] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24286, lrc_seqno=24286, guc_id=0, flags=0x73 in no process [-1] <6> [104.326268] xe 0000:03:00.0: [drm] Xe device coredump has been created <6> [104.326287] xe 0000:03:00.0: [drm] Check your /sys/class/drm/card0/device/devcoredump/data <4> [104.326290] ------------[ cut here ]------------ <4> [104.326292] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.326293] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:6/205 <4> [104.326419] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.326495] [last unloaded: snd_hda_intel] <4> [104.326498] CPU: 6 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.326501] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER <4> [104.326502] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.326504] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.326510] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.326588] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.326590] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [104.326592] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.326594] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.326595] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.326596] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.326597] R13: ffff888104000010 R14: ffff888157df8000 R15: 00000000fffffffb <4> [104.326598] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [104.326600] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.326601] CR2: 00007071c0db2000 CR3: 0000000117c65002 CR4: 0000000000f72ef0 <4> [104.326603] PKRU: 55555554 <4> [104.326604] Call Trace: <4> [104.326605] <TASK> <4> [104.326609] ? lock_acquire+0x60/0x300 <4> [104.326615] ? __pfx_autoremove_wake_function+0x10/0x10 <4> [104.326620] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.326626] process_one_work+0x239/0x740 <4> [104.326633] worker_thread+0x200/0x3f0 <4> [104.326635] ? __pfx_worker_thread+0x10/0x10 <4> [104.326638] kthread+0x10d/0x150 <4> [104.326640] ? __pfx_kthread+0x10/0x10 <4> [104.326643] ret_from_fork+0x3bd/0x470 <4> [104.326646] ? __pfx_kthread+0x10/0x10 <4> [104.326648] ret_from_fork_asm+0x1a/0x30 <4> [104.326656] </TASK> <4> [104.326657] irq event stamp: 1148919 <4> [104.326658] hardirqs last enabled at (1148925): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.326660] hardirqs last disabled at (1148930): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.326661] softirqs last enabled at (1147970): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.326665] softirqs last disabled at (1147965): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.326667] ---[ end trace 0000000000000000 ]--- <6> [104.326669] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.326748] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.327320] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.327815] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.328623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.328760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.328868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.328967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.329059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.329162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.329257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.329350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.329439] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.329544] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.329634] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.330668] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.341096] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.341378] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.343119] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.343215] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.343297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.343377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.343455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.343535] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.343611] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.343685] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.343758] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.343831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.343903] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.343975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.344047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.344128] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.344207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.344283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.344356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.344429] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.344502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.344586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.344669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.344749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.344826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.344903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.344981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.345058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.345149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.345233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.345316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.345394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.345472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.345547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.345623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.345700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.345781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.345863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.345945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.346022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.346101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.346183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.346262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.346335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.346409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.346484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.346560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.346636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.346712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.346787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.346861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.346936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.347013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.347223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.347314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.347398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.347480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.347563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.347647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.347728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.347808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.347892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.347974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.348056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.348156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.348238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.348321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.348402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.348483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.348563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.348647] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.350104] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.350111] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24286, lrc_seqno=24286, guc_id=0, flags=0x73 in no process [-1] <7> [104.350115] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.350202] ------------[ cut here ]------------ <4> [104.350203] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.350205] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:6/205 <4> [104.350296] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.350365] [last unloaded: snd_hda_intel] <4> [104.350369] CPU: 6 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.350372] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.350373] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.350375] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.350381] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.350465] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.350467] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [104.350469] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.350471] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.350472] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.350473] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.350474] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.350476] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [104.350477] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.350479] CR2: 00005e7e416da918 CR3: 0000000126b65004 CR4: 0000000000f72ef0 <4> [104.350480] PKRU: 55555554 <4> [104.350481] Call Trace: <4> [104.350483] <TASK> <4> [104.350487] ? lock_acquire+0x60/0x300 <4> [104.350493] ? lock_release+0xd0/0x2b0 <4> [104.350498] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.350504] process_one_work+0x239/0x740 <4> [104.350512] worker_thread+0x200/0x3f0 <4> [104.350515] ? __pfx_worker_thread+0x10/0x10 <4> [104.350517] kthread+0x10d/0x150 <4> [104.350520] ? __pfx_kthread+0x10/0x10 <4> [104.350523] ret_from_fork+0x3bd/0x470 <4> [104.350526] ? __pfx_kthread+0x10/0x10 <4> [104.350528] ret_from_fork_asm+0x1a/0x30 <4> [104.350537] </TASK> <4> [104.350538] irq event stamp: 1152177 <4> [104.350539] hardirqs last enabled at (1152183): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.350542] hardirqs last disabled at (1152188): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.350543] softirqs last enabled at (1151376): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.350547] softirqs last disabled at (1151369): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.350550] ---[ end trace 0000000000000000 ]--- <6> [104.350552] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.350631] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.350640] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.350917] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [104.351039] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [104.351241] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.351513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.351659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.351805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.351944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.352084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.352237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.352342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.352441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.352530] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.352631] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.352726] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.353763] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.364093] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.364357] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.365325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.365411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.365492] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.365573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.365654] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.365730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.365805] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.365882] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.365958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.366031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.366135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.366212] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.366292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.366367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.366441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.366515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.366588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.366663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.366738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.366821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.366906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.366987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.367066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.367158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.367239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.367318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.367396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.367472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.367549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.367630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.367710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.367789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.367869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.367948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.368033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.368124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.368209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.368290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.368370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.368449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.368527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.368605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.368679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.368757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.368836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.368914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.368991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.369067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.369153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.369231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.369312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.369389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.369468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.369545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.369621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.369699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.369777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.369852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.369928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.370006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.370084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.370178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.370256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.370333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.370410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.370487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.370561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.370636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.370715] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.372654] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.372660] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24286, lrc_seqno=24286, guc_id=0, flags=0x73 in no process [-1] <7> [104.372663] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.372741] ------------[ cut here ]------------ <4> [104.372742] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.372744] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:7/710 <4> [104.372828] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.372896] [last unloaded: snd_hda_intel] <4> [104.372899] CPU: 8 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.372902] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.372904] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.372905] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.372911] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.372990] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.372992] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [104.372995] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.372996] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.372997] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.372999] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.373000] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.373001] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [104.373003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.373004] CR2: 00007ffca3877ac8 CR3: 000000000344a002 CR4: 0000000000f72ef0 <4> [104.373006] PKRU: 55555554 <4> [104.373007] Call Trace: <4> [104.373008] <TASK> <4> [104.373012] ? lock_acquire+0x60/0x300 <4> [104.373018] ? lock_release+0xd0/0x2b0 <4> [104.373023] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.373029] process_one_work+0x239/0x740 <4> [104.373036] worker_thread+0x200/0x3f0 <4> [104.373039] ? __pfx_worker_thread+0x10/0x10 <4> [104.373042] kthread+0x10d/0x150 <4> [104.373044] ? __pfx_kthread+0x10/0x10 <4> [104.373047] ret_from_fork+0x3bd/0x470 <4> [104.373050] ? __pfx_kthread+0x10/0x10 <4> [104.373053] ret_from_fork_asm+0x1a/0x30 <4> [104.373061] </TASK> <4> [104.373062] irq event stamp: 757099 <4> [104.373063] hardirqs last enabled at (757105): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.373066] hardirqs last disabled at (757110): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.373068] softirqs last enabled at (756206): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.373071] softirqs last disabled at (756195): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.373073] ---[ end trace 0000000000000000 ]--- <5> [104.373946] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24341, lrc_seqno=24341, guc_id=0, flags=0x73 in no process [-1] <7> [104.373949] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.374021] ------------[ cut here ]------------ <4> [104.374022] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.374024] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:7/710 <4> [104.374106] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.374170] [last unloaded: snd_hda_intel] <4> [104.374173] CPU: 8 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.374176] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.374177] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.374178] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.374184] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.374261] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.374262] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [104.374265] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.374266] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.374267] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.374268] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.374270] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.374271] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [104.374273] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.374274] CR2: 00007ffca3877ac8 CR3: 000000000344a002 CR4: 0000000000f72ef0 <4> [104.374275] PKRU: 55555554 <4> [104.374276] Call Trace: <4> [104.374277] <TASK> <4> [104.374281] ? lock_acquire+0x60/0x300 <4> [104.374286] ? lock_release+0xd0/0x2b0 <4> [104.374291] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.374297] process_one_work+0x239/0x740 <4> [104.374304] worker_thread+0x200/0x3f0 <4> [104.374307] ? __pfx_worker_thread+0x10/0x10 <4> [104.374309] kthread+0x10d/0x150 <4> [104.374311] ? __pfx_kthread+0x10/0x10 <4> [104.374314] ret_from_fork+0x3bd/0x470 <4> [104.374317] ? __pfx_kthread+0x10/0x10 <4> [104.374319] ret_from_fork_asm+0x1a/0x30 <4> [104.374327] </TASK> <4> [104.374328] irq event stamp: 759325 <4> [104.374329] hardirqs last enabled at (759331): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.374332] hardirqs last disabled at (759336): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.374333] softirqs last enabled at (756206): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.374336] softirqs last disabled at (756195): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.374339] ---[ end trace 0000000000000000 ]--- <6> [104.374341] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.374419] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.374427] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.374697] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [104.374811] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [104.374926] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.375200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.375298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.375396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.375489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.375580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.375669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.375773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.375863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.375947] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.376048] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.376152] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.377204] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.387092] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.387353] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.388592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.388693] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.388780] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.388863] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.388944] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.389022] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.389117] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.389212] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.389291] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.389368] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.389446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.389523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.389600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.389676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.389756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.389835] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.389913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.389990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.390067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.390171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.390258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.390342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.390425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.390507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.390588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.390668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.390747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.390826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.390904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.390985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.391068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.391162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.391243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.391323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.391410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.391496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.391581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.391664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.391746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.391825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.391905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.391983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.392060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.392151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.392232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.392311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.392390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.392483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.392562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.392641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.392721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.392798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.392875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.392952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.393027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.393111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.393188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.393263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.393339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.393418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.393496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.393574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.393651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.393728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.393806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.393883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.393959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.394034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.394124] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.394359] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.394364] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24341, lrc_seqno=24341, guc_id=0, flags=0x73 in no process [-1] <7> [104.394367] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.394436] ------------[ cut here ]------------ <4> [104.394437] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.394439] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:5/204 <4> [104.394518] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.394584] [last unloaded: snd_hda_intel] <4> [104.394588] CPU: 11 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.394591] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.394592] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.394593] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.394599] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.394676] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.394678] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246 <4> [104.394680] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.394682] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.394683] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.394684] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.394685] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.394687] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [104.394688] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.394690] CR2: 00007b64f6ab2000 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [104.394691] PKRU: 55555554 <4> [104.394692] Call Trace: <4> [104.394693] <TASK> <4> [104.394698] ? lock_acquire+0x60/0x300 <4> [104.394703] ? lock_release+0xd0/0x2b0 <4> [104.394708] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.394714] process_one_work+0x239/0x740 <4> [104.394721] worker_thread+0x200/0x3f0 <4> [104.394724] ? __pfx_worker_thread+0x10/0x10 <4> [104.394727] kthread+0x10d/0x150 <4> [104.394730] ? __pfx_kthread+0x10/0x10 <4> [104.394732] ret_from_fork+0x3bd/0x470 <4> [104.394735] ? __pfx_kthread+0x10/0x10 <4> [104.394738] ret_from_fork_asm+0x1a/0x30 <4> [104.394745] </TASK> <4> [104.394746] irq event stamp: 41627 <4> [104.394747] hardirqs last enabled at (41633): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.394750] hardirqs last disabled at (41638): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.394751] softirqs last enabled at (40784): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.394754] softirqs last disabled at (40773): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.394757] ---[ end trace 0000000000000000 ]--- <6> [104.394758] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.394838] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.394844] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.396263] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [104.396378] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [104.396491] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.396709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.396811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.396910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.397006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.397100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.397189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.397278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.397370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.397455] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.397558] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.397652] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.398688] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.409089] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.409350] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.410493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.410579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.410660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.410741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.410821] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.410900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.410979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.411060] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.411147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.411225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.411302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.411377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.411453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.411529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.411605] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.411680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.411756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.411832] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.411906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.411990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.412074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.412167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.412246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.412327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.412406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.412484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.412561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.412638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.412717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.412797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.412878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.412957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.413037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.413128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.413216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.413301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.413386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.413466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.413547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.413625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.413705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.413780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.413856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.413932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.414009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.414091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.414172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.414251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.414328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.414407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.414486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.414563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.414641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.414718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.414794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.414869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.414943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.415018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.415096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.415175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.415251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.415326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.415403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.415478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.415555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.415631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.415706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.415781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.415858] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.415978] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.415982] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24341, lrc_seqno=24341, guc_id=0, flags=0x73 in no process [-1] <7> [104.415985] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.416052] ------------[ cut here ]------------ <4> [104.416053] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.416055] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:7/710 <4> [104.416141] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.416209] [last unloaded: snd_hda_intel] <4> [104.416212] CPU: 8 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.416215] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.416217] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.416218] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.416224] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.416300] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.416302] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [104.416304] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.416305] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.416307] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.416308] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.416309] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.416310] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [104.416312] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.416313] CR2: 00007ffca3877ac8 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [104.416315] PKRU: 55555554 <4> [104.416316] Call Trace: <4> [104.416317] <TASK> <4> [104.416321] ? lock_acquire+0x60/0x300 <4> [104.416326] ? lock_release+0xd0/0x2b0 <4> [104.416331] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.416337] process_one_work+0x239/0x740 <4> [104.416344] worker_thread+0x200/0x3f0 <4> [104.416347] ? __pfx_worker_thread+0x10/0x10 <4> [104.416350] kthread+0x10d/0x150 <4> [104.416353] ? __pfx_kthread+0x10/0x10 <4> [104.416355] ret_from_fork+0x3bd/0x470 <4> [104.416358] ? __pfx_kthread+0x10/0x10 <4> [104.416361] ret_from_fork_asm+0x1a/0x30 <4> [104.416368] </TASK> <4> [104.416369] irq event stamp: 763657 <4> [104.416370] hardirqs last enabled at (763663): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.416373] hardirqs last disabled at (763668): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.416375] softirqs last enabled at (762748): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.416378] softirqs last disabled at (762743): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.416380] ---[ end trace 0000000000000000 ]--- <5> [104.417705] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24396, lrc_seqno=24396, guc_id=0, flags=0x73 in no process [-1] <7> [104.417710] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.417826] ------------[ cut here ]------------ <4> [104.417827] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.417828] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:7/710 <4> [104.417915] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore <7> [104.417917] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [104.417975] spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [104.417987] CPU: 10 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.417990] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.417991] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.417992] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.417997] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.418076] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.418078] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <7> [104.418034] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [104.418089] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.418091] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.418092] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.418093] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.418094] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.418095] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [104.418097] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.418098] CR2: 0000743418095068 CR3: 0000000126b65004 CR4: 0000000000f72ef0 <4> [104.418099] PKRU: 55555554 <4> [104.418100] Call Trace: <4> [104.418101] <TASK> <4> [104.418105] ? lock_acquire+0x60/0x300 <4> [104.418110] ? lock_release+0xd0/0x2b0 <4> [104.418114] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.418120] process_one_work+0x239/0x740 <4> [104.418127] worker_thread+0x200/0x3f0 <4> [104.418129] ? __pfx_worker_thread+0x10/0x10 <4> [104.418132] kthread+0x10d/0x150 <4> [104.418134] ? __pfx_kthread+0x10/0x10 <4> [104.418136] ret_from_fork+0x3bd/0x470 <4> [104.418138] ? __pfx_kthread+0x10/0x10 <4> [104.418145] ret_from_fork_asm+0x1a/0x30 <4> [104.418153] </TASK> <4> [104.418154] irq event stamp: 765569 <4> [104.418156] hardirqs last enabled at (765575): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.418158] hardirqs last disabled at (765580): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.418160] softirqs last enabled at (765428): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.418162] softirqs last disabled at (765423): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.418165] ---[ end trace 0000000000000000 ]--- <6> [104.418167] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.418245] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.418253] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.418476] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.418826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.418925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.419023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.419126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.419219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.419309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.419398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.419487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.419571] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.419672] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.419767] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.420805] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.431093] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.431353] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.432402] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.432488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.432569] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.432649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.432728] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.432805] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.432882] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.432959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.433037] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.433130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.433207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.433284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.433361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.433437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.433514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.433589] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.433666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.433749] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.433825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.433911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.433996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.434078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.434174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.434256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.434336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.434414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.434491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.434569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.434645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.434725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.434805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.434884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.434965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.435047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.435144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.435230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.435315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.435396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.435476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.435555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.435635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.435729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.435807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.435884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.435962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.436040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.436133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.436211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.436288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.436367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.436447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.436524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.436602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.436678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.436753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.436831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.436913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.436991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.437069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.437163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.437239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.437317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.437395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.437472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.437551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.437629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.437706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.437782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.437862] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.437988] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.437992] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24396, lrc_seqno=24396, guc_id=0, flags=0x73 in no process [-1] <7> [104.437994] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.438062] ------------[ cut here ]------------ <4> [104.438063] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.438065] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:7/710 <4> [104.438159] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.438224] [last unloaded: snd_hda_intel] <4> [104.438227] CPU: 10 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.438230] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.438231] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.438232] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.438238] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.438314] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.438316] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [104.438318] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.438319] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.438320] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.438322] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.438323] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.438324] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [104.438326] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.438327] CR2: 0000743418095068 CR3: 0000000126b65004 CR4: 0000000000f72ef0 <4> [104.438329] PKRU: 55555554 <4> [104.438330] Call Trace: <4> [104.438331] <TASK> <4> [104.438335] ? lock_acquire+0x60/0x300 <4> [104.438339] ? lock_release+0xd0/0x2b0 <4> [104.438344] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.438350] process_one_work+0x239/0x740 <4> [104.438357] worker_thread+0x200/0x3f0 <4> [104.438360] ? __pfx_worker_thread+0x10/0x10 <4> [104.438363] kthread+0x10d/0x150 <4> [104.438365] ? __pfx_kthread+0x10/0x10 <4> [104.438368] ret_from_fork+0x3bd/0x470 <4> [104.438370] ? __pfx_kthread+0x10/0x10 <4> [104.438373] ret_from_fork_asm+0x1a/0x30 <4> [104.438380] </TASK> <4> [104.438381] irq event stamp: 768743 <4> [104.438382] hardirqs last enabled at (768749): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.438385] hardirqs last disabled at (768754): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.438386] softirqs last enabled at (768000): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.438389] softirqs last disabled at (767989): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.438392] ---[ end trace 0000000000000000 ]--- <6> [104.439134] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.439273] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.439286] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.439648] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [104.439759] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [104.439866] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.440094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.440196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.440300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.440394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.440483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.440569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.440656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.440743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.440826] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.440927] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.441021] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.442264] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.452087] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.452345] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.453366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.453454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.453536] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.453618] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.453697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.453776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.453855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.453933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.454011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.454092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.454168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.454244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.454318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.454394] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.454469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.454545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.454620] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.454696] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.454770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.454856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.454943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.455025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.455111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.455193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.455272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.455352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.455430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.455507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.455584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.455664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.455746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.455826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.455906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.455986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.456074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.456174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.456259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.456340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.456420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.456497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.456575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.456651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.456726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.456804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.456882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.456958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.457034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.457117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.457193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.457268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.457346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.457424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.457504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.457582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.457657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.457740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.457816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.457892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.457968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.458047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.458133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.458210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.458286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.458362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.458438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.458515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.458590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.458663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.458742] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.458866] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.458871] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24396, lrc_seqno=24396, guc_id=0, flags=0x73 in no process [-1] <7> [104.458873] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.458942] ------------[ cut here ]------------ <4> [104.458943] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.458944] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:7/710 <4> [104.459031] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.459249] [last unloaded: snd_hda_intel] <4> [104.459253] CPU: 4 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.459256] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.459257] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.459259] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.459265] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.459342] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.459344] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [104.459346] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.459348] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.459349] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.459350] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.459352] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.459353] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [104.459355] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.459356] CR2: 00007434180962a8 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [104.459357] PKRU: 55555554 <4> [104.459359] Call Trace: <4> [104.459360] <TASK> <4> [104.459364] ? lock_acquire+0x60/0x300 <4> [104.459370] ? lock_release+0xd0/0x2b0 <4> [104.459374] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.459380] process_one_work+0x239/0x740 <4> [104.459387] worker_thread+0x200/0x3f0 <4> [104.459390] ? __pfx_worker_thread+0x10/0x10 <4> [104.459393] kthread+0x10d/0x150 <4> [104.459395] ? __pfx_kthread+0x10/0x10 <4> [104.459398] ret_from_fork+0x3bd/0x470 <4> [104.459401] ? __pfx_kthread+0x10/0x10 <4> [104.459403] ret_from_fork_asm+0x1a/0x30 <4> [104.459411] </TASK> <4> [104.459413] irq event stamp: 771911 <4> [104.459414] hardirqs last enabled at (771917): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.459416] hardirqs last disabled at (771922): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.459418] softirqs last enabled at (771014): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.459421] softirqs last disabled at (771009): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.459423] ---[ end trace 0000000000000000 ]--- <5> [104.460612] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24451, lrc_seqno=24451, guc_id=0, flags=0x73 in no process [-1] <7> [104.460626] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.460700] ------------[ cut here ]------------ <4> [104.460701] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.460703] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:6/205 <7> [104.460692] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [104.460785] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.460850] [last unloaded: snd_hda_intel] <4> [104.460853] CPU: 8 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.460856] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.460858] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.460859] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.460865] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <7> [104.460852] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [104.460945] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.460946] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [104.460948] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.460950] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.460951] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.460952] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.460953] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.460954] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [104.460955] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.460956] CR2: 00007ffca3877ac8 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [104.460958] PKRU: 55555554 <4> [104.460958] Call Trace: <4> [104.460959] <TASK> <4> [104.460963] ? lock_acquire+0x60/0x300 <4> [104.460968] ? lock_release+0xd0/0x2b0 <4> [104.460972] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.460978] process_one_work+0x239/0x740 <4> [104.460985] worker_thread+0x200/0x3f0 <4> [104.460987] ? __pfx_worker_thread+0x10/0x10 <4> [104.460990] kthread+0x10d/0x150 <4> [104.460992] ? __pfx_kthread+0x10/0x10 <4> [104.460995] ret_from_fork+0x3bd/0x470 <4> [104.460997] ? __pfx_kthread+0x10/0x10 <4> [104.460999] ret_from_fork_asm+0x1a/0x30 <4> [104.461012] </TASK> <4> [104.461013] irq event stamp: 1153869 <4> [104.461014] hardirqs last enabled at (1153875): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.461016] hardirqs last disabled at (1153880): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.461018] softirqs last enabled at (1151376): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.461021] softirqs last disabled at (1151369): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.461024] ---[ end trace 0000000000000000 ]--- <6> [104.461026] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.461112] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.461122] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.461247] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.461518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.461667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.461813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.461954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.462102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.462242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.462382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.462524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.462661] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.462810] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.462955] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.464304] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.475097] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.475417] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.476603] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.476731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.476857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.476985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.477120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.477248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.477375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.477503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.477630] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.477757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.477885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.478012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.478143] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.478272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.478399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.478527] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.478653] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.478781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.478908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.479039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.479176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.479308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.479438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.479570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.479701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.479830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.479959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.480094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.480224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.480357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.480491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.480622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.480755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.480887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.481026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.481169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.481310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.481447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.481582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.481713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.481845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.481978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.482113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.482254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.482348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.482434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.482513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.482591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.482663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.482738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.482817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.482892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.482966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.483038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.483121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.483193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.483265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.483335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.483403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.483476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.483544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.483614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.483683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.483753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.483822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.483892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.483961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.484030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.484111] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.484349] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.484353] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24451, lrc_seqno=24451, guc_id=0, flags=0x73 in no process [-1] <7> [104.484355] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.484419] ------------[ cut here ]------------ <4> [104.484420] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.484421] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:7/710 <4> [104.484493] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.484554] [last unloaded: snd_hda_intel] <4> [104.484557] CPU: 10 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.484559] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.484560] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.484562] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.484567] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.484636] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.484637] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [104.484639] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.484641] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.484642] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.484643] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.484644] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.484645] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [104.484647] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.484648] CR2: 0000743421425000 CR3: 0000000126b65004 CR4: 0000000000f72ef0 <4> [104.484649] PKRU: 55555554 <4> [104.484650] Call Trace: <4> [104.484651] <TASK> <4> [104.484655] ? lock_acquire+0x60/0x300 <4> [104.484659] ? lock_release+0xd0/0x2b0 <4> [104.484664] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.484669] process_one_work+0x239/0x740 <4> [104.484676] worker_thread+0x200/0x3f0 <4> [104.484679] ? __pfx_worker_thread+0x10/0x10 <4> [104.484681] kthread+0x10d/0x150 <4> [104.484683] ? __pfx_kthread+0x10/0x10 <4> [104.484686] ret_from_fork+0x3bd/0x470 <4> [104.484688] ? __pfx_kthread+0x10/0x10 <4> [104.484691] ret_from_fork_asm+0x1a/0x30 <4> [104.484698] </TASK> <4> [104.484699] irq event stamp: 776273 <4> [104.484700] hardirqs last enabled at (776279): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.484702] hardirqs last disabled at (776284): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.484703] softirqs last enabled at (775340): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.484706] softirqs last disabled at (775333): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.484708] ---[ end trace 0000000000000000 ]--- <6> [104.484710] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.484779] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.484786] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.486038] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [104.486171] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [104.486525] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.486730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.486817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.486906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.486988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.487069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.487170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.487250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.487331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.487407] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.487498] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.487583] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.488604] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.499082] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.499332] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.500355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.500445] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.500524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.500600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.500674] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.500747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.500819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.500889] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.500960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.501031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.501123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.501194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.501263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.501332] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.501402] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.501471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.501540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.501609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.501677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.501756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.501834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.501909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.501984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.502059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.502143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.502215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.502286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.502356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.502425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.502497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.502570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.502642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.502714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.502786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.502864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.502942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.503019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.503095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.503176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.503247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.503316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.503386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.503454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.503524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.503596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.503668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.503738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.503808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.503877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.503948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.504021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.504096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.504174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.504244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.504313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.504384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.504458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.504529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.504598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.504670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.504740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.504810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.504880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.504949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.505022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.505098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.505178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.505248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.505321] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.505437] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.505441] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24451, lrc_seqno=24451, guc_id=0, flags=0x73 in no process [-1] <7> [104.505443] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.505505] ------------[ cut here ]------------ <4> [104.505506] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.505507] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:5/204 <4> [104.505579] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.505639] [last unloaded: snd_hda_intel] <4> [104.505642] CPU: 8 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.505645] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.505646] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.505647] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.505652] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.505723] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.505725] RSP: 0018:ffffc90001627ca0 EFLAGS: 00010246 <4> [104.505727] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.505728] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.505729] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.505730] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.505731] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.505732] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [104.505734] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.505735] CR2: 00007ffca3877ac8 CR3: 0000000140845004 CR4: 0000000000f72ef0 <4> [104.505736] PKRU: 55555554 <4> [104.505737] Call Trace: <4> [104.505738] <TASK> <4> [104.505742] ? lock_acquire+0x60/0x300 <4> [104.505747] ? lock_release+0xd0/0x2b0 <4> [104.505751] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.505757] process_one_work+0x239/0x740 <4> [104.505763] worker_thread+0x200/0x3f0 <4> [104.505766] ? __pfx_worker_thread+0x10/0x10 <4> [104.505768] kthread+0x10d/0x150 <4> [104.505771] ? __pfx_kthread+0x10/0x10 <4> [104.505773] ret_from_fork+0x3bd/0x470 <4> [104.505775] ? __pfx_kthread+0x10/0x10 <4> [104.505778] ret_from_fork_asm+0x1a/0x30 <4> [104.505785] </TASK> <4> [104.505786] irq event stamp: 46473 <4> [104.505787] hardirqs last enabled at (46479): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.505789] hardirqs last disabled at (46484): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.505791] softirqs last enabled at (45520): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.505794] softirqs last disabled at (45515): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.505796] ---[ end trace 0000000000000000 ]--- <5> [104.506392] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24506, lrc_seqno=24506, guc_id=0, flags=0x73 in no process [-1] <7> [104.506398] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.506672] ------------[ cut here ]------------ <4> [104.506675] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.506678] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#12: kworker/u64:7/710 <4> [104.506802] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.506901] [last unloaded: snd_hda_intel] <4> [104.506906] CPU: 12 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.506910] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.506912] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.506915] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.506925] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.507047] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.507050] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [104.507053] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.507055] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.507057] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.507059] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.507061] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.507063] FS: 0000000000000000(0000) GS:ffff8888db283000(0000) knlGS:0000000000000000 <4> [104.507065] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.507067] CR2: 0000721a2e3a7160 CR3: 0000000126b65004 CR4: 0000000000f72ef0 <4> [104.507069] PKRU: 55555554 <4> [104.507071] Call Trace: <4> [104.507072] <TASK> <4> [104.507086] ? lock_acquire+0x60/0x300 <4> [104.507096] ? lock_release+0xd0/0x2b0 <4> [104.507104] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.507115] process_one_work+0x239/0x740 <4> [104.507128] worker_thread+0x200/0x3f0 <4> [104.507132] ? __pfx_worker_thread+0x10/0x10 <4> [104.507136] kthread+0x10d/0x150 <4> [104.507141] ? __pfx_kthread+0x10/0x10 <4> [104.507146] ret_from_fork+0x3bd/0x470 <4> [104.507150] ? __pfx_kthread+0x10/0x10 <4> [104.507155] ret_from_fork_asm+0x1a/0x30 <4> [104.507168] </TASK> <4> [104.507171] irq event stamp: 777951 <4> [104.507173] hardirqs last enabled at (777957): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.507176] hardirqs last disabled at (777962): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.507179] softirqs last enabled at (776672): [<ffffffff8133ad53>] kernel_fpu_end+0x53/0x70 <4> [104.507183] softirqs last disabled at (776670): [<ffffffff8133b464>] kernel_fpu_begin_mask+0xc4/0x120 <4> [104.507186] ---[ end trace 0000000000000000 ]--- <6> [104.507190] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.507323] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.507333] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.507433] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [104.507535] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [104.507641] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.507900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.508039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.508187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.508327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.508465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.508601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.508740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.508881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.509016] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.509172] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.509318] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.510694] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.521086] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.521406] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.522595] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.522723] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.522848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.522975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.523136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.523230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.523314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.523392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.523465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.523535] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.523605] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.523674] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.523742] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.523813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.523884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.523953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.524024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.524108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.524185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.524267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.524344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.524418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.524492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.524568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.524642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.524713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.524785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.524855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.524926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.524999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.525078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.525157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.525232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.525303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.525382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.525460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.525536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.525609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.525680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.525751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.525824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.525894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.526111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.526191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.526266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.526339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.526411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.526481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.526551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.526623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.526696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.526767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.526837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.526908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.526978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.527048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.527127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.527202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.527273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.527345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.527415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.527486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.527556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.527625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.527696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.527770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.527842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.527913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.527986] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.528236] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.528241] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24506, lrc_seqno=24506, guc_id=0, flags=0x73 in no process [-1] <7> [104.528243] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.528309] ------------[ cut here ]------------ <4> [104.528310] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.528311] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:7/710 <4> [104.528386] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.528446] [last unloaded: snd_hda_intel] <4> [104.528449] CPU: 4 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.528451] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.528452] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.528454] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.528459] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.528529] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.528531] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [104.528533] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.528534] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.528536] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.528537] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.528538] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.528539] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [104.528540] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.528542] CR2: 00007434180962a8 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [104.528543] PKRU: 55555554 <4> [104.528544] Call Trace: <4> [104.528545] <TASK> <4> [104.528549] ? lock_acquire+0x60/0x300 <4> [104.528553] ? lock_release+0xd0/0x2b0 <4> [104.528558] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.528563] process_one_work+0x239/0x740 <4> [104.528569] worker_thread+0x200/0x3f0 <4> [104.528572] ? __pfx_worker_thread+0x10/0x10 <4> [104.528575] kthread+0x10d/0x150 <4> [104.528576] ? __pfx_kthread+0x10/0x10 <4> [104.528579] ret_from_fork+0x3bd/0x470 <4> [104.528581] ? __pfx_kthread+0x10/0x10 <4> [104.528584] ret_from_fork_asm+0x1a/0x30 <4> [104.528591] </TASK> <4> [104.528592] irq event stamp: 781119 <4> [104.528593] hardirqs last enabled at (781125): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.528595] hardirqs last disabled at (781130): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.528596] softirqs last enabled at (780102): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.528599] softirqs last disabled at (780093): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.528602] ---[ end trace 0000000000000000 ]--- <6> [104.528603] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.528673] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.528679] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.529955] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [104.530057] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [104.530436] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.530645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.530737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.530829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.530915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.530998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.531085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.531167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.531251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.531329] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.531422] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.531508] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.532528] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.543257] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.543524] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.544625] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.544737] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.544840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.544943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.545043] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.545160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.545264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.545365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.545469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.545572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.545677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.545783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.545891] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.545998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.546116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.546227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.546336] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.546445] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.546554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.546683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.546809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.546928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.547041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.547169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.547279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.547385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.547489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.547590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.547690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.547794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.547897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.547999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.548104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.548201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.548303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.548406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.548508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.548605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.548701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.548794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.548891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.548984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.549074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.549163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.549252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.549341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.549431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.549517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.549601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.549686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.549772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.549855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.549937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.550019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.550109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.550188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.550269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.550350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.550428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.550509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.550586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.550662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.550737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.550811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.550887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.550963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.551039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.551120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.551194] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.551310] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.551314] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24506, lrc_seqno=24506, guc_id=0, flags=0x73 in no process [-1] <7> [104.551317] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.551379] ------------[ cut here ]------------ <4> [104.551380] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.551382] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:7/710 <4> [104.551454] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.551514] [last unloaded: snd_hda_intel] <4> [104.551517] CPU: 4 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.551519] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.551521] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.551522] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.551527] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.551596] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.551598] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [104.551600] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.551601] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.551602] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.551603] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.551604] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.551606] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [104.551607] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.551608] CR2: 00007434180962a8 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [104.551610] PKRU: 55555554 <4> [104.551611] Call Trace: <4> [104.551612] <TASK> <4> [104.551616] ? lock_acquire+0x60/0x300 <4> [104.551620] ? lock_release+0xd0/0x2b0 <4> [104.551625] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.551630] process_one_work+0x239/0x740 <4> [104.551636] worker_thread+0x200/0x3f0 <4> [104.551639] ? __pfx_worker_thread+0x10/0x10 <4> [104.551642] kthread+0x10d/0x150 <4> [104.551644] ? __pfx_kthread+0x10/0x10 <4> [104.551646] ret_from_fork+0x3bd/0x470 <4> [104.551648] ? __pfx_kthread+0x10/0x10 <4> [104.551651] ret_from_fork_asm+0x1a/0x30 <4> [104.551658] </TASK> <4> [104.551659] irq event stamp: 784307 <4> [104.551660] hardirqs last enabled at (784313): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.551662] hardirqs last disabled at (784318): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.551663] softirqs last enabled at (783458): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.551666] softirqs last disabled at (783451): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.551668] ---[ end trace 0000000000000000 ]--- <5> [104.552385] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24561, lrc_seqno=24561, guc_id=0, flags=0x73 in no process [-1] <7> [104.552392] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.552525] ------------[ cut here ]------------ <4> [104.552527] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.552529] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:2/121 <4> [104.552627] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.552701] [last unloaded: snd_hda_intel] <4> [104.552704] CPU: 3 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.552707] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.552708] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.552710] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.552715] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.552794] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.552795] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [104.552798] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.552799] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.552800] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.552802] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.552803] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.552804] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000 <4> [104.552806] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.552807] CR2: 00007b64f7be62f4 CR3: 000000000344a002 CR4: 0000000000f72ef0 <4> [104.552809] PKRU: 55555554 <4> [104.552810] Call Trace: <4> [104.552811] <TASK> <4> [104.552815] ? lock_acquire+0x60/0x300 <4> [104.552821] ? lock_release+0xd0/0x2b0 <4> [104.552825] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.552831] process_one_work+0x239/0x740 <4> [104.552838] worker_thread+0x200/0x3f0 <4> [104.552841] ? __pfx_worker_thread+0x10/0x10 <4> [104.552844] kthread+0x10d/0x150 <4> [104.552846] ? __pfx_kthread+0x10/0x10 <4> [104.552849] ret_from_fork+0x3bd/0x470 <4> [104.552851] ? __pfx_kthread+0x10/0x10 <4> [104.552854] ret_from_fork_asm+0x1a/0x30 <4> [104.552861] </TASK> <4> [104.552863] irq event stamp: 1402301 <4> [104.552864] hardirqs last enabled at (1402307): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.552866] hardirqs last disabled at (1402312): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.552868] softirqs last enabled at (1400782): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.552871] softirqs last disabled at (1400761): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.552873] ---[ end trace 0000000000000000 ]--- <7> [104.552805] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [104.552875] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.552952] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.552959] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.552965] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [104.553290] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.553526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.553636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.553741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.553838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.553931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.554023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.554130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.554218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.554300] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.554394] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.554479] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.555501] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.566228] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.566501] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.567550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.567633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.567709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.567783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.567855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.567926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.567999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.568079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.568157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.568235] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.568309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.568386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.568463] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.568539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.568614] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.568691] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.568767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.568843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.568918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.569006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.569100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.569186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.569269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.569353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.569437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.569518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.569597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.569673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.569750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.569829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.569908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.569987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.570066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.570164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.570249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.570332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.570415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.570495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.570575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.570652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.570730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.570806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.570881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.570959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.571037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.571126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.571204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.571282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.571358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.571435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.571516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.571592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.571669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.571746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.571822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.571899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.571974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.572049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.572135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.572213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.572290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.572367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.572443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.572518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.572595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.572672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.572748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.572823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.572901] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.573027] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.573032] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24561, lrc_seqno=24561, guc_id=0, flags=0x73 in no process [-1] <7> [104.573034] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.573287] ------------[ cut here ]------------ <4> [104.573288] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.573290] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:7/710 <4> [104.573370] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.573435] [last unloaded: snd_hda_intel] <4> [104.573439] CPU: 2 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.573442] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.573443] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.573445] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.573451] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.573527] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.573529] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [104.573531] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.573533] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.573534] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.573535] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.573536] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.573538] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [104.573539] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.573541] CR2: 00005baa6c47e018 CR3: 000000000344a003 CR4: 0000000000f72ef0 <4> [104.573542] PKRU: 55555554 <4> [104.573543] Call Trace: <4> [104.573545] <TASK> <4> [104.573549] ? lock_acquire+0x60/0x300 <4> [104.573554] ? lock_release+0xd0/0x2b0 <4> [104.573558] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.573564] process_one_work+0x239/0x740 <4> [104.573571] worker_thread+0x200/0x3f0 <4> [104.573574] ? __pfx_worker_thread+0x10/0x10 <4> [104.573577] kthread+0x10d/0x150 <4> [104.573579] ? __pfx_kthread+0x10/0x10 <4> [104.573582] ret_from_fork+0x3bd/0x470 <4> [104.573584] ? __pfx_kthread+0x10/0x10 <4> [104.573587] ret_from_fork_asm+0x1a/0x30 <4> [104.573594] </TASK> <4> [104.573595] irq event stamp: 788655 <4> [104.573597] hardirqs last enabled at (788661): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.573599] hardirqs last disabled at (788666): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.573601] softirqs last enabled at (787564): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.573604] softirqs last disabled at (787557): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.573606] ---[ end trace 0000000000000000 ]--- <6> [104.573608] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.573685] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.573692] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.574949] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [104.575062] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [104.575189] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.575405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.575501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.575625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.575719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.575809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.575897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.575986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.576230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.576326] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.576428] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.576522] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.577558] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.588076] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.588332] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.589336] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.589420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.589502] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.589584] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.589666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.589747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.589826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.589903] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.589981] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.590057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.590149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.590227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.590303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.590379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.590455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.590530] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.590606] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.590681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.590756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.590843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.590927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.591012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.591102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.591184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.591264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.591342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.591419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.591496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.591573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.591653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.591734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.591813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.591893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.591972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.592056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.592156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.592240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.592323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.592403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.592481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.592561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.592640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.592717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.592794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.592873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.592951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.593029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.593117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.593193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.593272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.593352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.593429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.593507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.593583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.593659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.593736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.593812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.593887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.593963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.594042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.594131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.594210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.594286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.594361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.594467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.594569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.594662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.594746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.594832] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.594959] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.594964] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24561, lrc_seqno=24561, guc_id=0, flags=0x73 in no process [-1] <7> [104.594966] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.595035] ------------[ cut here ]------------ <4> [104.595036] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.595037] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:2/121 <4> [104.595126] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.595195] [last unloaded: snd_hda_intel] <4> [104.595198] CPU: 3 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.595201] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.595202] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.595204] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.595210] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.595286] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.595288] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [104.595290] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.595292] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.595293] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.595294] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.595295] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.595297] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000 <4> [104.595299] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.595300] CR2: 00007b64f7be62f4 CR3: 000000000344a002 CR4: 0000000000f72ef0 <4> [104.595302] PKRU: 55555554 <4> [104.595303] Call Trace: <4> [104.595304] <TASK> <4> [104.595308] ? lock_acquire+0x60/0x300 <4> [104.595313] ? lock_release+0xd0/0x2b0 <4> [104.595318] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.595324] process_one_work+0x239/0x740 <4> [104.595331] worker_thread+0x200/0x3f0 <4> [104.595334] ? __pfx_worker_thread+0x10/0x10 <4> [104.595337] kthread+0x10d/0x150 <4> [104.595339] ? __pfx_kthread+0x10/0x10 <4> [104.595342] ret_from_fork+0x3bd/0x470 <4> [104.595344] ? __pfx_kthread+0x10/0x10 <4> [104.595347] ret_from_fork_asm+0x1a/0x30 <4> [104.595354] </TASK> <4> [104.595355] irq event stamp: 1406567 <4> [104.595357] hardirqs last enabled at (1406573): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.595359] hardirqs last disabled at (1406578): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.595361] softirqs last enabled at (1405402): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.595363] softirqs last disabled at (1405397): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.595366] ---[ end trace 0000000000000000 ]--- <7> [104.596624] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [104.596739] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [104.597181] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24616, lrc_seqno=24616, guc_id=0, flags=0x73 in no process [-1] <7> [104.597187] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.597306] ------------[ cut here ]------------ <4> [104.597308] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.597310] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#13: kworker/u64:7/710 <4> [104.597435] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.597529] [last unloaded: snd_hda_intel] <4> [104.597533] CPU: 13 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.597537] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.597539] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.597541] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.597549] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.597669] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.597672] RSP: 0000:ffffc90001ffbca0 EFLAGS: 00010246 <4> [104.597675] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.597677] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.597679] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.597681] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.597682] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.597684] FS: 0000000000000000(0000) GS:ffff8888db303000(0000) knlGS:0000000000000000 <4> [104.597687] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.597689] CR2: 00007f024051b2d0 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [104.597691] PKRU: 55555554 <4> [104.597692] Call Trace: <4> [104.597694] <TASK> <4> [104.597701] ? lock_acquire+0x60/0x300 <4> [104.597708] ? lock_release+0xd0/0x2b0 <4> [104.597716] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.597726] process_one_work+0x239/0x740 <4> [104.597736] worker_thread+0x200/0x3f0 <4> [104.597741] ? __pfx_worker_thread+0x10/0x10 <4> [104.597745] kthread+0x10d/0x150 <4> [104.597748] ? __pfx_kthread+0x10/0x10 <4> [104.597752] ret_from_fork+0x3bd/0x470 <4> [104.597755] ? __pfx_kthread+0x10/0x10 <4> [104.597759] ret_from_fork_asm+0x1a/0x30 <4> [104.597772] </TASK> <4> [104.597773] irq event stamp: 790793 <4> [104.597775] hardirqs last enabled at (790799): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.597778] hardirqs last disabled at (790804): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.597780] softirqs last enabled at (789172): [<ffffffff8133ad53>] kernel_fpu_end+0x53/0x70 <4> [104.597783] softirqs last disabled at (789170): [<ffffffff8133b464>] kernel_fpu_begin_mask+0xc4/0x120 <4> [104.597787] ---[ end trace 0000000000000000 ]--- <6> [104.597790] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.597910] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.597921] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.598043] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.598407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.598562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.598710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.598850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.598989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.599150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.599265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.599366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.599454] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.599557] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.599652] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.600695] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.611073] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.611331] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.612374] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.612459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.612539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.612620] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.612700] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.612778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.612857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.612935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.613013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.613110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.613189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.613267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.613343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.613420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.613496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.613573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.613649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.613724] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.613800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.613888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.613974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.614058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.614157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.614237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.614317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.614394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.614471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.614547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.614623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.614705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.614790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.614870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.614950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.615030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.615127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.615212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.615296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.615378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.615457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.615535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.615613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.615689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.615766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.615843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.615921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.615999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.616084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.616163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.616239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.616317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.616396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.616472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.616550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.616626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.616702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.616780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.616857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.616932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.617007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.617098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.617176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.617256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.617332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.617408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.617484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.617563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.617640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.617715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.617794] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.618779] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.618784] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24616, lrc_seqno=24616, guc_id=0, flags=0x73 in no process [-1] <7> [104.618787] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.618857] ------------[ cut here ]------------ <4> [104.618859] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.618860] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:2/121 <4> [104.618939] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.619004] [last unloaded: snd_hda_intel] <4> [104.619008] CPU: 0 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.619010] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.619012] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.619013] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.619019] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.619109] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.619113] RSP: 0000:ffffc90000563ca0 EFLAGS: 00010246 <4> [104.619117] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.619118] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.619120] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.619121] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.619122] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.619123] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [104.619125] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.619126] CR2: 0000743421427000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [104.619128] PKRU: 55555554 <4> [104.619129] Call Trace: <4> [104.619130] <TASK> <4> [104.619135] ? lock_acquire+0x60/0x300 <4> [104.619140] ? lock_release+0xd0/0x2b0 <4> [104.619145] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.619151] process_one_work+0x239/0x740 <4> [104.619158] worker_thread+0x200/0x3f0 <4> [104.619161] ? __pfx_worker_thread+0x10/0x10 <4> [104.619164] kthread+0x10d/0x150 <4> [104.619166] ? __pfx_kthread+0x10/0x10 <4> [104.619169] ret_from_fork+0x3bd/0x470 <4> [104.619172] ? __pfx_kthread+0x10/0x10 <4> [104.619175] ret_from_fork_asm+0x1a/0x30 <4> [104.619182] </TASK> <4> [104.619183] irq event stamp: 1411015 <4> [104.619184] hardirqs last enabled at (1411021): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.619187] hardirqs last disabled at (1411026): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.619189] softirqs last enabled at (1410108): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.619192] softirqs last disabled at (1410093): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.619194] ---[ end trace 0000000000000000 ]--- <6> [104.619196] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.619273] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.619279] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.619693] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [104.619805] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [104.619916] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.620135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.620229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.620325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.620416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.620508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.620597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.620684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.620773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.620856] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.620955] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.621048] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.622101] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.632072] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.632326] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.633404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.633489] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.633569] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.633650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.633730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.633808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.633886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.633964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.634040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.634128] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.634205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.634281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.634357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.634433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.634510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.634585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.634661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.634735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.634809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.634893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.634975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.635054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.635153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.635234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.635315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.635393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.635470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.635548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.635625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.635705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.635785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.635863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.635941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.636023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.636118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.636204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.636289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.636369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.636450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.636527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.636606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.636684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.636759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.636838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.636918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.636996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.637084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.637161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.637236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.637312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.637391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.637466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.637543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.637618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.637692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.637769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.637845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.637919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.637994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.638075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.638154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.638234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.638311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.638388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.638465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.638543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.638617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.638693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.638772] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.638890] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.638894] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24616, lrc_seqno=24616, guc_id=0, flags=0x73 in no process [-1] <7> [104.638897] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.638964] ------------[ cut here ]------------ <4> [104.638965] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.638966] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:2/121 <4> [104.639044] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.639113] [last unloaded: snd_hda_intel] <4> [104.639116] CPU: 0 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.639119] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.639120] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.639121] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.639126] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.639202] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.639203] RSP: 0000:ffffc90000563ca0 EFLAGS: 00010246 <4> [104.639206] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.639207] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.639208] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.639210] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.639211] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.639212] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [104.639214] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.639215] CR2: 0000743421427000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [104.639217] PKRU: 55555554 <4> [104.639218] Call Trace: <4> [104.639219] <TASK> <4> [104.639223] ? lock_acquire+0x60/0x300 <4> [104.639227] ? lock_release+0xd0/0x2b0 <4> [104.639232] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.639238] process_one_work+0x239/0x740 <4> [104.639245] worker_thread+0x200/0x3f0 <4> [104.639248] ? __pfx_worker_thread+0x10/0x10 <4> [104.639250] kthread+0x10d/0x150 <4> [104.639252] ? __pfx_kthread+0x10/0x10 <4> [104.639255] ret_from_fork+0x3bd/0x470 <4> [104.639257] ? __pfx_kthread+0x10/0x10 <4> [104.639260] ret_from_fork_asm+0x1a/0x30 <4> [104.639268] </TASK> <4> [104.639269] irq event stamp: 1414201 <4> [104.639270] hardirqs last enabled at (1414207): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.639272] hardirqs last disabled at (1414212): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.639274] softirqs last enabled at (1413036): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.639277] softirqs last disabled at (1413027): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.639280] ---[ end trace 0000000000000000 ]--- <5> [104.639651] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24671, lrc_seqno=24671, guc_id=0, flags=0x73 in no process [-1] <7> [104.639657] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.639911] ------------[ cut here ]------------ <4> [104.639914] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.639916] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#13: kworker/u64:7/710 <4> [104.640044] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.640175] [last unloaded: snd_hda_intel] <4> [104.640181] CPU: 13 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.640185] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.640187] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.640189] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.640199] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.640327] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.640330] RSP: 0000:ffffc90001ffbca0 EFLAGS: 00010246 <4> [104.640333] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.640336] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.640338] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.640340] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.640342] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.640345] FS: 0000000000000000(0000) GS:ffff8888db303000(0000) knlGS:0000000000000000 <4> [104.640347] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.640349] CR2: 00007f024051b2d0 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [104.640352] PKRU: 55555554 <4> [104.640353] Call Trace: <4> [104.640355] <TASK> <4> [104.640363] ? lock_acquire+0x60/0x300 <4> [104.640372] ? lock_release+0xd0/0x2b0 <4> [104.640380] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.640390] process_one_work+0x239/0x740 <4> [104.640403] worker_thread+0x200/0x3f0 <4> [104.640408] ? __pfx_worker_thread+0x10/0x10 <4> [104.640412] kthread+0x10d/0x150 <4> [104.640415] ? __pfx_kthread+0x10/0x10 <4> [104.640420] ret_from_fork+0x3bd/0x470 <4> [104.640423] ? __pfx_kthread+0x10/0x10 <4> [104.640427] ret_from_fork_asm+0x1a/0x30 <4> [104.640440] </TASK> <4> [104.640442] irq event stamp: 793257 <4> [104.640444] hardirqs last enabled at (793263): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.640448] hardirqs last disabled at (793268): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.640451] softirqs last enabled at (792612): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.640455] softirqs last disabled at (792557): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.640459] ---[ end trace 0000000000000000 ]--- <6> [104.640486] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.640614] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <7> [104.640628] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [104.640737] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [104.640854] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.640908] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.641228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.641348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.641457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.641555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.641650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.641741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.641832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.641925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.642013] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.642131] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.642234] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.643281] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.654078] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.654364] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.655352] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.655449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.655540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.655627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.655714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.655798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.655881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.655964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.656047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.656143] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.656224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.656307] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.656389] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.656470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.656551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.656632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.656713] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.656793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.656875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.656968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.657059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.657162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.657251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.657338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.657424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.657508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.657591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.657674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.657757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.657841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.657928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.658013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.658104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.658188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.658277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.658368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.658458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.658544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.658629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.658712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.658795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.658877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.658957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.659040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.659131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.659213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.659295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.659378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.659460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.659542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.659627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.659710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.659796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.659881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.659963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.660045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.660138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.660219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.660299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.660382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.660463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.660543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.660624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.660704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.660786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.660884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.660966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.661047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.661141] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.661268] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.661273] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24671, lrc_seqno=24671, guc_id=0, flags=0x73 in no process [-1] <7> [104.661276] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.661348] ------------[ cut here ]------------ <4> [104.661349] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.661351] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:7/710 <4> [104.661434] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.661500] [last unloaded: snd_hda_intel] <4> [104.661503] CPU: 6 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.661506] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.661507] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.661509] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.661514] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.661595] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.661597] RSP: 0000:ffffc90001ffbca0 EFLAGS: 00010246 <4> [104.661599] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.661601] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.661602] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.661603] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.661604] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.661606] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [104.661607] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.661609] CR2: 0000743421424000 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [104.661610] PKRU: 55555554 <4> [104.661611] Call Trace: <4> [104.661612] <TASK> <4> [104.661617] ? lock_acquire+0x60/0x300 <4> [104.661622] ? lock_release+0xd0/0x2b0 <4> [104.661627] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.661633] process_one_work+0x239/0x740 <4> [104.661640] worker_thread+0x200/0x3f0 <4> [104.661643] ? __pfx_worker_thread+0x10/0x10 <4> [104.661646] kthread+0x10d/0x150 <4> [104.661648] ? __pfx_kthread+0x10/0x10 <4> [104.661651] ret_from_fork+0x3bd/0x470 <4> [104.661653] ? __pfx_kthread+0x10/0x10 <4> [104.661656] ret_from_fork_asm+0x1a/0x30 <4> [104.661664] </TASK> <4> [104.661665] irq event stamp: 796415 <4> [104.661666] hardirqs last enabled at (796421): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.661668] hardirqs last disabled at (796426): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.661670] softirqs last enabled at (795244): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.661673] softirqs last disabled at (795235): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.661676] ---[ end trace 0000000000000000 ]--- <6> [104.661677] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.661758] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.661764] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.663010] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [104.663142] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [104.663258] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.663475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.663574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.663673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.663764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.663854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.663943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.664031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.664137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.664226] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.664329] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.664425] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.665461] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.676068] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.676326] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.677359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.677448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.677529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.677610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.677690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.677771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.677849] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.677928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.678007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.678096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.678174] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.678251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.678328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.678404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.678480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.678555] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.678631] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.678707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.678783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.678869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.678954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.679036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.679129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.679211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.679295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.679376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.679454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.679531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.679608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.679686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.679766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.679844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.679921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.679999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.680094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.680180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.680264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.680344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.680423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.680500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.680577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.680653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.680729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.680805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.680883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.680960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.681040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.681131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.681209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.681289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.681372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.681450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.681527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.681604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.681679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.681758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.681835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.681910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.681986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.682071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.682147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.682224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.682300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.682377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.682456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.682537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.682615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.682691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.682770] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.682892] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.682896] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24671, lrc_seqno=24671, guc_id=0, flags=0x73 in no process [-1] <7> [104.682899] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.682970] ------------[ cut here ]------------ <4> [104.682971] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.682972] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:2/121 <4> [104.683050] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.683337] [last unloaded: snd_hda_intel] <4> [104.683341] CPU: 0 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.683344] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.683345] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.683346] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.683352] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.683429] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.683431] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [104.683433] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.683435] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.683436] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.683437] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.683438] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.683440] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [104.683441] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.683443] CR2: 0000743421427000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [104.683444] PKRU: 55555554 <4> [104.683445] Call Trace: <4> [104.683446] <TASK> <4> [104.683450] ? lock_acquire+0x60/0x300 <4> [104.683455] ? lock_release+0xd0/0x2b0 <4> [104.683460] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.683466] process_one_work+0x239/0x740 <4> [104.683473] worker_thread+0x200/0x3f0 <4> [104.683476] ? __pfx_worker_thread+0x10/0x10 <4> [104.683479] kthread+0x10d/0x150 <4> [104.683481] ? __pfx_kthread+0x10/0x10 <4> [104.683484] ret_from_fork+0x3bd/0x470 <4> [104.683486] ? __pfx_kthread+0x10/0x10 <4> [104.683488] ret_from_fork_asm+0x1a/0x30 <4> [104.683496] </TASK> <4> [104.683497] irq event stamp: 1419647 <4> [104.683498] hardirqs last enabled at (1419653): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.683500] hardirqs last disabled at (1419658): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.683502] softirqs last enabled at (1418380): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.683505] softirqs last disabled at (1418371): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.683507] ---[ end trace 0000000000000000 ]--- <7> [104.685209] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [104.685328] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [104.685436] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24726, lrc_seqno=24726, guc_id=0, flags=0x73 in no process [-1] <7> [104.685439] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.685510] ------------[ cut here ]------------ <4> [104.685511] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.685513] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:2/121 <4> [104.685596] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.685661] [last unloaded: snd_hda_intel] <4> [104.685664] CPU: 0 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.685667] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.685668] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.685669] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.685675] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.685755] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.685757] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [104.685759] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.685760] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.685761] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.685763] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.685764] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.685765] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [104.685767] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.685768] CR2: 0000743421427000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [104.685769] PKRU: 55555554 <4> [104.685771] Call Trace: <4> [104.685772] <TASK> <4> [104.685775] ? lock_acquire+0x60/0x300 <4> [104.685780] ? lock_release+0xd0/0x2b0 <4> [104.685785] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.685791] process_one_work+0x239/0x740 <4> [104.685798] worker_thread+0x200/0x3f0 <4> [104.685801] ? __pfx_worker_thread+0x10/0x10 <4> [104.685803] kthread+0x10d/0x150 <4> [104.685806] ? __pfx_kthread+0x10/0x10 <4> [104.685808] ret_from_fork+0x3bd/0x470 <4> [104.685811] ? __pfx_kthread+0x10/0x10 <4> [104.685813] ret_from_fork_asm+0x1a/0x30 <4> [104.685821] </TASK> <4> [104.685822] irq event stamp: 1421515 <4> [104.685823] hardirqs last enabled at (1421521): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.685825] hardirqs last disabled at (1421526): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.685827] softirqs last enabled at (1418380): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.685830] softirqs last disabled at (1418371): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.685832] ---[ end trace 0000000000000000 ]--- <6> [104.685834] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.685912] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.685918] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.686153] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.686365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.686464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.686562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.686652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.686739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.686826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.686912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.687000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.687089] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.687190] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.687287] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.688349] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.699066] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.699347] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.700391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.700476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.700557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.700639] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.700719] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.700798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.700876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.700949] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.701024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.701117] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.701194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.701267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.701342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.701419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.701495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.701571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.701647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.701723] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.701798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.701883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.701967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.702049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.702148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.702229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.702308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.702386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.702464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.702544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.702624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.702705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.702784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.702862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.702941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.703020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.703114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.703199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.703284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.703365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.703444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.703522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.703601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.703680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.703756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.703835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.703913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.703989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.704078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.704156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.704232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.704310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.704387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.704463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.704539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.704619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.704697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.704775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.704853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.704929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.705004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.705092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.705170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.705249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.705324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.705399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.705477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.705554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.705631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.705706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.705784] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.705905] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.705910] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24726, lrc_seqno=24726, guc_id=0, flags=0x73 in no process [-1] <7> [104.705912] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.705980] ------------[ cut here ]------------ <4> [104.705981] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.705982] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:2/121 <4> [104.706066] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.706132] [last unloaded: snd_hda_intel] <4> [104.706136] CPU: 0 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.706138] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.706140] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.706141] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.706147] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.706222] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.706224] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [104.706226] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.706227] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.706229] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.706230] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.706231] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.706233] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [104.706234] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.706236] CR2: 0000743421427000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [104.706237] PKRU: 55555554 <4> [104.706238] Call Trace: <4> [104.706239] <TASK> <4> [104.706243] ? lock_acquire+0x60/0x300 <4> [104.706248] ? lock_release+0xd0/0x2b0 <4> [104.706253] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.706259] process_one_work+0x239/0x740 <4> [104.706265] worker_thread+0x200/0x3f0 <4> [104.706268] ? __pfx_worker_thread+0x10/0x10 <4> [104.706271] kthread+0x10d/0x150 <4> [104.706273] ? __pfx_kthread+0x10/0x10 <4> [104.706276] ret_from_fork+0x3bd/0x470 <4> [104.706278] ? __pfx_kthread+0x10/0x10 <4> [104.706281] ret_from_fork_asm+0x1a/0x30 <4> [104.706289] </TASK> <4> [104.706290] irq event stamp: 1424695 <4> [104.706291] hardirqs last enabled at (1424701): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.706293] hardirqs last disabled at (1424706): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.706295] softirqs last enabled at (1423708): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.706297] softirqs last disabled at (1423701): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.706300] ---[ end trace 0000000000000000 ]--- <6> [104.706302] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.706377] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.706383] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.706791] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.707005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.707104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.707198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.707287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.707372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.707459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.707545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.707632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.707715] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.707816] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.707910] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.708942] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.719065] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.719323] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.720459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.720546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.720627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.720705] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.720784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.720862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.720940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.721017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.721105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.721181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.721257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.721331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.721407] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.721483] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.721575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.721652] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.721729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.721805] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.721880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.721966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.722052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.722150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.722232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.722314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.722395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.722474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.722553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.722631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.722708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.722789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.722868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.722946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.723025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.723113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.723199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.723285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.723369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.723451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.723533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.723611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.723689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.723766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.723843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.723922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.724001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.724089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.724166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.724242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.724320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.724399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.724480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.724557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.724638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.724714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.724790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.724868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.724945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.725022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.725105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.725185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.725263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.725343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.725420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.725497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.725574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.725653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.725730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.725805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.725887] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.726005] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.726009] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24726, lrc_seqno=24726, guc_id=0, flags=0x73 in no process [-1] <7> [104.726012] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.726092] ------------[ cut here ]------------ <4> [104.726093] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.726095] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:2/121 <4> [104.726173] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.726237] [last unloaded: snd_hda_intel] <4> [104.726240] CPU: 0 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.726243] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.726244] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.726245] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.726251] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.726328] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.726330] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [104.726332] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.726334] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.726335] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.726336] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.726337] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.726339] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [104.726340] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.726341] CR2: 0000743421427000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [104.726343] PKRU: 55555554 <4> [104.726344] Call Trace: <4> [104.726345] <TASK> <4> [104.726349] ? lock_acquire+0x60/0x300 <4> [104.726354] ? lock_release+0xd0/0x2b0 <4> [104.726358] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.726364] process_one_work+0x239/0x740 <4> [104.726371] worker_thread+0x200/0x3f0 <4> [104.726374] ? __pfx_worker_thread+0x10/0x10 <4> [104.726376] kthread+0x10d/0x150 <4> [104.726379] ? __pfx_kthread+0x10/0x10 <4> [104.726382] ret_from_fork+0x3bd/0x470 <4> [104.726384] ? __pfx_kthread+0x10/0x10 <4> [104.726386] ret_from_fork_asm+0x1a/0x30 <4> [104.726394] </TASK> <4> [104.726395] irq event stamp: 1427855 <4> [104.726396] hardirqs last enabled at (1427861): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.726398] hardirqs last disabled at (1427866): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.726400] softirqs last enabled at (1426860): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.726403] softirqs last disabled at (1426853): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.726405] ---[ end trace 0000000000000000 ]--- <5> [104.726991] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24781, lrc_seqno=24781, guc_id=0, flags=0x73 in no process [-1] <7> [104.727000] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.727145] ------------[ cut here ]------------ <4> [104.727148] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.727149] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:6/205 <4> [104.727240] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.727314] [last unloaded: snd_hda_intel] <4> [104.727320] CPU: 10 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.727324] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.727326] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.727327] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.727336] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.727423] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.727425] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [104.727428] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.727430] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.727431] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.727432] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.727433] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.727435] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [104.727436] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.727438] CR2: 0000743421428000 CR3: 0000000140845005 CR4: 0000000000f72ef0 <4> [104.727439] PKRU: 55555554 <4> [104.727440] Call Trace: <4> [104.727441] <TASK> <4> [104.727445] ? lock_acquire+0x60/0x300 <4> [104.727452] ? lock_release+0xd0/0x2b0 <4> [104.727457] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.727464] process_one_work+0x239/0x740 <4> [104.727472] worker_thread+0x200/0x3f0 <4> [104.727475] ? __pfx_worker_thread+0x10/0x10 <4> [104.727478] kthread+0x10d/0x150 <4> [104.727480] ? __pfx_kthread+0x10/0x10 <4> [104.727483] ret_from_fork+0x3bd/0x470 <4> [104.727486] ? __pfx_kthread+0x10/0x10 <4> [104.727488] ret_from_fork_asm+0x1a/0x30 <4> [104.727496] </TASK> <4> [104.727498] irq event stamp: 1158713 <4> [104.727499] hardirqs last enabled at (1158719): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.727501] hardirqs last disabled at (1158724): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.727503] softirqs last enabled at (1157952): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.727506] softirqs last disabled at (1157947): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.727509] ---[ end trace 0000000000000000 ]--- <6> [104.727511] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.727596] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.727603] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.727769] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [104.727883] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [104.727992] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.728222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.728326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.728430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.728563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.728721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.728837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.728954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.729273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.729380] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.729487] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.729585] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.730626] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.741063] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.741324] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.742356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.742444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.742528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.742608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.742685] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.742763] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.742840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.742917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.742995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.743074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.743150] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.743226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.743303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.743378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.743454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.743529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.743604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.743680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.743755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.743841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.743926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.744009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.744099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.744181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.744260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.744337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.744414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.744491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.744567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.744646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.744725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.744803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.744882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.744960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.745044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.745138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.745221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.745301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.745380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.745457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.745533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.745609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.745685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.745762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.745841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.745920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.745998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.746079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.746155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.746233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.746313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.746390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.746467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.746543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.746619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.746696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.746772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.746848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.746924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.747003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.747090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.747171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.747249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.747326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.747404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.747479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.747554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.747630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.747710] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.747832] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.747836] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24781, lrc_seqno=24781, guc_id=0, flags=0x73 in no process [-1] <7> [104.747839] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.747906] ------------[ cut here ]------------ <4> [104.747908] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.747909] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:7/710 <4> [104.747994] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.748064] [last unloaded: snd_hda_intel] <4> [104.748068] CPU: 2 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.748071] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.748073] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.748074] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.748080] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.748156] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.748157] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [104.748160] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.748161] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.748162] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.748164] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.748165] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.748166] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [104.748168] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.748169] CR2: 00005baa6c47e018 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [104.748171] PKRU: 55555554 <4> [104.748172] Call Trace: <4> [104.748173] <TASK> <4> [104.748177] ? lock_acquire+0x60/0x300 <4> [104.748182] ? lock_release+0xd0/0x2b0 <4> [104.748187] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.748193] process_one_work+0x239/0x740 <4> [104.748200] worker_thread+0x200/0x3f0 <4> [104.748203] ? __pfx_worker_thread+0x10/0x10 <4> [104.748206] kthread+0x10d/0x150 <4> [104.748208] ? __pfx_kthread+0x10/0x10 <4> [104.748211] ret_from_fork+0x3bd/0x470 <4> [104.748213] ? __pfx_kthread+0x10/0x10 <4> [104.748216] ret_from_fork_asm+0x1a/0x30 <4> [104.748223] </TASK> <4> [104.748225] irq event stamp: 802109 <4> [104.748226] hardirqs last enabled at (802115): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.748228] hardirqs last disabled at (802120): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.748230] softirqs last enabled at (801212): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.748233] softirqs last disabled at (801207): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.748235] ---[ end trace 0000000000000000 ]--- <6> [104.749143] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.749292] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.749305] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.749497] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [104.749607] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [104.749719] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.749934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.750030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.750141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.750235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.750325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.750412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.750497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.750585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.750666] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.750765] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.750877] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.751912] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.762077] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.762335] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.763455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.763547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.763631] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.763712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.763791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.763870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.763948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.764025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.764116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.764195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.764271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.764348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.764425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.764501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.764578] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.764655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.764731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.764807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.764883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.764969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.765064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.765151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.765232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.765315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.765396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.765476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.765555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.765633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.765712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.765793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.765875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.765958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.766040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.766137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.766224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.766309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.766394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.766475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.766555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.766632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.766732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.766813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.766892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.766971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.767051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.767152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.767233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.767312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.767390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.767468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.767549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.767627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.767705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.767782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.767858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.767936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.768013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.768097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.768172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.768249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.768325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.768403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.768479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.768555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.768633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.768709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.768786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.768863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.768943] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.769066] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.769070] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24781, lrc_seqno=24781, guc_id=0, flags=0x73 in no process [-1] <7> [104.769073] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.769142] ------------[ cut here ]------------ <4> [104.769143] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.769144] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:2/121 <4> [104.769223] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.769289] [last unloaded: snd_hda_intel] <4> [104.769292] CPU: 0 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.769295] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.769297] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.769298] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.769304] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.769378] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.769380] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [104.769382] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.769383] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.769385] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.769386] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.769387] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.769388] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [104.769390] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.769391] CR2: 0000743421429000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [104.769393] PKRU: 55555554 <4> [104.769394] Call Trace: <4> [104.769395] <TASK> <4> [104.769399] ? lock_acquire+0x60/0x300 <4> [104.769404] ? lock_release+0xd0/0x2b0 <4> [104.769409] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.769415] process_one_work+0x239/0x740 <4> [104.769421] worker_thread+0x200/0x3f0 <4> [104.769424] ? __pfx_worker_thread+0x10/0x10 <4> [104.769427] kthread+0x10d/0x150 <4> [104.769429] ? __pfx_kthread+0x10/0x10 <4> [104.769432] ret_from_fork+0x3bd/0x470 <4> [104.769434] ? __pfx_kthread+0x10/0x10 <4> [104.769437] ret_from_fork_asm+0x1a/0x30 <4> [104.769445] </TASK> <4> [104.769446] irq event stamp: 1432967 <4> [104.769447] hardirqs last enabled at (1432973): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.769450] hardirqs last disabled at (1432978): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.769451] softirqs last enabled at (1431692): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.769454] softirqs last disabled at (1431687): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.769457] ---[ end trace 0000000000000000 ]--- <5> [104.770836] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24836, lrc_seqno=24836, guc_id=0, flags=0x73 in no process [-1] <7> [104.770840] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [104.771215] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [104.771328] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [104.771603] ------------[ cut here ]------------ <4> [104.771604] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.771606] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:2/121 <4> [104.771691] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.771758] [last unloaded: snd_hda_intel] <4> [104.771761] CPU: 0 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.771764] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.771765] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.771766] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.771772] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.771850] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.771852] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [104.771854] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.771856] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.771857] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.771858] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.771859] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.771861] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [104.771862] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.771864] CR2: 0000743421429000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [104.771865] PKRU: 55555554 <4> [104.771866] Call Trace: <4> [104.771867] <TASK> <4> [104.771871] ? lock_acquire+0x60/0x300 <4> [104.771876] ? lock_release+0xd0/0x2b0 <4> [104.771881] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.771887] process_one_work+0x239/0x740 <4> [104.771893] worker_thread+0x200/0x3f0 <4> [104.771896] ? __pfx_worker_thread+0x10/0x10 <4> [104.771899] kthread+0x10d/0x150 <4> [104.771901] ? __pfx_kthread+0x10/0x10 <4> [104.771904] ret_from_fork+0x3bd/0x470 <4> [104.771906] ? __pfx_kthread+0x10/0x10 <4> [104.771909] ret_from_fork_asm+0x1a/0x30 <4> [104.771916] </TASK> <4> [104.771918] irq event stamp: 1435377 <4> [104.771919] hardirqs last enabled at (1435383): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.771921] hardirqs last disabled at (1435388): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.771923] softirqs last enabled at (1431692): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.771925] softirqs last disabled at (1431687): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.771928] ---[ end trace 0000000000000000 ]--- <6> [104.771930] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.772008] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.772015] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.772092] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.772386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.772485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.772585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.772678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.772769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.772858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.772947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.773038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.773135] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.773237] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.773333] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.774369] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.785060] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.785320] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.786370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.786459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.786540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.786621] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.786700] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.786778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.786855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.786931] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.787008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.787096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.787172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.787248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.787324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.787401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.787477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.787552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.787627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.787702] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.787777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.787865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.787950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.788031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.788119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.788198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.788278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.788355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.788432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.788509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.788587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.788667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.788749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.788828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.788908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.788990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.789079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.789163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.789248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.789329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.789409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.789487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.789566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.789642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.789718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.789795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.789873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.789950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.790027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.790112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.790188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.790266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.790345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.790422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.790500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.790576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.790651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.790729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.790806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.790881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.790956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.791035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.791122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.791200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.791275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.791351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.791429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.791505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.791580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.791655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.791733] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.791855] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.791860] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24836, lrc_seqno=24836, guc_id=0, flags=0x73 in no process [-1] <7> [104.791862] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.791929] ------------[ cut here ]------------ <4> [104.791930] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.791931] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:7/710 <4> [104.792011] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.792080] [last unloaded: snd_hda_intel] <4> [104.792084] CPU: 10 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.792086] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.792087] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.792089] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.792095] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.792171] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.792173] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [104.792175] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.792176] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.792177] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.792179] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.792180] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.792181] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [104.792183] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.792184] CR2: 0000743421428000 CR3: 0000000126b65004 CR4: 0000000000f72ef0 <4> [104.792186] PKRU: 55555554 <4> [104.792187] Call Trace: <4> [104.792188] <TASK> <4> [104.792192] ? lock_acquire+0x60/0x300 <4> [104.792197] ? lock_release+0xd0/0x2b0 <4> [104.792202] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.792208] process_one_work+0x239/0x740 <4> [104.792214] worker_thread+0x200/0x3f0 <4> [104.792217] ? __pfx_worker_thread+0x10/0x10 <4> [104.792220] kthread+0x10d/0x150 <4> [104.792222] ? __pfx_kthread+0x10/0x10 <4> [104.792225] ret_from_fork+0x3bd/0x470 <4> [104.792227] ? __pfx_kthread+0x10/0x10 <4> [104.792230] ret_from_fork_asm+0x1a/0x30 <4> [104.792237] </TASK> <4> [104.792238] irq event stamp: 806457 <4> [104.792239] hardirqs last enabled at (806463): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.792241] hardirqs last disabled at (806468): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.792243] softirqs last enabled at (805292): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.792246] softirqs last disabled at (805285): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.792248] ---[ end trace 0000000000000000 ]--- <6> [104.792250] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.792325] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.792331] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.792738] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.792946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.793039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.793148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.793238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.793326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.793414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.793501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.793589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.793673] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.793774] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.793868] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.794901] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.805058] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.805317] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.806353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.806438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.806519] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.806599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.806677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.806753] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.806827] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.806902] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.806978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.807057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.807135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.807212] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.807288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.807363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.807440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.807516] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.807592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.807668] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.807743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.807828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.807913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.807994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.808078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.808159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.808238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.808316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.808396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.808476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.808553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.808634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.808714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.808792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.808870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.808947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.809030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.809120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.809204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.809288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.809371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.809449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.809526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.809601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.809677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.809754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.809831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.809907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.809986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.810065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.810140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.810216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.810295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.810370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.810446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.810521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.810597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.810673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.810749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.810824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.810899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.810979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.811058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.811135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.811210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.811283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.811360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.811436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.811511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.811586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.811662] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.811781] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.811785] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24836, lrc_seqno=24836, guc_id=0, flags=0x73 in no process [-1] <7> [104.811787] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.811854] ------------[ cut here ]------------ <4> [104.811855] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.811856] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:7/710 <4> [104.811938] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.812002] [last unloaded: snd_hda_intel] <4> [104.812005] CPU: 10 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.812008] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.812009] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.812010] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.812015] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.812099] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.812100] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [104.812103] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.812104] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.812106] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.812107] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.812108] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.812110] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [104.812112] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.812113] CR2: 0000743421428000 CR3: 0000000126b65004 CR4: 0000000000f72ef0 <4> [104.812115] PKRU: 55555554 <4> [104.812116] Call Trace: <4> [104.812117] <TASK> <4> [104.812121] ? lock_acquire+0x60/0x300 <4> [104.812126] ? lock_release+0xd0/0x2b0 <4> [104.812131] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.812137] process_one_work+0x239/0x740 <4> [104.812143] worker_thread+0x200/0x3f0 <4> [104.812147] ? __pfx_worker_thread+0x10/0x10 <4> [104.812149] kthread+0x10d/0x150 <4> [104.812151] ? __pfx_kthread+0x10/0x10 <4> [104.812154] ret_from_fork+0x3bd/0x470 <4> [104.812157] ? __pfx_kthread+0x10/0x10 <4> [104.812159] ret_from_fork_asm+0x1a/0x30 <4> [104.812167] </TASK> <4> [104.812168] irq event stamp: 809619 <4> [104.812169] hardirqs last enabled at (809625): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.812172] hardirqs last disabled at (809630): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.812173] softirqs last enabled at (808722): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.812176] softirqs last disabled at (808715): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.812179] ---[ end trace 0000000000000000 ]--- <7> [104.813205] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <5> [104.813309] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24891, lrc_seqno=24891, guc_id=0, flags=0x73 in no process [-1] <7> [104.813314] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [104.813316] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [104.813391] ------------[ cut here ]------------ <4> [104.813392] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.813394] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:2/121 <4> [104.813478] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.813543] [last unloaded: snd_hda_intel] <4> [104.813547] CPU: 0 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.813550] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.813551] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.813552] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.813558] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.813637] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.813639] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [104.813642] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.813643] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.813644] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.813646] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.813647] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.813648] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [104.813650] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.813651] CR2: 0000743421429000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [104.813653] PKRU: 55555554 <4> [104.813654] Call Trace: <4> [104.813655] <TASK> <4> [104.813659] ? lock_acquire+0x60/0x300 <4> [104.813664] ? lock_release+0xd0/0x2b0 <4> [104.813669] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.813675] process_one_work+0x239/0x740 <4> [104.813682] worker_thread+0x200/0x3f0 <4> [104.813685] ? __pfx_worker_thread+0x10/0x10 <4> [104.813688] kthread+0x10d/0x150 <4> [104.813690] ? __pfx_kthread+0x10/0x10 <4> [104.813693] ret_from_fork+0x3bd/0x470 <4> [104.813695] ? __pfx_kthread+0x10/0x10 <4> [104.813698] ret_from_fork_asm+0x1a/0x30 <4> [104.813705] </TASK> <4> [104.813706] irq event stamp: 1437879 <4> [104.813708] hardirqs last enabled at (1437885): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.813710] hardirqs last disabled at (1437890): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.813711] softirqs last enabled at (1436390): [<ffffffff8133ad53>] kernel_fpu_end+0x53/0x70 <4> [104.813714] softirqs last disabled at (1436388): [<ffffffff8133b464>] kernel_fpu_begin_mask+0xc4/0x120 <4> [104.813717] ---[ end trace 0000000000000000 ]--- <6> [104.813718] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.813797] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.813805] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.814054] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.814327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.814417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.814511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.814599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.814686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.814773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.814860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.814951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.815036] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.815145] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.815237] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.816269] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.826057] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.826314] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.827330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.827415] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.827495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.827577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.827657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.827736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.827816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.827895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.827973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.828055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.828132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.828209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.828285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.828361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.828437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.828512] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.828587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.828666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.828742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.828827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.828910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.828992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.829074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.829155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.829234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.829311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.829387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.829463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.829540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.829617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.829696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.829773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.829851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.829929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.830013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.830107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.830191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.830272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.830351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.830426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.830504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.830579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.830655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.830733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.830813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.830894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.830975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.831057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.831134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.831212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.831294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.831370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.831445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.831521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.831596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.831674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.831749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.831822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.831897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.831975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.832054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.832131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.832207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.832283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.832360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.832436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.832510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.832585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.832663] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.832782] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.832787] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24891, lrc_seqno=24891, guc_id=0, flags=0x73 in no process [-1] <7> [104.832789] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.832857] ------------[ cut here ]------------ <4> [104.832858] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.832859] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:6/205 <4> [104.832945] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.833008] [last unloaded: snd_hda_intel] <4> [104.833011] CPU: 10 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.833014] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.833015] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.833017] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.833022] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.833105] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.833107] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [104.833110] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.833111] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.833113] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.833114] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.833115] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.833117] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [104.833119] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.833120] CR2: 0000743421428000 CR3: 0000000126b65004 CR4: 0000000000f72ef0 <4> [104.833122] PKRU: 55555554 <4> [104.833123] Call Trace: <4> [104.833124] <TASK> <4> [104.833128] ? lock_acquire+0x60/0x300 <4> [104.833133] ? lock_release+0xd0/0x2b0 <4> [104.833138] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.833144] process_one_work+0x239/0x740 <4> [104.833151] worker_thread+0x200/0x3f0 <4> [104.833154] ? __pfx_worker_thread+0x10/0x10 <4> [104.833157] kthread+0x10d/0x150 <4> [104.833159] ? __pfx_kthread+0x10/0x10 <4> [104.833162] ret_from_fork+0x3bd/0x470 <4> [104.833164] ? __pfx_kthread+0x10/0x10 <4> [104.833166] ret_from_fork_asm+0x1a/0x30 <4> [104.833174] </TASK> <4> [104.833175] irq event stamp: 1163239 <4> [104.833176] hardirqs last enabled at (1163245): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.833178] hardirqs last disabled at (1163250): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.833180] softirqs last enabled at (1162256): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.833183] softirqs last disabled at (1162249): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.833186] ---[ end trace 0000000000000000 ]--- <6> [104.834079] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.834187] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.834201] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.834220] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [104.834332] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [104.834442] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.834656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.834755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.834853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.834944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.835031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.835129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.835215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.835303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.835386] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.835487] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.835581] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.836613] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.847055] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.847312] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.848321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.848405] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.848486] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.848567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.848648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.848726] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.848803] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.848879] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.848955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.849030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.849117] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.849193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.849269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.849344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.849420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.849497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.849573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.849648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.849723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.849808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.849891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.849972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.850056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.850137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.850215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.850293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.850370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.850449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.850529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.850611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.850691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.850769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.850847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.850927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.851012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.851104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.851188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.851270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.851350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.851428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.851505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.851582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.851658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.851736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.851814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.851891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.851970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.852053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.852135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.852213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.852293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.852370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.852448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.852526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.852603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.852681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.852757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.852834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.852910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.852987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.853067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.853144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.853221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.853297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.853375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.853451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.853528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.853604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.853686] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.853807] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.853811] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24891, lrc_seqno=24891, guc_id=0, flags=0x73 in no process [-1] <7> [104.853814] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.853881] ------------[ cut here ]------------ <4> [104.853882] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.853883] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:2/121 <4> [104.853971] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.854036] [last unloaded: snd_hda_intel] <4> [104.854039] CPU: 0 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.854042] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.854043] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.854044] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.854054] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.854130] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.854132] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [104.854134] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.854136] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.854137] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.854138] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.854139] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.854141] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [104.854142] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.854144] CR2: 0000743421429000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [104.854145] PKRU: 55555554 <4> [104.854146] Call Trace: <4> [104.854147] <TASK> <4> [104.854152] ? lock_acquire+0x60/0x300 <4> [104.854157] ? lock_release+0xd0/0x2b0 <4> [104.854161] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.854167] process_one_work+0x239/0x740 <4> [104.854174] worker_thread+0x200/0x3f0 <4> [104.854177] ? __pfx_worker_thread+0x10/0x10 <4> [104.854180] kthread+0x10d/0x150 <4> [104.854182] ? __pfx_kthread+0x10/0x10 <4> [104.854185] ret_from_fork+0x3bd/0x470 <4> [104.854187] ? __pfx_kthread+0x10/0x10 <4> [104.854190] ret_from_fork_asm+0x1a/0x30 <4> [104.854197] </TASK> <4> [104.854198] irq event stamp: 1442137 <4> [104.854200] hardirqs last enabled at (1442143): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.854202] hardirqs last disabled at (1442148): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.854204] softirqs last enabled at (1440970): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.854206] softirqs last disabled at (1440963): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.854209] ---[ end trace 0000000000000000 ]--- <7> [104.855233] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [104.855346] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [104.855546] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24946, lrc_seqno=24946, guc_id=0, flags=0x73 in no process [-1] <7> [104.855552] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.855663] ------------[ cut here ]------------ <4> [104.855666] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.855668] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:2/121 <4> [104.855793] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.855922] [last unloaded: snd_hda_intel] <4> [104.855928] CPU: 4 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.855932] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.855935] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.855937] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.855946] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.856071] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.856074] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [104.856079] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.856082] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.856084] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.856087] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.856089] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.856091] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [104.856094] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.856097] CR2: 000074342142a000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [104.856099] PKRU: 55555554 <4> [104.856102] Call Trace: <4> [104.856104] <TASK> <4> [104.856111] ? lock_acquire+0x60/0x300 <4> [104.856120] ? lock_release+0xd0/0x2b0 <4> [104.856129] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.856140] process_one_work+0x239/0x740 <4> [104.856152] worker_thread+0x200/0x3f0 <4> [104.856157] ? __pfx_worker_thread+0x10/0x10 <4> [104.856162] kthread+0x10d/0x150 <4> [104.856166] ? __pfx_kthread+0x10/0x10 <4> [104.856171] ret_from_fork+0x3bd/0x470 <4> [104.856175] ? __pfx_kthread+0x10/0x10 <4> [104.856180] ret_from_fork_asm+0x1a/0x30 <4> [104.856192] </TASK> <4> [104.856195] irq event stamp: 1443657 <4> [104.856196] hardirqs last enabled at (1443663): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.856200] hardirqs last disabled at (1443668): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.856203] softirqs last enabled at (1440970): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.856207] softirqs last disabled at (1440963): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.856212] ---[ end trace 0000000000000000 ]--- <6> [104.856215] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.856336] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.856346] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.856472] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.856732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.856877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.857022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.857181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.857316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.857453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.857590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.857732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.857865] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.858012] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.858174] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.859325] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.870060] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.870323] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.871390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.871479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.871561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.871643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.871725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.871806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.871885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.871963] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.872041] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.872136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.872213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.872289] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.872364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.872440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.872517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.872593] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.872668] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.872744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.872819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.872906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.872991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.873079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.873160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.873241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.873319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.873395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.873472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.873548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.873626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.873704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.873783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.873861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.873940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.874017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.874108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.874193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.874277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.874358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.874437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.874514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.874592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.874668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.874744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.874821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.874899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.874977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.875059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.875140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.875217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.875297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.875377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.875454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.875534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.875609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.875685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.875763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.875840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.875918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.875993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.876097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.876177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.876257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.876335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.876413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.876490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.876568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.876645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.876721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.876800] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.876922] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.876927] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24946, lrc_seqno=24946, guc_id=0, flags=0x73 in no process [-1] <7> [104.876929] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.877015] ------------[ cut here ]------------ <4> [104.877016] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.877018] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:2/121 <4> [104.877123] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.877189] [last unloaded: snd_hda_intel] <4> [104.877192] CPU: 4 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.877195] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.877197] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.877198] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.877204] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.877281] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.877283] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [104.877285] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.877287] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.877288] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.877289] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.877290] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.877292] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [104.877293] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.877294] CR2: 000074342142a000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [104.877296] PKRU: 55555554 <4> [104.877297] Call Trace: <4> [104.877298] <TASK> <4> [104.877302] ? lock_acquire+0x60/0x300 <4> [104.877307] ? lock_release+0xd0/0x2b0 <4> [104.877312] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.877318] process_one_work+0x239/0x740 <4> [104.877327] worker_thread+0x200/0x3f0 <4> [104.877330] ? __pfx_worker_thread+0x10/0x10 <4> [104.877332] kthread+0x10d/0x150 <4> [104.877334] ? __pfx_kthread+0x10/0x10 <4> [104.877337] ret_from_fork+0x3bd/0x470 <4> [104.877340] ? __pfx_kthread+0x10/0x10 <4> [104.877342] ret_from_fork_asm+0x1a/0x30 <4> [104.877350] </TASK> <4> [104.877351] irq event stamp: 1446831 <4> [104.877352] hardirqs last enabled at (1446837): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.877354] hardirqs last disabled at (1446842): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.877356] softirqs last enabled at (1445928): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.877359] softirqs last disabled at (1445923): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.877361] ---[ end trace 0000000000000000 ]--- <6> [104.877363] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.877439] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.877445] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.878714] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [104.878825] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [104.878934] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.879154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.879256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.879355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.879447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.879536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.879624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.879714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.879804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.879891] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.879992] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.880112] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.881168] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.891900] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.892159] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.893170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.893255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.893336] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.893417] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.893497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.893576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.893657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.893736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.893813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.893889] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.893966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.894041] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.894155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.894232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.894306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.894381] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.894457] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.894532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.894607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.894694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.894778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.894859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.894937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.895015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.895135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.895214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.895291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.895367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.895443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.895521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.895600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.895735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.895851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.895933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.896019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.896116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.896201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.896282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.896362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.896440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.896518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.896595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.896672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.896750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.896829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.896907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.896984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.897071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.897149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.897228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.897309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.897386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.897464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.897541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.897616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.897693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.897770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.897846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.897922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.898001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.898089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.898168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.898245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.898322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.898400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.898476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.898552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.898628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.898707] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.898829] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.898834] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=24946, lrc_seqno=24946, guc_id=0, flags=0x73 in no process [-1] <7> [104.898836] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.898905] ------------[ cut here ]------------ <4> [104.898907] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.898909] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:6/205 <4> [104.898987] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.899312] [last unloaded: snd_hda_intel] <4> [104.899316] CPU: 11 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.899319] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.899321] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.899322] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.899329] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.899411] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.899413] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [104.899415] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.899416] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.899418] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.899419] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.899420] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.899421] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [104.899423] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.899424] CR2: 00007b64f6ab2000 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [104.899426] PKRU: 55555554 <4> [104.899427] Call Trace: <4> [104.899428] <TASK> <4> [104.899432] ? lock_acquire+0x60/0x300 <4> [104.899437] ? lock_release+0xd0/0x2b0 <4> [104.899442] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.899448] process_one_work+0x239/0x740 <4> [104.899455] worker_thread+0x200/0x3f0 <4> [104.899458] ? __pfx_worker_thread+0x10/0x10 <4> [104.899461] kthread+0x10d/0x150 <4> [104.899463] ? __pfx_kthread+0x10/0x10 <4> [104.899466] ret_from_fork+0x3bd/0x470 <4> [104.899468] ? __pfx_kthread+0x10/0x10 <4> [104.899471] ret_from_fork_asm+0x1a/0x30 <4> [104.899479] </TASK> <4> [104.899480] irq event stamp: 1166833 <4> [104.899481] hardirqs last enabled at (1166839): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.899483] hardirqs last disabled at (1166844): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.899485] softirqs last enabled at (1165936): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.899488] softirqs last disabled at (1165929): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.899490] ---[ end trace 0000000000000000 ]--- <5> [104.900659] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25001, lrc_seqno=25001, guc_id=0, flags=0x73 in no process [-1] <7> [104.900663] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [104.900683] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [104.900741] ------------[ cut here ]------------ <4> [104.900742] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.900744] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:6/205 <4> [104.900831] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr <7> [104.900798] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [104.900850] intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [104.900899] CPU: 2 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.900902] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.900903] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.900905] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.900911] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.900992] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.900994] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [104.900997] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.900998] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.900999] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.901001] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.901002] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.901003] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [104.901005] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.901006] CR2: 00005baa6c47e018 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [104.901008] PKRU: 55555554 <4> [104.901009] Call Trace: <4> [104.901010] <TASK> <4> [104.901014] ? lock_acquire+0x60/0x300 <4> [104.901019] ? lock_release+0xd0/0x2b0 <4> [104.901024] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.901030] process_one_work+0x239/0x740 <4> [104.901037] worker_thread+0x200/0x3f0 <4> [104.901040] ? __pfx_worker_thread+0x10/0x10 <4> [104.901049] kthread+0x10d/0x150 <4> [104.901052] ? __pfx_kthread+0x10/0x10 <4> [104.901055] ret_from_fork+0x3bd/0x470 <4> [104.901058] ? __pfx_kthread+0x10/0x10 <4> [104.901061] ret_from_fork_asm+0x1a/0x30 <4> [104.901068] </TASK> <4> [104.901070] irq event stamp: 1168743 <4> [104.901071] hardirqs last enabled at (1168749): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.901073] hardirqs last disabled at (1168754): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.901075] softirqs last enabled at (1165936): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.901078] softirqs last disabled at (1165929): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.901080] ---[ end trace 0000000000000000 ]--- <6> [104.901083] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.901161] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.901168] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.901219] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.901535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.901634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.901731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.901822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.901910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.901998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.902099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.902189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.902273] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.902374] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.902468] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.903506] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.914050] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.914310] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.915352] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.915437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.915517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.915596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.915677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.915760] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.915838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.915916] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.915991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.916073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.916148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.916225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.916299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.916374] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.916449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.916525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.916599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.916673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.916746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.916831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.916915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.916996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.917089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.917169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.917249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.917327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.917405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.917481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.917559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.917638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.917720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.917799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.917879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.917957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.918046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.918131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.918215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.918295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.918376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.918453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.918532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.918610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.918687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.918766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.918850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.918932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.919013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.919104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.919182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.919259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.919339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.919416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.919496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.919573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.919648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.919724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.919802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.919877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.919953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.920031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.920124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.920202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.920279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.920354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.920432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.920509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.920585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.920660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.920739] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.920859] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.920864] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25001, lrc_seqno=25001, guc_id=0, flags=0x73 in no process [-1] <7> [104.920866] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.920934] ------------[ cut here ]------------ <4> [104.920936] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.920937] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:2/121 <4> [104.921015] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.921090] [last unloaded: snd_hda_intel] <4> [104.921093] CPU: 0 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.921096] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.921097] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.921098] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.921104] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.921179] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.921181] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [104.921183] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.921185] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.921186] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.921187] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.921188] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.921190] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [104.921191] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.921193] CR2: 0000743421429000 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [104.921194] PKRU: 55555554 <4> [104.921195] Call Trace: <4> [104.921196] <TASK> <4> [104.921200] ? lock_acquire+0x60/0x300 <4> [104.921205] ? lock_release+0xd0/0x2b0 <4> [104.921210] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.921216] process_one_work+0x239/0x740 <4> [104.921223] worker_thread+0x200/0x3f0 <4> [104.921226] ? __pfx_worker_thread+0x10/0x10 <4> [104.921229] kthread+0x10d/0x150 <4> [104.921231] ? __pfx_kthread+0x10/0x10 <4> [104.921234] ret_from_fork+0x3bd/0x470 <4> [104.921236] ? __pfx_kthread+0x10/0x10 <4> [104.921239] ret_from_fork_asm+0x1a/0x30 <4> [104.921246] </TASK> <4> [104.921248] irq event stamp: 1450389 <4> [104.921249] hardirqs last enabled at (1450395): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.921251] hardirqs last disabled at (1450400): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.921253] softirqs last enabled at (1449408): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.921255] softirqs last disabled at (1449401): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.921258] ---[ end trace 0000000000000000 ]--- <6> [104.922106] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.922246] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.922258] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.922523] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [104.922632] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [104.922741] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.922958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.923067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.923168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.923258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.923348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.923435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.923521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.923608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.923693] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.923791] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.923885] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.924923] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.935052] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.935314] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.936314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.936417] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.936506] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.936592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.936675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.936755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.936835] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.936914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.936991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.937084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.937162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.937239] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.937317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.937393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.937469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.937546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.937622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.937699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.937774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.937864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.937953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.938035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.938129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.938208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.938290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.938368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.938445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.938522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.938599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.938678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.938760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.938841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.938919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.938998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.939090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.939173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.939256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.939337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.939416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.939492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.939570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.939646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.939722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.939799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.939878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.939956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.940038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.940130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.940208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.940287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.940367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.940445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.940523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.940600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.940676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.940753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.940829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.940904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.940978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.941061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.941137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.941214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.941291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.941367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.941444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.941523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.941598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.941674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.941753] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.941877] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.942736] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25001, lrc_seqno=25001, guc_id=0, flags=0x73 in no process [-1] <7> [104.942739] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.942811] ------------[ cut here ]------------ <4> [104.942813] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.942814] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:2/121 <4> [104.942894] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.942962] [last unloaded: snd_hda_intel] <4> [104.942966] CPU: 4 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.942969] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.942970] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.942972] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.942978] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.943059] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.943061] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [104.943063] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.943065] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.943067] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.943068] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.943069] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.943071] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [104.943072] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.943073] CR2: 00007071c0db4059 CR3: 00000001322f1002 CR4: 0000000000f72ef0 <4> [104.943075] PKRU: 55555554 <4> [104.943076] Call Trace: <4> [104.943077] <TASK> <4> [104.943081] ? lock_acquire+0x60/0x300 <4> [104.943087] ? lock_release+0xd0/0x2b0 <4> [104.943092] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.943098] process_one_work+0x239/0x740 <4> [104.943105] worker_thread+0x200/0x3f0 <4> [104.943108] ? __pfx_worker_thread+0x10/0x10 <4> [104.943111] kthread+0x10d/0x150 <4> [104.943113] ? __pfx_kthread+0x10/0x10 <4> [104.943116] ret_from_fork+0x3bd/0x470 <4> [104.943118] ? __pfx_kthread+0x10/0x10 <4> [104.943121] ret_from_fork_asm+0x1a/0x30 <4> [104.943129] </TASK> <4> [104.943130] irq event stamp: 1453565 <4> [104.943131] hardirqs last enabled at (1453571): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.943134] hardirqs last disabled at (1453576): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.943136] softirqs last enabled at (1452658): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.943139] softirqs last disabled at (1452643): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.943142] ---[ end trace 0000000000000000 ]--- <7> [104.943511] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [104.943623] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [104.943685] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25056, lrc_seqno=25056, guc_id=0, flags=0x73 in no process [-1] <7> [104.943690] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.943764] ------------[ cut here ]------------ <4> [104.943766] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.943767] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [104.943850] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.943916] [last unloaded: snd_hda_intel] <4> [104.943920] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.943923] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.943924] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.943925] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.943931] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.944009] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.944011] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [104.944013] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.944014] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.944016] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.944017] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.944018] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.944019] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [104.944021] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.944022] CR2: 0000743421428000 CR3: 00000001322f1001 CR4: 0000000000f72ef0 <4> [104.944024] PKRU: 55555554 <4> [104.944025] Call Trace: <4> [104.944026] <TASK> <4> [104.944030] ? lock_acquire+0x60/0x300 <4> [104.944036] ? lock_release+0xd0/0x2b0 <4> [104.944045] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.944051] process_one_work+0x239/0x740 <4> [104.944058] worker_thread+0x200/0x3f0 <4> [104.944061] ? __pfx_worker_thread+0x10/0x10 <4> [104.944064] kthread+0x10d/0x150 <4> [104.944067] ? __pfx_kthread+0x10/0x10 <4> [104.944070] ret_from_fork+0x3bd/0x470 <4> [104.944072] ? __pfx_kthread+0x10/0x10 <4> [104.944075] ret_from_fork_asm+0x1a/0x30 <4> [104.944083] </TASK> <4> [104.944084] irq event stamp: 1455437 <4> [104.944085] hardirqs last enabled at (1455443): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.944088] hardirqs last disabled at (1455448): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.944089] softirqs last enabled at (1452658): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.944093] softirqs last disabled at (1452643): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.944096] ---[ end trace 0000000000000000 ]--- <6> [104.944097] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.944174] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.944180] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.944406] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.944616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.944714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.944813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.944906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.944993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.945092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.945183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.945273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.945357] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.945457] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.945551] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.946593] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.957047] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.957304] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.958316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.958403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.958484] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.958566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.958648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.958729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.958807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.958885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.958963] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.959045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.959123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.959199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.959275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.959351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.959427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.959503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.959577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.959653] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.959728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.959814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.959899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.959981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.960068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.960151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.960236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.960317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.960398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.960479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.960557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.960638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.960718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.960798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.960877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.960958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.961048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.961132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.961216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.961297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.961379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.961455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.961532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.961608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.961684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.961760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.961838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.961915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.961991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.962074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.962150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.962226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.962304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.962382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.962458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.962533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.962608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.962684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.962760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.962835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.962909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.962986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.963069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.963146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.963238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.963316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.963394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.963471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.963546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.963622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.963701] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.963821] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.963825] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25056, lrc_seqno=25056, guc_id=0, flags=0x73 in no process [-1] <7> [104.963828] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.963895] ------------[ cut here ]------------ <4> [104.963896] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.963897] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:2/121 <4> [104.963975] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.964042] [last unloaded: snd_hda_intel] <4> [104.964045] CPU: 4 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.964048] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.964049] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.964051] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.964056] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.964133] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.964135] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [104.964137] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.964139] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.964140] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.964141] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.964142] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.964144] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [104.964145] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.964147] CR2: 00007071c0db4059 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [104.964148] PKRU: 55555554 <4> [104.964149] Call Trace: <4> [104.964150] <TASK> <4> [104.964154] ? lock_acquire+0x60/0x300 <4> [104.964159] ? lock_release+0xd0/0x2b0 <4> [104.964164] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.964170] process_one_work+0x239/0x740 <4> [104.964176] worker_thread+0x200/0x3f0 <4> [104.964179] ? __pfx_worker_thread+0x10/0x10 <4> [104.964182] kthread+0x10d/0x150 <4> [104.964184] ? __pfx_kthread+0x10/0x10 <4> [104.964187] ret_from_fork+0x3bd/0x470 <4> [104.964189] ? __pfx_kthread+0x10/0x10 <4> [104.964192] ret_from_fork_asm+0x1a/0x30 <4> [104.964200] </TASK> <4> [104.964201] irq event stamp: 1458623 <4> [104.964202] hardirqs last enabled at (1458629): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.964204] hardirqs last disabled at (1458634): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.964206] softirqs last enabled at (1457728): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.964208] softirqs last disabled at (1457721): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.964211] ---[ end trace 0000000000000000 ]--- <6> [104.964213] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [104.964289] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.964295] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.965538] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [104.965650] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [104.965761] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.965984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.966096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.966198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.966293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.966381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.966468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.966555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.966642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.966726] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.966826] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.966920] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.967956] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [104.978047] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [104.978305] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [104.979341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [104.979427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [104.979508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [104.979590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [104.979671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [104.979752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [104.979832] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [104.979911] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [104.979989] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [104.980079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [104.980156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [104.980232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [104.980309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [104.980385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [104.980461] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [104.980537] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [104.980613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [104.980690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [104.980764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [104.980848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [104.980931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [104.981014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [104.981101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [104.981183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [104.981263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [104.981342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [104.981420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [104.981497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [104.981573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [104.981652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [104.981731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [104.981810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [104.981889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [104.981969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [104.982055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [104.982140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [104.982224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [104.982304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [104.982384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [104.982460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [104.982537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [104.982613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [104.982688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [104.982765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [104.982844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [104.982920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [104.982998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [104.983083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [104.983160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [104.983236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [104.983316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [104.983393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [104.983470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [104.983545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [104.983620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [104.983695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [104.983771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [104.983845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [104.983920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [104.983997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [104.984080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [104.984158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [104.984234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [104.984311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [104.984389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [104.984465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [104.984539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [104.984615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [104.984694] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [104.984818] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [104.984822] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25056, lrc_seqno=25056, guc_id=0, flags=0x73 in no process [-1] <7> [104.984825] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.984894] ------------[ cut here ]------------ <4> [104.984895] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.984896] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:6/205 <4> [104.984977] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.985046] [last unloaded: snd_hda_intel] <4> [104.985050] CPU: 2 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.985053] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.985054] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.985056] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.985061] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.985138] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.985139] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [104.985142] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.985143] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.985144] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.985146] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.985147] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.985148] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [104.985150] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.985151] CR2: 00005baa6c47e018 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [104.985153] PKRU: 55555554 <4> [104.985154] Call Trace: <4> [104.985155] <TASK> <4> [104.985159] ? lock_acquire+0x60/0x300 <4> [104.985164] ? lock_release+0xd0/0x2b0 <4> [104.985169] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.985175] process_one_work+0x239/0x740 <4> [104.985181] worker_thread+0x200/0x3f0 <4> [104.985184] ? __pfx_worker_thread+0x10/0x10 <4> [104.985187] kthread+0x10d/0x150 <4> [104.985189] ? __pfx_kthread+0x10/0x10 <4> [104.985192] ret_from_fork+0x3bd/0x470 <4> [104.985194] ? __pfx_kthread+0x10/0x10 <4> [104.985197] ret_from_fork_asm+0x1a/0x30 <4> [104.985205] </TASK> <4> [104.985206] irq event stamp: 1175321 <4> [104.985207] hardirqs last enabled at (1175327): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.985209] hardirqs last disabled at (1175332): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.985211] softirqs last enabled at (1174156): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.985214] softirqs last disabled at (1174149): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.985216] ---[ end trace 0000000000000000 ]--- <5> [104.985674] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25111, lrc_seqno=25111, guc_id=0, flags=0x73 in no process [-1] <7> [104.985869] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [104.986226] ------------[ cut here ]------------ <4> [104.986230] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [104.986234] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:6/205 <4> [104.986612] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [104.986713] [last unloaded: snd_hda_intel] <4> [104.986716] CPU: 3 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [104.986719] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [104.986721] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [104.986722] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [104.986727] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [104.986823] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [104.986825] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [104.986828] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [104.986830] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [104.986833] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [104.986835] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [104.986837] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [104.986839] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000 <4> [104.986842] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [104.986844] CR2: 00007b64f7be62f4 CR3: 000000000344a002 CR4: 0000000000f72ef0 <4> [104.986846] PKRU: 55555554 <4> [104.986848] Call Trace: <4> [104.986850] <TASK> <4> [104.986857] ? lock_acquire+0x60/0x300 <4> [104.986866] ? lock_release+0xd0/0x2b0 <7> [104.986790] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [104.986874] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [104.986884] process_one_work+0x239/0x740 <4> [104.986894] worker_thread+0x200/0x3f0 <4> [104.986898] ? __pfx_worker_thread+0x10/0x10 <4> [104.986901] kthread+0x10d/0x150 <4> [104.986904] ? __pfx_kthread+0x10/0x10 <4> [104.986909] ret_from_fork+0x3bd/0x470 <4> [104.986912] ? __pfx_kthread+0x10/0x10 <4> [104.986916] ret_from_fork_asm+0x1a/0x30 <4> [104.986929] </TASK> <4> [104.986931] irq event stamp: 1177201 <4> [104.986932] hardirqs last enabled at (1177207): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [104.986935] hardirqs last disabled at (1177212): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [104.986938] softirqs last enabled at (1176440): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.986942] softirqs last disabled at (1176433): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [104.986945] ---[ end trace 0000000000000000 ]--- <6> [104.986948] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [104.986958] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [104.987087] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [104.987095] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [104.987332] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [104.987545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [104.987640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [104.987738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [104.987829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [104.987918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [104.988005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [104.988104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [104.988193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [104.988276] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [104.988377] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [104.988470] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [104.989505] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.000045] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.000302] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.001380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.001465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.001546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.001627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.001706] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.001787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.001864] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.001941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.002018] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.002132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.002207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.002282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.002358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.002434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.002510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.002585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.002660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.002734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.002808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.002893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.002977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.003065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.003145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.003225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.003303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.003379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.003455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.003532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.003608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.003686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.003769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.003848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.003930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.004008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.004104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.004190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.004275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.004356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.004437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.004518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.004596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.004675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.004752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.004830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.004909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.004986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.005076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.005154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.005230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.005308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.005389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.005464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.005542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.005619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.005695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.005773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.005851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.005926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.006001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.006091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.006169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.006246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.006323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.006400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.006478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.006555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.006631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.006707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.006787] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.006908] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.006912] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25111, lrc_seqno=25111, guc_id=0, flags=0x73 in no process [-1] <7> [105.006915] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.006982] ------------[ cut here ]------------ <4> [105.006983] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.006985] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:6/205 <4> [105.007074] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.007139] [last unloaded: snd_hda_intel] <4> [105.007143] CPU: 3 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.007146] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.007147] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.007149] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.007154] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.007231] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.007232] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [105.007235] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.007236] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.007237] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.007238] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.007240] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.007241] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000 <4> [105.007243] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.007244] CR2: 00007b64f7be62f4 CR3: 000000000344a002 CR4: 0000000000f72ef0 <4> [105.007246] PKRU: 55555554 <4> [105.007247] Call Trace: <4> [105.007248] <TASK> <4> [105.007252] ? lock_acquire+0x60/0x300 <4> [105.007257] ? lock_release+0xd0/0x2b0 <4> [105.007261] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.007268] process_one_work+0x239/0x740 <4> [105.007274] worker_thread+0x200/0x3f0 <4> [105.007277] ? __pfx_worker_thread+0x10/0x10 <4> [105.007280] kthread+0x10d/0x150 <4> [105.007282] ? __pfx_kthread+0x10/0x10 <4> [105.007285] ret_from_fork+0x3bd/0x470 <4> [105.007287] ? __pfx_kthread+0x10/0x10 <4> [105.007290] ret_from_fork_asm+0x1a/0x30 <4> [105.007298] </TASK> <4> [105.007299] irq event stamp: 1180525 <4> [105.007300] hardirqs last enabled at (1180531): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.007302] hardirqs last disabled at (1180536): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.007304] softirqs last enabled at (1179354): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.007307] softirqs last disabled at (1179347): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.007309] ---[ end trace 0000000000000000 ]--- <6> [105.007311] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.007387] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.007393] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.008631] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [105.008742] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [105.008851] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.009069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.009167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.009264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.009354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.009441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.009526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.009612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.009698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.009780] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.009879] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.009974] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.011011] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.021041] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.021298] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.022293] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.022379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.022460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.022541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.022621] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.022699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.022776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.022853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.022929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.023005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.023105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.023183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.023259] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.023335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.023411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.023488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.023564] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.023640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.023716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.023802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.023886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.023968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.024053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.024135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.024215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.024293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.024371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.024449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.024527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.024609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.024694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.024774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.024853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.024932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.025018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.025114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.025200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.025281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.025361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.025438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.025516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.025593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.025669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.025746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.025824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.025901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.025977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.026056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.026130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.026206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.026285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.026360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.026436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.026512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.026587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.026664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.026741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.026815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.026891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.026969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.027048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.027124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.027200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.027276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.027354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.027431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.027506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.027581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.027659] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.027779] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.027783] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25111, lrc_seqno=25111, guc_id=0, flags=0x73 in no process [-1] <7> [105.027786] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.027853] ------------[ cut here ]------------ <4> [105.027854] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.027855] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:2/121 <4> [105.027939] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.028003] [last unloaded: snd_hda_intel] <4> [105.028007] CPU: 4 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.028010] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.028011] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.028012] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.028018] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.028106] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.028108] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [105.028111] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.028112] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.028114] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.028115] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.028117] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.028118] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [105.028120] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.028121] CR2: 00007071c0db4059 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.028123] PKRU: 55555554 <4> [105.028124] Call Trace: <4> [105.028125] <TASK> <4> [105.028129] ? lock_acquire+0x60/0x300 <4> [105.028134] ? lock_release+0xd0/0x2b0 <4> [105.028139] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.028145] process_one_work+0x239/0x740 <4> [105.028151] worker_thread+0x200/0x3f0 <4> [105.028154] ? __pfx_worker_thread+0x10/0x10 <4> [105.028157] kthread+0x10d/0x150 <4> [105.028159] ? __pfx_kthread+0x10/0x10 <4> [105.028163] ret_from_fork+0x3bd/0x470 <4> [105.028165] ? __pfx_kthread+0x10/0x10 <4> [105.028168] ret_from_fork_asm+0x1a/0x30 <4> [105.028176] </TASK> <4> [105.028177] irq event stamp: 1462157 <4> [105.028178] hardirqs last enabled at (1462163): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.028180] hardirqs last disabled at (1462168): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.028182] softirqs last enabled at (1461996): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.028185] softirqs last disabled at (1461985): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.028187] ---[ end trace 0000000000000000 ]--- <5> [105.029696] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25166, lrc_seqno=25166, guc_id=0, flags=0x73 in no process [-1] <7> [105.029701] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [105.029700] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [105.029778] ------------[ cut here ]------------ <4> [105.029780] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.029781] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:2/121 <7> [105.029813] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [105.029866] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.029934] [last unloaded: snd_hda_intel] <4> [105.029938] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.029941] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.029942] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.029943] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.029949] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.030028] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.030030] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [105.030267] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.030269] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.030270] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.030271] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.030273] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.030274] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [105.030275] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.030277] CR2: 0000743421428000 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [105.030278] PKRU: 55555554 <4> [105.030279] Call Trace: <4> [105.030281] <TASK> <4> [105.030285] ? lock_acquire+0x60/0x300 <4> [105.030290] ? lock_release+0xd0/0x2b0 <4> [105.030295] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.030301] process_one_work+0x239/0x740 <4> [105.030308] worker_thread+0x200/0x3f0 <4> [105.030311] ? __pfx_worker_thread+0x10/0x10 <4> [105.030314] kthread+0x10d/0x150 <4> [105.030316] ? __pfx_kthread+0x10/0x10 <4> [105.030319] ret_from_fork+0x3bd/0x470 <4> [105.030321] ? __pfx_kthread+0x10/0x10 <4> [105.030324] ret_from_fork_asm+0x1a/0x30 <4> [105.030332] </TASK> <4> [105.030333] irq event stamp: 1464025 <4> [105.030334] hardirqs last enabled at (1464031): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.030336] hardirqs last disabled at (1464036): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.030338] softirqs last enabled at (1461996): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.030341] softirqs last disabled at (1461985): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.030343] ---[ end trace 0000000000000000 ]--- <6> [105.030345] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.030424] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.030433] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.030615] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.030940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.031048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.031151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.031245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.031335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.031424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.031514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.031604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.031689] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.031791] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.031887] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.032947] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.043042] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.043302] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.044353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.044441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.044523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.044604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.044683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.044763] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.044842] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.044918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.044994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.045089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.045168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.045247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.045323] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.045401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.045477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.045554] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.045630] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.045705] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.045780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.045865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.045949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.046038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.046122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.046204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.046284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.046362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.046441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.046519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.046597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.046677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.046761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.046843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.046923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.047008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.047105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.047189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.047273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.047354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.047434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.047512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.047590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.047667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.047742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.047820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.047898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.047976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.048060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.048136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.048210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.048286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.048364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.048440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.048519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.048601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.048682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.048763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.048842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.048921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.048998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.049095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.049173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.049250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.049327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.049401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.049480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.049556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.049632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.049706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.049784] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.049911] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.049932] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25166, lrc_seqno=25166, guc_id=0, flags=0x73 in no process [-1] <7> [105.049939] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.050473] ------------[ cut here ]------------ <4> [105.050475] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.050477] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:7/710 <4> [105.050616] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.050691] [last unloaded: snd_hda_intel] <4> [105.050695] CPU: 0 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.050699] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.050701] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.050703] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.050711] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.050794] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.050796] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [105.050798] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.050800] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.050801] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.050802] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.050803] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.050805] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [105.050806] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.050808] CR2: 000074342142d000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.050809] PKRU: 55555554 <4> [105.050810] Call Trace: <4> [105.050811] <TASK> <4> [105.050815] ? lock_acquire+0x60/0x300 <4> [105.050820] ? lock_release+0xd0/0x2b0 <4> [105.050825] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.050831] process_one_work+0x239/0x740 <4> [105.050838] worker_thread+0x200/0x3f0 <4> [105.050841] ? __pfx_worker_thread+0x10/0x10 <4> [105.050843] kthread+0x10d/0x150 <4> [105.050846] ? __pfx_kthread+0x10/0x10 <4> [105.050849] ret_from_fork+0x3bd/0x470 <4> [105.050851] ? __pfx_kthread+0x10/0x10 <4> [105.050854] ret_from_fork_asm+0x1a/0x30 <4> [105.050861] </TASK> <4> [105.050862] irq event stamp: 819711 <4> [105.050863] hardirqs last enabled at (819717): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.050866] hardirqs last disabled at (819722): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.050867] softirqs last enabled at (818946): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.050870] softirqs last disabled at (818815): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.050873] ---[ end trace 0000000000000000 ]--- <6> [105.050875] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [105.050868] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [105.050955] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.050962] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.050979] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [105.051137] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.051350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.051447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.051545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.051637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.051726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.051814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.051904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.051996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.052090] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.052191] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.052285] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.053319] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.064044] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.064300] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.065343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.065428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.065506] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.065587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.065668] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.065748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.065825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.065901] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.065977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.066063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.066139] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.066215] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.066291] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.066366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.066442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.066526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.066602] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.066677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.066753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.066839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.066924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.067005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.067093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.067174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.067253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.067330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.067406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.067484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.067560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.067638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.067717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.067794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.067874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.067952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.068039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.068123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.068205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.068285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.068363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.068440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.068521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.068598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.068675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.068752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.068829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.068905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.068981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.069068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.069144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.069220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.069300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.069375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.069453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.069528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.069603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.069680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.069757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.069831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.069906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.069984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.070070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.070148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.070224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.070299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.070376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.070452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.070527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.070602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.070680] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.070801] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.070805] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25166, lrc_seqno=25166, guc_id=0, flags=0x73 in no process [-1] <7> [105.070808] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.070875] ------------[ cut here ]------------ <4> [105.070876] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.070878] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:7/710 <4> [105.070956] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.071020] [last unloaded: snd_hda_intel] <4> [105.071023] CPU: 0 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.071026] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.071027] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.071028] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.071037] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.071113] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.071115] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [105.071117] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.071118] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.071120] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.071121] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.071122] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.071124] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [105.071125] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.071127] CR2: 000074342142d000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.071128] PKRU: 55555554 <4> [105.071129] Call Trace: <4> [105.071130] <TASK> <4> [105.071134] ? lock_acquire+0x60/0x300 <4> [105.071139] ? lock_release+0xd0/0x2b0 <4> [105.071144] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.071150] process_one_work+0x239/0x740 <4> [105.071156] worker_thread+0x200/0x3f0 <4> [105.071160] ? __pfx_worker_thread+0x10/0x10 <4> [105.071162] kthread+0x10d/0x150 <4> [105.071164] ? __pfx_kthread+0x10/0x10 <4> [105.071167] ret_from_fork+0x3bd/0x470 <4> [105.071170] ? __pfx_kthread+0x10/0x10 <4> [105.071172] ret_from_fork_asm+0x1a/0x30 <4> [105.071180] </TASK> <4> [105.071181] irq event stamp: 822855 <4> [105.071182] hardirqs last enabled at (822861): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.071184] hardirqs last disabled at (822866): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.071186] softirqs last enabled at (821588): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.071189] softirqs last disabled at (821583): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.071191] ---[ end trace 0000000000000000 ]--- <5> [105.072586] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25221, lrc_seqno=25221, guc_id=0, flags=0x73 in no process [-1] <7> [105.072589] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.072662] ------------[ cut here ]------------ <4> [105.072663] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.072664] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:7/710 <4> [105.072743] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.072806] [last unloaded: snd_hda_intel] <4> [105.072809] CPU: 0 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.072812] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.072813] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.072815] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.072820] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.072895] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.072897] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [105.072899] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.072900] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.072902] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.072903] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.072907] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.072908] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [105.072910] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.072911] CR2: 000074342142d000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.072912] PKRU: 55555554 <4> [105.072914] Call Trace: <4> [105.072915] <TASK> <4> [105.072918] ? lock_acquire+0x60/0x300 <4> [105.072923] ? lock_release+0xd0/0x2b0 <4> [105.072928] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.072934] process_one_work+0x239/0x740 <4> [105.072940] worker_thread+0x200/0x3f0 <4> [105.072943] ? __pfx_worker_thread+0x10/0x10 <4> [105.072946] kthread+0x10d/0x150 <4> [105.072948] ? __pfx_kthread+0x10/0x10 <4> [105.072951] ret_from_fork+0x3bd/0x470 <4> [105.072953] ? __pfx_kthread+0x10/0x10 <4> [105.072956] ret_from_fork_asm+0x1a/0x30 <4> [105.072963] </TASK> <4> [105.072964] irq event stamp: 824727 <4> [105.072966] hardirqs last enabled at (824733): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.072968] hardirqs last disabled at (824738): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.072969] softirqs last enabled at (821588): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.072972] softirqs last disabled at (821583): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.072975] ---[ end trace 0000000000000000 ]--- <7> [105.072989] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [105.073113] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [105.073218] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.073295] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.073301] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.073526] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.073736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.073830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.073928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.074022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.074131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.074218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.074304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.074392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.074475] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.074575] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.074669] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.075703] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.086039] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.086297] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.087316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.087400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.087481] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.087562] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.087642] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.087721] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.087797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.087875] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.087951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.088039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.088121] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.088205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.088281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.088357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.088434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.088510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.088586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.088661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.088736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.088822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.088907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.088990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.089086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.089169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.089249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.089327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.089404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.089481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.089558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.089639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.089719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.089796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.089875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.089954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.090043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.090129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.090214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.090295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.090375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.090453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.090531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.090608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.090684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.090762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.090840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.090916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.090992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.091076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.091152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.091230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.091314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.091392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.091470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.091546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.091622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.091699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.091776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.091852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.091928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.092007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.092099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.092178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.092256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.092337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.092419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.092500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.092579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.092655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.092735] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.092856] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.092860] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25221, lrc_seqno=25221, guc_id=0, flags=0x73 in no process [-1] <7> [105.092863] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.092931] ------------[ cut here ]------------ <4> [105.092932] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.092933] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:7/710 <4> [105.093012] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.093085] [last unloaded: snd_hda_intel] <4> [105.093088] CPU: 0 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.093091] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.093092] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.093094] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.093099] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.093174] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.093176] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [105.093178] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.093180] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.093181] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.093182] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.093184] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.093185] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [105.093187] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.093188] CR2: 000074342142d000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.093189] PKRU: 55555554 <4> [105.093191] Call Trace: <4> [105.093192] <TASK> <4> [105.093195] ? lock_acquire+0x60/0x300 <4> [105.093200] ? lock_release+0xd0/0x2b0 <4> [105.093205] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.093211] process_one_work+0x239/0x740 <4> [105.093217] worker_thread+0x200/0x3f0 <4> [105.093220] ? __pfx_worker_thread+0x10/0x10 <4> [105.093223] kthread+0x10d/0x150 <4> [105.093225] ? __pfx_kthread+0x10/0x10 <4> [105.093228] ret_from_fork+0x3bd/0x470 <4> [105.093230] ? __pfx_kthread+0x10/0x10 <4> [105.093233] ret_from_fork_asm+0x1a/0x30 <4> [105.093241] </TASK> <4> [105.093242] irq event stamp: 827879 <4> [105.093243] hardirqs last enabled at (827885): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.093245] hardirqs last disabled at (827890): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.093247] softirqs last enabled at (826984): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.093249] softirqs last disabled at (826973): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.093252] ---[ end trace 0000000000000000 ]--- <6> [105.093254] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.093328] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.093335] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.094577] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [105.094687] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [105.094796] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.095018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.095132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.095233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.095326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.095415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.095506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.095597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.095686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.095769] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.095870] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.095964] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.097003] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.107035] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.107295] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.108293] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.108382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.108466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.108549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.108630] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.108708] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.108785] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.108862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.108939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.109015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.109104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.109180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.109255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.109330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.109406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.109481] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.109557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.109632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.109707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.109794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.109880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.109964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.110048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.110129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.110208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.110284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.110361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.110437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.110513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.110592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.110670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.110747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.110825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.110902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.110985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.111077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.111160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.111239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.111318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.111394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.111471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.111547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.111622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.111699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.111777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.111853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.111929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.112005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.112090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.112166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.112245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.112320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.112396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.112472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.112547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.112625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.112701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.112776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.112851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.112929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.113005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.113092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.113169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.113245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.113323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.113405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.113481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.113556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.113636] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.113757] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.113762] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25221, lrc_seqno=25221, guc_id=0, flags=0x73 in no process [-1] <7> [105.113764] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.113832] ------------[ cut here ]------------ <4> [105.113833] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.113834] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [105.113919] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.113984] [last unloaded: snd_hda_intel] <4> [105.113988] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.113991] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.113992] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.113993] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.113999] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.114083] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.114085] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [105.114088] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.114089] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.114091] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.114092] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.114094] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.114095] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [105.114097] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.114099] CR2: 0000743421428000 CR3: 0000000126b65004 CR4: 0000000000f72ef0 <4> [105.114100] PKRU: 55555554 <4> [105.114101] Call Trace: <4> [105.114102] <TASK> <4> [105.114106] ? lock_acquire+0x60/0x300 <4> [105.114111] ? lock_release+0xd0/0x2b0 <4> [105.114116] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.114123] process_one_work+0x239/0x740 <4> [105.114129] worker_thread+0x200/0x3f0 <4> [105.114133] ? __pfx_worker_thread+0x10/0x10 <4> [105.114135] kthread+0x10d/0x150 <4> [105.114138] ? __pfx_kthread+0x10/0x10 <4> [105.114141] ret_from_fork+0x3bd/0x470 <4> [105.114143] ? __pfx_kthread+0x10/0x10 <4> [105.114146] ret_from_fork_asm+0x1a/0x30 <4> [105.114154] </TASK> <4> [105.114155] irq event stamp: 1468777 <4> [105.114156] hardirqs last enabled at (1468783): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.114159] hardirqs last disabled at (1468788): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.114161] softirqs last enabled at (1467888): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.114163] softirqs last disabled at (1467883): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.114166] ---[ end trace 0000000000000000 ]--- <5> [105.115453] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25276, lrc_seqno=25276, guc_id=0, flags=0x73 in no process [-1] <7> [105.115456] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [105.115459] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [105.115528] ------------[ cut here ]------------ <4> [105.115529] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.115531] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:2/121 <4> [105.115611] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm <7> [105.115571] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [105.115622] drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [105.115679] CPU: 4 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.115682] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.115684] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.115685] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.115691] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.115768] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.115770] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [105.115772] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.115773] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.115775] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.115776] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.115777] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.115779] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [105.115780] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.115782] CR2: 00007071c0db4059 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.115783] PKRU: 55555554 <4> [105.115784] Call Trace: <4> [105.115785] <TASK> <4> [105.115789] ? lock_acquire+0x60/0x300 <4> [105.115794] ? lock_release+0xd0/0x2b0 <4> [105.115799] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.115805] process_one_work+0x239/0x740 <4> [105.115812] worker_thread+0x200/0x3f0 <4> [105.115815] ? __pfx_worker_thread+0x10/0x10 <4> [105.115817] kthread+0x10d/0x150 <4> [105.115820] ? __pfx_kthread+0x10/0x10 <4> [105.115823] ret_from_fork+0x3bd/0x470 <4> [105.115825] ? __pfx_kthread+0x10/0x10 <4> [105.115827] ret_from_fork_asm+0x1a/0x30 <4> [105.115835] </TASK> <4> [105.115836] irq event stamp: 1470631 <4> [105.115837] hardirqs last enabled at (1470637): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.115840] hardirqs last disabled at (1470642): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.115841] softirqs last enabled at (1467888): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.115844] softirqs last disabled at (1467883): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.115847] ---[ end trace 0000000000000000 ]--- <6> [105.115849] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.115928] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.115935] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.116088] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.116320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.116416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.116512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.116604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.116692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.116784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.116886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.116974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.117066] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.117167] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.117263] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.118303] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.128033] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.128316] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.129294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.129379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.129458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.129537] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.129616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.129694] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.129771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.129850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.129928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.130005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.130109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.130188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.130264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.130341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.130417] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.130494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.130570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.130644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.130720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.130803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.130887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.130969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.131053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.131153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.131233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.131311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.131388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.131465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.131542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.131624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.131707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.131787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.131866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.131946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.132035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.132142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.132226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.132312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.132395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.132475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.132552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.132629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.132705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.132783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.132862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.132941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.133019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.133112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.133188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.133267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.133347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.133424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.133505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.133583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.133660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.133737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.133815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.133892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.133968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.134049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.134127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.134205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.134283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.134359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.134438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.134515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.134591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.134666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.134744] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.134866] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.134870] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25276, lrc_seqno=25276, guc_id=0, flags=0x73 in no process [-1] <7> [105.134872] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.134940] ------------[ cut here ]------------ <4> [105.134941] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.134942] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:2/121 <4> [105.135020] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.135092] [last unloaded: snd_hda_intel] <4> [105.135095] CPU: 4 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.135098] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.135099] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.135101] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.135106] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.135182] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.135184] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [105.135186] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.135188] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.135189] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.135190] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.135191] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.135193] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [105.135194] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.135196] CR2: 00007071c0db4059 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.135197] PKRU: 55555554 <4> [105.135198] Call Trace: <4> [105.135199] <TASK> <4> [105.135203] ? lock_acquire+0x60/0x300 <4> [105.135208] ? lock_release+0xd0/0x2b0 <4> [105.135213] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.135219] process_one_work+0x239/0x740 <4> [105.135226] worker_thread+0x200/0x3f0 <4> [105.135229] ? __pfx_worker_thread+0x10/0x10 <4> [105.135232] kthread+0x10d/0x150 <4> [105.135234] ? __pfx_kthread+0x10/0x10 <4> [105.135237] ret_from_fork+0x3bd/0x470 <4> [105.135239] ? __pfx_kthread+0x10/0x10 <4> [105.135242] ret_from_fork_asm+0x1a/0x30 <4> [105.135249] </TASK> <4> [105.135250] irq event stamp: 1473815 <4> [105.135251] hardirqs last enabled at (1473821): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.135254] hardirqs last disabled at (1473826): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.135255] softirqs last enabled at (1473104): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.135258] softirqs last disabled at (1473093): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.135261] ---[ end trace 0000000000000000 ]--- <6> [105.136054] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.136243] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.136251] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.136292] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [105.136404] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [105.136516] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.136728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.136821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.136915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.137003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.137106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.137192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.137278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.137366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.137448] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.137547] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.137641] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.138675] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.149384] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.149641] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.150678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.150764] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.150844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.150925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.151005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.151096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.151173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.151252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.151330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.151408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.151484] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.151561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.151637] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.151713] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.151786] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.151861] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.151937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.152012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.152102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.152189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.152274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.152355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.152438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.152519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.152599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.152675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.152752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.152828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.152905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.152984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.153075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.153152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.153230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.153309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.153393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.153477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.153561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.153640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.153720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.153796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.153873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.153949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.154032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.154111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.154196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.154275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.154353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.154430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.154507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.154584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.154663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.154740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.154818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.154899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.154974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.155061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.155139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.155214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.155289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.155368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.155443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.155519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.155595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.155672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.155749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.155825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.155900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.155975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.156061] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.156183] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.156187] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25276, lrc_seqno=25276, guc_id=0, flags=0x73 in no process [-1] <7> [105.156190] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.156258] ------------[ cut here ]------------ <4> [105.156259] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.156261] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:2/121 <4> [105.156339] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.156405] [last unloaded: snd_hda_intel] <4> [105.156409] CPU: 5 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.156412] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.156413] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.156415] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.156420] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.156496] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.156498] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [105.156500] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.156501] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.156503] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.156504] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.156505] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.156506] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [105.156508] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.156509] CR2: 00007f06be143008 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [105.156511] PKRU: 55555554 <4> [105.156512] Call Trace: <4> [105.156513] <TASK> <4> [105.156517] ? lock_acquire+0x60/0x300 <4> [105.156523] ? lock_release+0xd0/0x2b0 <4> [105.156527] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.156534] process_one_work+0x239/0x740 <4> [105.156540] worker_thread+0x200/0x3f0 <4> [105.156543] ? __pfx_worker_thread+0x10/0x10 <4> [105.156546] kthread+0x10d/0x150 <4> [105.156548] ? __pfx_kthread+0x10/0x10 <4> [105.156551] ret_from_fork+0x3bd/0x470 <4> [105.156553] ? __pfx_kthread+0x10/0x10 <4> [105.156556] ret_from_fork_asm+0x1a/0x30 <4> [105.156564] </TASK> <4> [105.156565] irq event stamp: 1476979 <4> [105.156566] hardirqs last enabled at (1476985): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.156569] hardirqs last disabled at (1476990): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.156570] softirqs last enabled at (1475964): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.156573] softirqs last disabled at (1475955): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.156576] ---[ end trace 0000000000000000 ]--- <5> [105.157931] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25331, lrc_seqno=25331, guc_id=0, flags=0x73 in no process [-1] <7> [105.157934] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.158006] ------------[ cut here ]------------ <4> [105.158007] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.158009] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:2/121 <4> [105.158101] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.158165] [last unloaded: snd_hda_intel] <4> [105.158168] CPU: 5 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.158171] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.158172] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.158173] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.158179] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.158255] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.158256] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [105.158258] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.158260] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.158261] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.158262] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.158263] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.158264] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [105.158266] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.158267] CR2: 00007f06be143008 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [105.158269] PKRU: 55555554 <4> [105.158270] Call Trace: <4> [105.158271] <TASK> <4> [105.158275] ? lock_acquire+0x60/0x300 <4> [105.158279] ? lock_release+0xd0/0x2b0 <4> [105.158284] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.158290] process_one_work+0x239/0x740 <4> [105.158297] worker_thread+0x200/0x3f0 <4> [105.158300] ? __pfx_worker_thread+0x10/0x10 <4> [105.158302] kthread+0x10d/0x150 <4> [105.158305] ? __pfx_kthread+0x10/0x10 <4> [105.158308] ret_from_fork+0x3bd/0x470 <4> [105.158310] ? __pfx_kthread+0x10/0x10 <4> [105.158312] ret_from_fork_asm+0x1a/0x30 <4> [105.158320] </TASK> <4> [105.158321] irq event stamp: 1478477 <4> [105.158322] hardirqs last enabled at (1478483): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.158324] hardirqs last disabled at (1478488): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.158326] softirqs last enabled at (1475964): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.158329] softirqs last disabled at (1475955): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.158331] ---[ end trace 0000000000000000 ]--- <6> [105.158333] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.158408] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.158414] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.158431] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [105.158541] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [105.158651] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.158875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.158976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.159131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.159227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.159318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.159407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.159495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.159585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.159670] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.159771] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.159865] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.160907] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.171032] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.171292] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.172242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.172330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.172411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.172490] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.172567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.172642] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.172719] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.172793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.172869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.172945] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.173019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.173120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.173209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.173286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.173361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.173436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.173514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.173592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.173669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.173755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.173837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.173919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.173999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.174095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.174192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.174272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.174350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.174427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.174504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.174583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.174664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.174742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.174821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.174900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.174984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.175081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.175176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.175256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.175336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.175415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.175493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.175569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.175644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.175721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.175800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.175877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.175959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.176051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.176141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.176220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.176303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.176383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.176461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.176538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.176614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.176691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.176768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.176843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.176916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.176993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.177088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.177179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.177255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.177330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.177406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.177483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.177557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.177633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.177711] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.177834] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.177838] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25331, lrc_seqno=25331, guc_id=0, flags=0x73 in no process [-1] <7> [105.177841] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.178119] ------------[ cut here ]------------ <4> [105.178123] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.178127] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:6/205 <4> [105.178511] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.178644] [last unloaded: snd_hda_intel] <4> [105.178652] CPU: 2 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.178660] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.178663] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.178667] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.178689] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.178826] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.178828] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [105.178831] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.178833] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.178834] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.178836] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.178837] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.178839] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [105.178841] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.178843] CR2: 000074342142f000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.178844] PKRU: 55555554 <4> [105.178846] Call Trace: <4> [105.178847] <TASK> <4> [105.178855] ? lock_acquire+0x60/0x300 <4> [105.178864] ? lock_release+0xd0/0x2b0 <4> [105.178873] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.178884] process_one_work+0x239/0x740 <4> [105.178894] worker_thread+0x200/0x3f0 <4> [105.178899] ? __pfx_worker_thread+0x10/0x10 <4> [105.178903] kthread+0x10d/0x150 <4> [105.178906] ? __pfx_kthread+0x10/0x10 <4> [105.178911] ret_from_fork+0x3bd/0x470 <4> [105.178915] ? __pfx_kthread+0x10/0x10 <4> [105.178919] ret_from_fork_asm+0x1a/0x30 <4> [105.178933] </TASK> <4> [105.178935] irq event stamp: 1189753 <4> [105.178937] hardirqs last enabled at (1189759): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.178941] hardirqs last disabled at (1189764): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.178944] softirqs last enabled at (1188854): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <7> [105.178870] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [105.178948] softirqs last disabled at (1188847): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.178952] ---[ end trace 0000000000000000 ]--- <6> [105.178955] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.179099] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.179111] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.179038] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [105.179494] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.179709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.179805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.179903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.179994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.180098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.180187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.180277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.180367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.180453] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.180554] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.180648] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.181684] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.192030] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.192285] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.193303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.193389] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.193470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.193553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.193633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.193712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.193791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.193869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.193947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.194030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.194108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.194183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.194260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.194337] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.194412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.194488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.194564] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.194639] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.194714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.194801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.194887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.194969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.195061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.195143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.195224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.195306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.195385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.195464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.195541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.195621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.195701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.195780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.195859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.195938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.196029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.196113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.196197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.196277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.196357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.196434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.196512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.196589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.196664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.196742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.196820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.196898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.196975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.197064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.197139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.197217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.197296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.197372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.197450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.197527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.197602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.197680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.197760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.197839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.197915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.197994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.198086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.198165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.198241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.198318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.198396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.198472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.198548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.198624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.198704] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.198826] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.198830] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25331, lrc_seqno=25331, guc_id=0, flags=0x73 in no process [-1] <7> [105.198833] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.198901] ------------[ cut here ]------------ <4> [105.198902] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.198903] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:6/205 <4> [105.198982] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.199051] [last unloaded: snd_hda_intel] <4> [105.199054] CPU: 2 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.199057] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.199059] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.199060] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.199066] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.199142] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.199143] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [105.199146] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.199147] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.199148] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.199150] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.199151] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.199152] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [105.199154] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.199155] CR2: 000074342142f000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.199157] PKRU: 55555554 <4> [105.199158] Call Trace: <4> [105.199159] <TASK> <4> [105.199163] ? lock_acquire+0x60/0x300 <4> [105.199168] ? lock_release+0xd0/0x2b0 <4> [105.199173] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.199179] process_one_work+0x239/0x740 <4> [105.199185] worker_thread+0x200/0x3f0 <4> [105.199188] ? __pfx_worker_thread+0x10/0x10 <4> [105.199191] kthread+0x10d/0x150 <4> [105.199193] ? __pfx_kthread+0x10/0x10 <4> [105.199196] ret_from_fork+0x3bd/0x470 <4> [105.199198] ? __pfx_kthread+0x10/0x10 <4> [105.199201] ret_from_fork_asm+0x1a/0x30 <4> [105.199208] </TASK> <4> [105.199210] irq event stamp: 1192909 <4> [105.199211] hardirqs last enabled at (1192915): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.199213] hardirqs last disabled at (1192920): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.199215] softirqs last enabled at (1191928): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.199217] softirqs last disabled at (1191921): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.199220] ---[ end trace 0000000000000000 ]--- <5> [105.200049] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25386, lrc_seqno=25386, guc_id=0, flags=0x73 in no process [-1] <7> [105.200057] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.200440] ------------[ cut here ]------------ <4> [105.200444] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.200448] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:6/205 <4> [105.200579] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.200677] [last unloaded: snd_hda_intel] <4> [105.200682] CPU: 3 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.200686] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.200688] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.200690] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [105.200625] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [105.200699] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.200826] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.200829] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [105.200832] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.200835] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.200837] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.200839] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.200841] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.200844] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000 <4> [105.200846] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.200849] CR2: 00007b64f7be62f4 CR3: 000000000344a002 CR4: 0000000000f72ef0 <4> [105.200851] PKRU: 55555554 <4> [105.200853] Call Trace: <4> [105.200855] <TASK> <7> [105.200785] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [105.200862] ? lock_acquire+0x60/0x300 <4> [105.200870] ? lock_release+0xd0/0x2b0 <4> [105.200877] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.200887] process_one_work+0x239/0x740 <4> [105.200895] worker_thread+0x200/0x3f0 <4> [105.200900] ? __pfx_worker_thread+0x10/0x10 <4> [105.200904] kthread+0x10d/0x150 <4> [105.200907] ? __pfx_kthread+0x10/0x10 <4> [105.200912] ret_from_fork+0x3bd/0x470 <4> [105.200915] ? __pfx_kthread+0x10/0x10 <4> [105.200919] ret_from_fork_asm+0x1a/0x30 <4> [105.200932] </TASK> <4> [105.200933] irq event stamp: 1194827 <4> [105.200940] hardirqs last enabled at (1194837): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.200943] hardirqs last disabled at (1194842): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.200945] softirqs last enabled at (1191928): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.200947] softirqs last disabled at (1191921): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.200950] ---[ end trace 0000000000000000 ]--- <6> [105.200952] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.201040] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.201046] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.201162] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.201375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.201471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.201567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.201656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.201744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.201830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.201918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.202007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.202107] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.202208] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.202303] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.203340] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.214364] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.214622] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.215636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.215714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.215787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.215862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.215935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.216006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.216096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.216172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.216248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.216325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.216399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.216473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.216548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.216623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.216699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.216774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.216848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.216925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.216999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.217097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.217180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.217260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.217340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.217421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.217501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.217579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.217657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.217735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.217813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.217892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.217973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.218062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.218140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.218221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.218307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.218392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.218475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.218555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.218633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.218709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.218787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.218863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.218939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.219017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.219116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.219194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.219272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.219348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.219424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.219500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.219580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.219656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.219749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.219828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.219905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.219998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.220090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.220169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.220247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.220327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.220405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.220483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.220561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.220637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.220715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.220792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.220867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.220943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.221025] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.221145] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.221150] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25386, lrc_seqno=25386, guc_id=0, flags=0x73 in no process [-1] <7> [105.221152] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.221220] ------------[ cut here ]------------ <4> [105.221222] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.221223] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:6/205 <4> [105.221301] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.221365] [last unloaded: snd_hda_intel] <4> [105.221368] CPU: 3 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.221371] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.221372] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.221374] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.221379] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.221455] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.221457] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [105.221459] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.221460] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.221462] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.221463] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.221464] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.221465] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000 <4> [105.221467] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.221468] CR2: 00007b64f7be62f4 CR3: 000000000344a002 CR4: 0000000000f72ef0 <4> [105.221470] PKRU: 55555554 <4> [105.221471] Call Trace: <4> [105.221472] <TASK> <4> [105.221476] ? lock_acquire+0x60/0x300 <4> [105.221481] ? lock_release+0xd0/0x2b0 <4> [105.221486] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.221492] process_one_work+0x239/0x740 <4> [105.221498] worker_thread+0x200/0x3f0 <4> [105.221501] ? __pfx_worker_thread+0x10/0x10 <4> [105.221504] kthread+0x10d/0x150 <4> [105.221506] ? __pfx_kthread+0x10/0x10 <4> [105.221509] ret_from_fork+0x3bd/0x470 <4> [105.221511] ? __pfx_kthread+0x10/0x10 <4> [105.221513] ret_from_fork_asm+0x1a/0x30 <4> [105.221521] </TASK> <4> [105.221522] irq event stamp: 1198019 <4> [105.221523] hardirqs last enabled at (1198025): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.221525] hardirqs last disabled at (1198030): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.221527] softirqs last enabled at (1197016): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.221530] softirqs last disabled at (1197009): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.221532] ---[ end trace 0000000000000000 ]--- <6> [105.221534] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.221608] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.221614] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.222852] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [105.222963] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [105.223083] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.223304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.223405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.223506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.223601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.223695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.223785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.223872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.223961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.224059] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.224161] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.224256] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.225295] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.236030] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.236285] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.237304] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.237389] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.237471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.237552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.237631] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.237710] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.237789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.237866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.237941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.238015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.238109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.238185] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.238261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.238337] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.238411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.238486] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.238561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.238637] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.238713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.238798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.238882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.238965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.239056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.239137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.239217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.239295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.239375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.239455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.239531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.239612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.239692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.239771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.239850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.239928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.240013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.240119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.240203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.240283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.240363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.240441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.240518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.240593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.240669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.240745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.240823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.240899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.240979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.241071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.241148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.241224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.241304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.241382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.241460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.241537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.241612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.241689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.241766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.241840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.241916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.241994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.242084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.242161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.242238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.242314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.242390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.242466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.242542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.242618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.242697] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.242822] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.242826] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25386, lrc_seqno=25386, guc_id=0, flags=0x73 in no process [-1] <7> [105.242828] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.242896] ------------[ cut here ]------------ <4> [105.242897] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.242898] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:7/710 <4> [105.242987] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.243061] [last unloaded: snd_hda_intel] <4> [105.243065] CPU: 4 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.243068] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.243069] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.243070] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.243076] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.243152] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.243153] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [105.243156] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.243157] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.243158] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.243160] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.243161] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.243162] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [105.243164] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.243165] CR2: 00007071c0db4059 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.243167] PKRU: 55555554 <4> [105.243168] Call Trace: <4> [105.243169] <TASK> <4> [105.243173] ? lock_acquire+0x60/0x300 <4> [105.243178] ? lock_release+0xd0/0x2b0 <4> [105.243183] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.243189] process_one_work+0x239/0x740 <4> [105.243196] worker_thread+0x200/0x3f0 <4> [105.243199] ? __pfx_worker_thread+0x10/0x10 <4> [105.243202] kthread+0x10d/0x150 <4> [105.243204] ? __pfx_kthread+0x10/0x10 <4> [105.243207] ret_from_fork+0x3bd/0x470 <4> [105.243209] ? __pfx_kthread+0x10/0x10 <4> [105.243212] ret_from_fork_asm+0x1a/0x30 <4> [105.243219] </TASK> <4> [105.243220] irq event stamp: 832075 <4> [105.243221] hardirqs last enabled at (832081): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.243224] hardirqs last disabled at (832086): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.243225] softirqs last enabled at (831178): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.243228] softirqs last disabled at (831167): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.243231] ---[ end trace 0000000000000000 ]--- <7> [105.244479] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <5> [105.244637] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25441, lrc_seqno=25441, guc_id=0, flags=0x73 in no process [-1] <7> [105.244591] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [105.244640] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.244714] ------------[ cut here ]------------ <4> [105.244715] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.244717] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:6/205 <4> [105.244800] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.244864] [last unloaded: snd_hda_intel] <4> [105.244867] CPU: 3 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.244870] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.244871] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.244872] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.244878] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.244955] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.244957] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [105.244959] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.244961] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.244962] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.244963] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.244964] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.244966] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000 <4> [105.244967] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.244969] CR2: 00007b64f7be62f4 CR3: 000000000344a002 CR4: 0000000000f72ef0 <4> [105.244970] PKRU: 55555554 <4> [105.244971] Call Trace: <4> [105.244972] <TASK> <4> [105.244976] ? lock_acquire+0x60/0x300 <4> [105.244981] ? lock_release+0xd0/0x2b0 <4> [105.244986] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.244992] process_one_work+0x239/0x740 <4> [105.244998] worker_thread+0x200/0x3f0 <4> [105.245001] ? __pfx_worker_thread+0x10/0x10 <4> [105.245004] kthread+0x10d/0x150 <4> [105.245006] ? __pfx_kthread+0x10/0x10 <4> [105.245009] ret_from_fork+0x3bd/0x470 <4> [105.245011] ? __pfx_kthread+0x10/0x10 <4> [105.245014] ret_from_fork_asm+0x1a/0x30 <4> [105.245029] </TASK> <4> [105.245030] irq event stamp: 1199837 <4> [105.245032] hardirqs last enabled at (1199843): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.245034] hardirqs last disabled at (1199848): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.245036] softirqs last enabled at (1199828): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.245039] softirqs last disabled at (1199821): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.245042] ---[ end trace 0000000000000000 ]--- <6> [105.245044] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.245159] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.245167] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.245360] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.245573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.245669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.245767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.245861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.245952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.246046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.246151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.246241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.246325] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.246426] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.246521] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.247561] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.258026] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.258284] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.259292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.259370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.259444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.259517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.259588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.259660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.259731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.259802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.259873] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.259943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.260012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.260108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.260196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.260274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.260351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.260426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.260502] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.260578] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.260653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.260740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.260824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.260906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.260987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.261080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.261161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.261240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.261318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.261395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.261472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.261553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.261634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.261711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.261790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.261869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.261954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.262043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.262128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.262210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.262291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.262370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.262450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.262527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.262603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.262680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.262760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.262840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.262917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.262996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.263084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.263166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.263249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.263329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.263407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.263484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.263560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.263637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.263715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.263790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.263867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.263947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.264031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.264109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.264185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.264261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.264339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.264414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.264490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.264565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.264643] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.264764] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.264769] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25441, lrc_seqno=25441, guc_id=0, flags=0x73 in no process [-1] <7> [105.264771] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.265039] ------------[ cut here ]------------ <4> [105.265044] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.265048] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:6/205 <4> [105.265464] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.265598] [last unloaded: snd_hda_intel] <4> [105.265606] CPU: 2 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.265614] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.265617] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.265619] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.265640] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.265756] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.265757] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [105.265760] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.265761] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.265763] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.265764] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.265765] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.265766] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [105.265768] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.265769] CR2: 000074342142f000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.265771] PKRU: 55555554 <4> [105.265773] Call Trace: <4> [105.265775] <TASK> <4> [105.265782] ? lock_acquire+0x60/0x300 <4> [105.265791] ? lock_release+0xd0/0x2b0 <4> [105.265800] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.265810] process_one_work+0x239/0x740 <4> [105.265820] worker_thread+0x200/0x3f0 <4> [105.265825] ? __pfx_worker_thread+0x10/0x10 <4> [105.265828] kthread+0x10d/0x150 <4> [105.265831] ? __pfx_kthread+0x10/0x10 <4> [105.265837] ret_from_fork+0x3bd/0x470 <4> [105.265840] ? __pfx_kthread+0x10/0x10 <4> [105.265845] ret_from_fork_asm+0x1a/0x30 <4> [105.265858] </TASK> <4> [105.265860] irq event stamp: 1202987 <4> [105.265862] hardirqs last enabled at (1202993): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.265866] hardirqs last disabled at (1202998): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.265869] softirqs last enabled at (1202086): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <7> [105.265794] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [105.265873] softirqs last disabled at (1202075): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.265876] ---[ end trace 0000000000000000 ]--- <6> [105.265886] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.265976] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.265983] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.265936] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [105.266159] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.266380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.266481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.266580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.266672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.266760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.266846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.266935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.267032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.267116] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.267218] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.267313] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.268349] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.279022] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.279278] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.280305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.280390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.280473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.280556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.280637] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.280716] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.280793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.280873] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.280952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.281035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.281113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.281190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.281268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.281345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.281421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.281497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.281572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.281647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.281722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.281808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.281893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.281975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.282063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.282145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.282225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.282304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.282384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.282463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.282541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.282620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.282700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.282779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.282858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.282937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.283024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.283109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.283194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.283274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.283353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.283430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.283508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.283585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.283661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.283739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.283818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.283896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.283975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.284059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.284136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.284214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.284293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.284370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.284448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.284525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.284601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.284678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.284756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.284831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.284907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.284986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.285093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.285171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.285248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.285324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.285400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.285476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.285559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.285638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.285719] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.285838] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.285843] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25441, lrc_seqno=25441, guc_id=0, flags=0x73 in no process [-1] <7> [105.285845] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.285913] ------------[ cut here ]------------ <4> [105.285915] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.285916] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [105.285994] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.286066] [last unloaded: snd_hda_intel] <4> [105.286069] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.286072] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.286074] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.286075] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.286081] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.286157] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.286159] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [105.286162] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.286163] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.286164] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.286166] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.286167] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.286168] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [105.286170] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.286171] CR2: 0000743421428000 CR3: 0000000140845005 CR4: 0000000000f72ef0 <4> [105.286173] PKRU: 55555554 <4> [105.286174] Call Trace: <4> [105.286175] <TASK> <4> [105.286179] ? lock_acquire+0x60/0x300 <4> [105.286184] ? lock_release+0xd0/0x2b0 <4> [105.286189] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.286195] process_one_work+0x239/0x740 <4> [105.286202] worker_thread+0x200/0x3f0 <4> [105.286205] ? __pfx_worker_thread+0x10/0x10 <4> [105.286207] kthread+0x10d/0x150 <4> [105.286210] ? __pfx_kthread+0x10/0x10 <4> [105.286213] ret_from_fork+0x3bd/0x470 <4> [105.286215] ? __pfx_kthread+0x10/0x10 <4> [105.286218] ret_from_fork_asm+0x1a/0x30 <4> [105.286225] </TASK> <4> [105.286226] irq event stamp: 1484849 <4> [105.286228] hardirqs last enabled at (1484855): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.286230] hardirqs last disabled at (1484860): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.286232] softirqs last enabled at (1483954): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.286235] softirqs last disabled at (1483813): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.286237] ---[ end trace 0000000000000000 ]--- <5> [105.287597] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25496, lrc_seqno=25496, guc_id=0, flags=0x73 in no process [-1] <7> [105.287600] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.287670] ------------[ cut here ]------------ <4> [105.287672] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.287674] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [105.287751] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.287814] [last unloaded: snd_hda_intel] <4> [105.287817] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.287819] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.287821] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.287822] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.287827] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.287901] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.287902] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [105.287904] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.287905] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.287907] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.287908] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.287909] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.287910] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [105.287912] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.287913] CR2: 0000743421428000 CR3: 0000000140845005 CR4: 0000000000f72ef0 <4> [105.287915] PKRU: 55555554 <4> [105.287916] Call Trace: <4> [105.287917] <TASK> <4> [105.287921] ? lock_acquire+0x60/0x300 <4> [105.287925] ? lock_release+0xd0/0x2b0 <4> [105.287930] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.287936] process_one_work+0x239/0x740 <4> [105.287942] worker_thread+0x200/0x3f0 <4> [105.287945] ? __pfx_worker_thread+0x10/0x10 <4> [105.287948] kthread+0x10d/0x150 <4> [105.287950] ? __pfx_kthread+0x10/0x10 <4> [105.287953] ret_from_fork+0x3bd/0x470 <4> [105.287955] ? __pfx_kthread+0x10/0x10 <4> [105.287958] ret_from_fork_asm+0x1a/0x30 <4> [105.287965] </TASK> <4> [105.287966] irq event stamp: 1486719 <4> [105.287967] hardirqs last enabled at (1486725): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.287969] hardirqs last disabled at (1486730): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.287971] softirqs last enabled at (1483954): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.287974] softirqs last disabled at (1483813): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.287976] ---[ end trace 0000000000000000 ]--- <6> [105.287978] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [105.288076] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [105.288187] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [105.288290] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.288296] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.288515] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.288735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.288835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.288935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.289034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.289141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.289230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.289320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.289412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.289497] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.289598] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.289694] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.290737] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.301023] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.301283] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.302315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.302395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.302470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.302542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.302613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.302684] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.302755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.302824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.302894] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.302962] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.303038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.303132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.303209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.303285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.303362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.303437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.303514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.303585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.303654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.303731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.303807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.303881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.303957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.304040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.304135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.304207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.304278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.304348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.304425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.304504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.304585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.304666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.304749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.304827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.304910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.304994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.305091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.305184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.305265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.305343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.305421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.305498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.305574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.305652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.305731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.305809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.305891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.305968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.306054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.306131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.306210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.306287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.306364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.306441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.306517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.306594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.306671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.306747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.306823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.306902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.306979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.307068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.307146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.307223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.307301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.307379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.307454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.307531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.307611] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.307732] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.307736] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25496, lrc_seqno=25496, guc_id=0, flags=0x73 in no process [-1] <7> [105.307739] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.307808] ------------[ cut here ]------------ <4> [105.307809] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.307810] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:7/710 <4> [105.307891] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.307956] [last unloaded: snd_hda_intel] <4> [105.307960] CPU: 5 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.307963] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.307964] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.307965] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.307971] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.308057] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.308059] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [105.308062] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.308064] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.308065] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.308067] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.308068] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.308070] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [105.308072] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.308073] CR2: 00007f06be143008 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [105.308075] PKRU: 55555554 <4> [105.308076] Call Trace: <4> [105.308077] <TASK> <4> [105.308081] ? lock_acquire+0x60/0x300 <4> [105.308086] ? lock_release+0xd0/0x2b0 <4> [105.308091] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.308097] process_one_work+0x239/0x740 <4> [105.308104] worker_thread+0x200/0x3f0 <4> [105.308107] ? __pfx_worker_thread+0x10/0x10 <4> [105.308110] kthread+0x10d/0x150 <4> [105.308113] ? __pfx_kthread+0x10/0x10 <4> [105.308116] ret_from_fork+0x3bd/0x470 <4> [105.308118] ? __pfx_kthread+0x10/0x10 <4> [105.308121] ret_from_fork_asm+0x1a/0x30 <4> [105.308129] </TASK> <4> [105.308130] irq event stamp: 837597 <4> [105.308132] hardirqs last enabled at (837603): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.308134] hardirqs last disabled at (837608): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.308136] softirqs last enabled at (836436): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.308139] softirqs last disabled at (836427): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.308141] ---[ end trace 0000000000000000 ]--- <6> [105.309023] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.309320] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.309328] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.309401] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [105.309514] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [105.309624] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.309841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.309942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.310057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.310152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.310242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.310329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.310415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.310503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.310586] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.310687] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.310781] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.311818] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.322019] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.322273] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.323256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.323343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.323423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.323503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.323581] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.323659] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.323739] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.323817] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.323895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.323971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.324056] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.324133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.324209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.324286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.324363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.324440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.324517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.324593] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.324668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.324753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.324837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.324918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.324997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.325090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.325170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.325248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.325325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.325402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.325479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.325558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.325638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.325717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.325795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.325874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.325958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.326057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.326144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.326226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.326307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.326384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.326461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.326537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.326612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.326689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.326767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.326845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.326923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.326999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.327091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.327170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.327250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.327327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.327405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.327482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.327558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.327634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.327710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.327785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.327860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.327939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.328019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.328096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.328173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.328249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.328326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.328403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.328478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.328553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.328631] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.328753] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.328757] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25496, lrc_seqno=25496, guc_id=0, flags=0x73 in no process [-1] <7> [105.328760] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.328827] ------------[ cut here ]------------ <4> [105.328828] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.328830] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:6/205 <4> [105.328917] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.328982] [last unloaded: snd_hda_intel] <4> [105.328985] CPU: 0 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.328988] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.328989] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.328990] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.328996] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.329083] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.329085] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [105.329087] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.329089] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.329091] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.329092] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.329094] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.329095] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [105.329097] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.329099] CR2: 0000743421430000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.329100] PKRU: 55555554 <4> [105.329101] Call Trace: <4> [105.329102] <TASK> <4> [105.329107] ? lock_acquire+0x60/0x300 <4> [105.329112] ? lock_release+0xd0/0x2b0 <4> [105.329116] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.329123] process_one_work+0x239/0x740 <4> [105.329129] worker_thread+0x200/0x3f0 <4> [105.329133] ? __pfx_worker_thread+0x10/0x10 <4> [105.329135] kthread+0x10d/0x150 <4> [105.329138] ? __pfx_kthread+0x10/0x10 <4> [105.329141] ret_from_fork+0x3bd/0x470 <4> [105.329143] ? __pfx_kthread+0x10/0x10 <4> [105.329146] ret_from_fork_asm+0x1a/0x30 <4> [105.329154] </TASK> <4> [105.329155] irq event stamp: 1206441 <4> [105.329156] hardirqs last enabled at (1206447): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.329158] hardirqs last disabled at (1206452): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.329160] softirqs last enabled at (1205544): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.329163] softirqs last disabled at (1205537): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.329166] ---[ end trace 0000000000000000 ]--- <5> [105.330665] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25551, lrc_seqno=25551, guc_id=0, flags=0x73 in no process [-1] <7> [105.330670] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [105.330669] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [105.330755] ------------[ cut here ]------------ <4> [105.330756] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.330758] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:6/205 <7> [105.330783] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [105.330849] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.330915] [last unloaded: snd_hda_intel] <4> [105.330918] CPU: 2 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.330921] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.330922] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.330924] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.330930] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.331019] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.331021] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [105.331024] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.331026] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.331027] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.331028] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.331030] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.331031] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [105.331033] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.331034] CR2: 000074342142f000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.331036] PKRU: 55555554 <4> [105.331037] Call Trace: <4> [105.331038] <TASK> <4> [105.331042] ? lock_acquire+0x60/0x300 <4> [105.331047] ? lock_release+0xd0/0x2b0 <4> [105.331052] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.331058] process_one_work+0x239/0x740 <4> [105.331065] worker_thread+0x200/0x3f0 <4> [105.331069] ? __pfx_worker_thread+0x10/0x10 <4> [105.331071] kthread+0x10d/0x150 <4> [105.331074] ? __pfx_kthread+0x10/0x10 <4> [105.331077] ret_from_fork+0x3bd/0x470 <4> [105.331079] ? __pfx_kthread+0x10/0x10 <4> [105.331082] ret_from_fork_asm+0x1a/0x30 <4> [105.331090] </TASK> <4> [105.331091] irq event stamp: 1208321 <4> [105.331093] hardirqs last enabled at (1208327): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.331095] hardirqs last disabled at (1208332): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.331097] softirqs last enabled at (1205544): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.331100] softirqs last disabled at (1205537): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.331103] ---[ end trace 0000000000000000 ]--- <6> [105.331105] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.331187] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.331195] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.331304] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.331521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.331626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.331730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.331829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.331922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.332018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.332105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.332194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.332276] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.332376] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.332470] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.333509] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.344029] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.344287] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.345662] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.345755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.345839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.345920] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.346000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.346093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.346172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.346249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.346326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.346403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.346480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.346556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.346632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.346708] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.346785] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.346861] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.346936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.347033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.347110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.347197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.347282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.347364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.347445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.347526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.347607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.347687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.347765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.347843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.347920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.348002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.348103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.348185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.348265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.348345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.348431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.348516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.348600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.348682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.348762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.348839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.348925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.349003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.349093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.349172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.349251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.349330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.349407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.349484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.349561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.349639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.349723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.349800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.349878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.349955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.350037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.350115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.350192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.350268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.350344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.350423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.350500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.350578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.350655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.350731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.350810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.350887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.350963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.351046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.351128] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.351251] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.351255] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25551, lrc_seqno=25551, guc_id=0, flags=0x73 in no process [-1] <7> [105.351258] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.351327] ------------[ cut here ]------------ <4> [105.351328] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.351330] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:6/205 <4> [105.351409] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.351474] [last unloaded: snd_hda_intel] <4> [105.351477] CPU: 2 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.351480] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.351481] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.351482] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.351488] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.351565] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.351566] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [105.351569] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.351570] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.351571] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.351573] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.351574] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.351575] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [105.351577] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.351578] CR2: 000074342142f000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.351580] PKRU: 55555554 <4> [105.351581] Call Trace: <4> [105.351582] <TASK> <4> [105.351586] ? lock_acquire+0x60/0x300 <4> [105.351591] ? lock_release+0xd0/0x2b0 <4> [105.351596] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.351602] process_one_work+0x239/0x740 <4> [105.351608] worker_thread+0x200/0x3f0 <4> [105.351611] ? __pfx_worker_thread+0x10/0x10 <4> [105.351614] kthread+0x10d/0x150 <4> [105.351616] ? __pfx_kthread+0x10/0x10 <4> [105.351619] ret_from_fork+0x3bd/0x470 <4> [105.351621] ? __pfx_kthread+0x10/0x10 <4> [105.351624] ret_from_fork_asm+0x1a/0x30 <4> [105.351632] </TASK> <4> [105.351633] irq event stamp: 1211473 <4> [105.351634] hardirqs last enabled at (1211479): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.351636] hardirqs last disabled at (1211484): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.351638] softirqs last enabled at (1210458): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.351641] softirqs last disabled at (1210451): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.351644] ---[ end trace 0000000000000000 ]--- <6> [105.351645] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.351721] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.351727] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.352973] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [105.353095] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [105.353207] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.353422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.353519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.353617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.353712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.353804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.353892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.353980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.354099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.354186] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.354285] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.354379] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.355413] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.366144] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.366400] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.367424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.367510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.367591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.367673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.367753] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.367831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.367907] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.367985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.368079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.368169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.368247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.368324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.368401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.368477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.368571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.368648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.368725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.368801] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.368875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.368962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.369062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.369155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.369235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.369313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.369393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.369468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.369543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.369621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.369698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.369777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.369858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.369940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.370030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.370122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.370207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.370291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.370374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.370453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.370531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.370609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.370689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.370765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.370844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.370925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.371003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.371100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.371191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.371269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.371344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.371423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.371504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.371580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.371658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.371734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.371807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.371885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.371960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.372051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.372139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.372218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.372294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.372371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.372448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.372522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.372598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.372674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.372749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.372823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.372904] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.373034] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.373041] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25551, lrc_seqno=25551, guc_id=0, flags=0x73 in no process [-1] <7> [105.373045] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.373122] ------------[ cut here ]------------ <4> [105.373123] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.373124] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:7/710 <4> [105.373203] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.373268] [last unloaded: snd_hda_intel] <4> [105.373271] CPU: 4 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.373274] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.373275] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.373277] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.373283] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.373359] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.373361] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [105.373363] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.373365] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.373366] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.373367] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.373368] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.373370] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [105.373372] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.373373] CR2: 00007071c0db4059 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [105.373374] PKRU: 55555554 <4> [105.373376] Call Trace: <4> [105.373377] <TASK> <4> [105.373381] ? lock_acquire+0x60/0x300 <4> [105.373386] ? lock_release+0xd0/0x2b0 <4> [105.373391] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.373396] process_one_work+0x239/0x740 <4> [105.373403] worker_thread+0x200/0x3f0 <4> [105.373406] ? __pfx_worker_thread+0x10/0x10 <4> [105.373409] kthread+0x10d/0x150 <4> [105.373411] ? __pfx_kthread+0x10/0x10 <4> [105.373414] ret_from_fork+0x3bd/0x470 <4> [105.373416] ? __pfx_kthread+0x10/0x10 <4> [105.373419] ret_from_fork_asm+0x1a/0x30 <4> [105.373427] </TASK> <4> [105.373428] irq event stamp: 841277 <4> [105.373429] hardirqs last enabled at (841283): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.373431] hardirqs last disabled at (841288): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.373433] softirqs last enabled at (840476): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.373436] softirqs last disabled at (840469): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.373438] ---[ end trace 0000000000000000 ]--- <5> [105.374033] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25606, lrc_seqno=25606, guc_id=0, flags=0x73 in no process [-1] <7> [105.374043] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.374436] ------------[ cut here ]------------ <4> [105.374439] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.374442] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:7/710 <4> [105.374667] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.374742] [last unloaded: snd_hda_intel] <4> [105.374748] CPU: 5 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.374752] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.374754] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.374756] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [105.374744] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [105.374764] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.374887] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.374890] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [105.374893] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.374895] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.374897] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.374899] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.374904] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.374906] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [105.374909] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.374911] CR2: 0000743421431000 CR3: 0000000126b65005 CR4: 0000000000f72ef0 <4> [105.374914] PKRU: 55555554 <4> [105.374916] Call Trace: <4> [105.374917] <TASK> <4> [105.374924] ? lock_acquire+0x60/0x300 <4> [105.374930] ? lock_release+0xd0/0x2b0 <4> [105.374937] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.374947] process_one_work+0x239/0x740 <4> [105.374959] worker_thread+0x200/0x3f0 <4> [105.374964] ? __pfx_worker_thread+0x10/0x10 <4> [105.374968] kthread+0x10d/0x150 <4> [105.374971] ? __pfx_kthread+0x10/0x10 <4> [105.374977] ret_from_fork+0x3bd/0x470 <7> [105.374905] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [105.374980] ? __pfx_kthread+0x10/0x10 <4> [105.374984] ret_from_fork_asm+0x1a/0x30 <4> [105.374996] </TASK> <4> [105.374998] irq event stamp: 843139 <4> [105.374999] hardirqs last enabled at (843145): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.375002] hardirqs last disabled at (843150): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.375004] softirqs last enabled at (840476): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.375014] softirqs last disabled at (840469): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.375018] ---[ end trace 0000000000000000 ]--- <6> [105.375020] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.375118] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.375125] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.375298] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.375510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.375606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.375702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.375790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.375877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.375964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.376065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.376157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.376241] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.376339] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.376431] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.377472] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.388193] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.388450] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.389481] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.389574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.389657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.389735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.389813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.389891] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.389968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.390060] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.390137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.390214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.390290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.390366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.390442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.390517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.390594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.390669] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.390745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.390819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.390894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.390979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.391078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.391164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.391245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.391327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.391406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.391483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.391560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.391636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.391711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.391790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.391869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.391949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.392036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.392114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.392198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.392281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.392364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.392443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.392523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.392600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.392675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.392751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.392827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.392905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.392983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.393076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.393154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.393231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.393306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.393383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.393463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.393539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.393616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.393693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.393768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.393844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.393921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.393996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.394089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.394168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.394245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.394321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.394397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.394471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.394548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.394623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.394697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.394771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.394849] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.394971] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.394975] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25606, lrc_seqno=25606, guc_id=0, flags=0x73 in no process [-1] <7> [105.394977] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.395061] ------------[ cut here ]------------ <4> [105.395063] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.395064] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:7/710 <4> [105.395142] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.395206] [last unloaded: snd_hda_intel] <4> [105.395209] CPU: 0 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.395212] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.395214] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.395215] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.395221] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.395297] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.395298] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [105.395301] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.395302] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.395303] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.395305] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.395306] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.395307] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [105.395309] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.395310] CR2: 0000743421430000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.395312] PKRU: 55555554 <4> [105.395313] Call Trace: <4> [105.395314] <TASK> <4> [105.395318] ? lock_acquire+0x60/0x300 <4> [105.395323] ? lock_release+0xd0/0x2b0 <4> [105.395328] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.395334] process_one_work+0x239/0x740 <4> [105.395340] worker_thread+0x200/0x3f0 <4> [105.395344] ? __pfx_worker_thread+0x10/0x10 <4> [105.395346] kthread+0x10d/0x150 <4> [105.395349] ? __pfx_kthread+0x10/0x10 <4> [105.395352] ret_from_fork+0x3bd/0x470 <4> [105.395354] ? __pfx_kthread+0x10/0x10 <4> [105.395356] ret_from_fork_asm+0x1a/0x30 <4> [105.395364] </TASK> <4> [105.395365] irq event stamp: 846297 <4> [105.395366] hardirqs last enabled at (846303): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.395368] hardirqs last disabled at (846308): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.395370] softirqs last enabled at (845536): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.395373] softirqs last disabled at (845529): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.395376] ---[ end trace 0000000000000000 ]--- <6> [105.395377] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.395453] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.395459] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.396701] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [105.396811] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [105.396921] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.397427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.397530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.397631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.397722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.397811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.397899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.397985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.398084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.398171] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.398272] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.398366] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.399406] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.410012] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.410277] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.411277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.411363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.411443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.411525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.411605] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.411686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.411765] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.411842] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.411919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.411994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.412083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.412159] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.412235] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.412311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.412388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.412462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.412538] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.412613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.412688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.412773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.412857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.412943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.413026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.413107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.413188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.413266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.413344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.413429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.413507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.413587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.413668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.413747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.413826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.413905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.413987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.414082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.414166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.414247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.414326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.414403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.414480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.414556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.414632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.414711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.414788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.414866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.414945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.415026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.415103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.415181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.415261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.415339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.415418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.415495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.415571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.415650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.415726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.415800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.415876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.415954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.416035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.416112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.416188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.416262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.416339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.416416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.416491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.416566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.416645] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.416765] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.416769] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25606, lrc_seqno=25606, guc_id=0, flags=0x73 in no process [-1] <7> [105.416772] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.416840] ------------[ cut here ]------------ <4> [105.416841] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.416843] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:6/205 <4> [105.416928] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.416993] [last unloaded: snd_hda_intel] <4> [105.416996] CPU: 2 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.416999] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.417000] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.417001] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.417010] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.417086] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.417087] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [105.417090] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.417091] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.417092] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.417094] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.417095] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.417096] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [105.417098] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.417099] CR2: 0000743421432000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.417101] PKRU: 55555554 <4> [105.417102] Call Trace: <4> [105.417103] <TASK> <4> [105.417107] ? lock_acquire+0x60/0x300 <4> [105.417112] ? lock_release+0xd0/0x2b0 <4> [105.417117] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.417123] process_one_work+0x239/0x740 <4> [105.417130] worker_thread+0x200/0x3f0 <4> [105.417133] ? __pfx_worker_thread+0x10/0x10 <4> [105.417136] kthread+0x10d/0x150 <4> [105.417138] ? __pfx_kthread+0x10/0x10 <4> [105.417141] ret_from_fork+0x3bd/0x470 <4> [105.417143] ? __pfx_kthread+0x10/0x10 <4> [105.417146] ret_from_fork_asm+0x1a/0x30 <4> [105.417154] </TASK> <4> [105.417155] irq event stamp: 1215041 <4> [105.417157] hardirqs last enabled at (1215047): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.417159] hardirqs last disabled at (1215052): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.417161] softirqs last enabled at (1214144): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.417164] softirqs last disabled at (1214137): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.417167] ---[ end trace 0000000000000000 ]--- <7> [105.418207] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [105.418320] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [105.418509] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25661, lrc_seqno=25661, guc_id=0, flags=0x73 in no process [-1] <7> [105.418514] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.418589] ------------[ cut here ]------------ <4> [105.418591] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.418592] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:6/205 <4> [105.418677] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.418742] [last unloaded: snd_hda_intel] <4> [105.418745] CPU: 10 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.418748] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.418750] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.418751] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.418757] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.418839] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.418840] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [105.418843] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.418844] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.418846] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.418847] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.418848] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.418849] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [105.418851] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.418852] CR2: 0000743421428000 CR3: 0000000140845005 CR4: 0000000000f72ef0 <4> [105.418854] PKRU: 55555554 <4> [105.418855] Call Trace: <4> [105.418856] <TASK> <4> [105.418860] ? lock_acquire+0x60/0x300 <4> [105.418865] ? lock_release+0xd0/0x2b0 <4> [105.418869] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.418876] process_one_work+0x239/0x740 <4> [105.418882] worker_thread+0x200/0x3f0 <4> [105.418885] ? __pfx_worker_thread+0x10/0x10 <4> [105.418888] kthread+0x10d/0x150 <4> [105.418890] ? __pfx_kthread+0x10/0x10 <4> [105.418893] ret_from_fork+0x3bd/0x470 <4> [105.418895] ? __pfx_kthread+0x10/0x10 <4> [105.418898] ret_from_fork_asm+0x1a/0x30 <4> [105.418906] </TASK> <4> [105.418907] irq event stamp: 1216923 <4> [105.418908] hardirqs last enabled at (1216929): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.418910] hardirqs last disabled at (1216934): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.418912] softirqs last enabled at (1214144): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.418915] softirqs last disabled at (1214137): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.418917] ---[ end trace 0000000000000000 ]--- <6> [105.418919] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.418998] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.419055] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.419103] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.419585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.419684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.419782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.419874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.419966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.420067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.420157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.420245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.420329] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.420428] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.420522] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.421563] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.432023] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.432305] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.433365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.433452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.433534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.433614] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.433691] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.433769] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.433846] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.433923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.433999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.434092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.434168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.434243] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.434319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.434396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.434472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.434547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.434623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.434698] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.434774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.434860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.434944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.435030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.435111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.435192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.435272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.435351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.435429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.435507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.435588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.435671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.435752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.435832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.435910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.435989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.436083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.436168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.436251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.436331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.436411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.436489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.436567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.436645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.436722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.436800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.436879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.436956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.437041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.437117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.437193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.437269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.437347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.437423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.437501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.437577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.437653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.437730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.437806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.437881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.437956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.438041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.438118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.438194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.438270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.438345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.438421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.438497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.438572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.438647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.438726] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.438846] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.438850] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25661, lrc_seqno=25661, guc_id=0, flags=0x73 in no process [-1] <7> [105.438852] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.438920] ------------[ cut here ]------------ <4> [105.438921] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.438922] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:6/205 <4> [105.439000] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.439069] [last unloaded: snd_hda_intel] <4> [105.439073] CPU: 10 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.439076] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.439077] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.439078] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.439084] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.439159] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.439161] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [105.439163] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.439164] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.439166] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.439167] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.439168] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.439169] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [105.439171] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.439173] CR2: 0000743421428000 CR3: 0000000140845005 CR4: 0000000000f72ef0 <4> [105.439174] PKRU: 55555554 <4> [105.439175] Call Trace: <4> [105.439176] <TASK> <4> [105.439180] ? lock_acquire+0x60/0x300 <4> [105.439185] ? lock_release+0xd0/0x2b0 <4> [105.439190] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.439196] process_one_work+0x239/0x740 <4> [105.439203] worker_thread+0x200/0x3f0 <4> [105.439206] ? __pfx_worker_thread+0x10/0x10 <4> [105.439208] kthread+0x10d/0x150 <4> [105.439211] ? __pfx_kthread+0x10/0x10 <4> [105.439214] ret_from_fork+0x3bd/0x470 <4> [105.439216] ? __pfx_kthread+0x10/0x10 <4> [105.439218] ret_from_fork_asm+0x1a/0x30 <4> [105.439226] </TASK> <4> [105.439227] irq event stamp: 1220211 <4> [105.439228] hardirqs last enabled at (1220217): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.439230] hardirqs last disabled at (1220222): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.439232] softirqs last enabled at (1219480): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.439235] softirqs last disabled at (1219475): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.439237] ---[ end trace 0000000000000000 ]--- <6> [105.440165] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.440245] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.440251] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.440268] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [105.440378] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [105.440487] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.440704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.440802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.440901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.440992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.441100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.441187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.441274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.441363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.441444] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.441546] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.441641] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.442674] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.453008] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.453267] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.454244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.454325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.454400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.454475] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.454547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.454619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.454690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.454761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.454830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.454901] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.454971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.455050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.455120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.455190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.455259] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.455328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.455397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.455466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.455535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.455615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.455693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.455767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.455839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.455912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.455984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.456067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.456138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.456208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.456278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.456355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.456430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.456503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.456575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.456648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.456725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.456803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.456880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.456954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.457033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.457109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.457187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.457258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.457327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.457397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.457474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.457551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.457629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.457705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.457779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.457855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.457933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.458016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.458100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.458177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.458247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.458320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.458393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.458462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.458532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.458604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.458674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.458747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.458822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.458898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.458971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.459054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.459130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.459207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.459285] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.459403] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.459406] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25661, lrc_seqno=25661, guc_id=0, flags=0x73 in no process [-1] <7> [105.459409] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.459470] ------------[ cut here ]------------ <4> [105.459471] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.459473] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:7/710 <4> [105.459544] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.459603] [last unloaded: snd_hda_intel] <4> [105.459606] CPU: 0 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.459609] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.459610] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.459611] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.459616] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.459685] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.459687] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [105.459689] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.459690] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.459691] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.459692] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.459693] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.459695] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [105.459696] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.459697] CR2: 0000743421430000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.459699] PKRU: 55555554 <4> [105.459700] Call Trace: <4> [105.459701] <TASK> <4> [105.459704] ? lock_acquire+0x60/0x300 <4> [105.459709] ? lock_release+0xd0/0x2b0 <4> [105.459713] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.459719] process_one_work+0x239/0x740 <4> [105.459725] worker_thread+0x200/0x3f0 <4> [105.459728] ? __pfx_worker_thread+0x10/0x10 <4> [105.459730] kthread+0x10d/0x150 <4> [105.459732] ? __pfx_kthread+0x10/0x10 <4> [105.459735] ret_from_fork+0x3bd/0x470 <4> [105.459737] ? __pfx_kthread+0x10/0x10 <4> [105.459740] ret_from_fork_asm+0x1a/0x30 <4> [105.459747] </TASK> <4> [105.459748] irq event stamp: 850795 <4> [105.459749] hardirqs last enabled at (850801): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.459751] hardirqs last disabled at (850806): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.459753] softirqs last enabled at (849752): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.459756] softirqs last disabled at (849745): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.459758] ---[ end trace 0000000000000000 ]--- <5> [105.460804] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25716, lrc_seqno=25716, guc_id=0, flags=0x73 in no process [-1] <7> [105.460811] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.460941] ------------[ cut here ]------------ <4> [105.460943] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.460944] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:7/710 <4> [105.461041] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.461108] [last unloaded: snd_hda_intel] <4> [105.461111] CPU: 2 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.461114] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.461115] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.461117] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.461123] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <7> [105.461103] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [105.461202] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.461204] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [105.461206] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.461207] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.461208] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.461209] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.461210] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.461211] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [105.461212] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.461214] CR2: 0000743421433000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.461215] PKRU: 55555554 <4> [105.461216] Call Trace: <4> [105.461217] <TASK> <4> [105.461220] ? lock_acquire+0x60/0x300 <4> [105.461225] ? lock_release+0xd0/0x2b0 <4> [105.461236] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.461242] process_one_work+0x239/0x740 <4> [105.461249] worker_thread+0x200/0x3f0 <4> [105.461252] ? __pfx_worker_thread+0x10/0x10 <4> [105.461255] kthread+0x10d/0x150 <4> [105.461257] ? __pfx_kthread+0x10/0x10 <4> [105.461260] ret_from_fork+0x3bd/0x470 <4> [105.461262] ? __pfx_kthread+0x10/0x10 <4> [105.461265] ret_from_fork_asm+0x1a/0x30 <4> [105.461273] </TASK> <4> [105.461274] irq event stamp: 852687 <4> [105.461275] hardirqs last enabled at (852693): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.461277] hardirqs last disabled at (852698): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.461279] softirqs last enabled at (851944): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.461282] softirqs last disabled at (851935): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <7> [105.461233] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [105.461284] ---[ end trace 0000000000000000 ]--- <6> [105.461286] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.461363] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.461369] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.461417] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.461892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.461991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.462105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.462198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.462289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.462379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.462469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.462560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.462653] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.462756] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.462850] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.463887] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.474007] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.474267] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.475304] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.475390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.475471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.475553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.475634] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.475714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.475792] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.475870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.475947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.476032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.476107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.476182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.476258] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.476333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.476409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.476484] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.476560] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.476636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.476712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.476798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.476884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.476967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.477057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.477140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.477222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.477304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.477383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.477463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.477541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.477623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.477704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.477784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.477865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.477946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.478037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.478123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.478208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.478289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.478369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.478447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.478524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.478601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.478678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.478755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.478834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.478912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.478990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.479082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.479161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.479243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.479325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.479403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.479482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.479560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.479637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.479716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.479795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.479872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.479948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.480033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.480111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.480190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.480267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.480344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.480426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.480507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.480587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.480663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.480743] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.480867] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.480871] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25716, lrc_seqno=25716, guc_id=0, flags=0x73 in no process [-1] <7> [105.480874] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.480941] ------------[ cut here ]------------ <4> [105.480943] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.480944] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:7/710 <4> [105.481028] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.481093] [last unloaded: snd_hda_intel] <4> [105.481096] CPU: 2 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.481099] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.481100] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.481102] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.481107] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.481184] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.481185] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [105.481188] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.481189] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.481191] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.481192] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.481193] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.481194] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [105.481196] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.481197] CR2: 0000743421433000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.481199] PKRU: 55555554 <4> [105.481200] Call Trace: <4> [105.481201] <TASK> <4> [105.481205] ? lock_acquire+0x60/0x300 <4> [105.481210] ? lock_release+0xd0/0x2b0 <4> [105.481215] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.481221] process_one_work+0x239/0x740 <4> [105.481227] worker_thread+0x200/0x3f0 <4> [105.481231] ? __pfx_worker_thread+0x10/0x10 <4> [105.481233] kthread+0x10d/0x150 <4> [105.481236] ? __pfx_kthread+0x10/0x10 <4> [105.481238] ret_from_fork+0x3bd/0x470 <4> [105.481241] ? __pfx_kthread+0x10/0x10 <4> [105.481243] ret_from_fork_asm+0x1a/0x30 <4> [105.481251] </TASK> <4> [105.481252] irq event stamp: 855875 <4> [105.481253] hardirqs last enabled at (855881): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.481256] hardirqs last disabled at (855886): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.481257] softirqs last enabled at (854972): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.481260] softirqs last disabled at (854965): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.481263] ---[ end trace 0000000000000000 ]--- <6> [105.481265] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.481340] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.481346] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.482586] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [105.482698] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [105.482809] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.483029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.483126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.483223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.483311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.483398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.483484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.483571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.483659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.483742] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.483843] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.483937] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.485047] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.495006] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.495279] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.496289] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.496376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.496459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.496541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.496621] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.496700] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.496778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.496855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.496933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.497015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.497092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.497168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.497244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.497319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.497395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.497470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.497546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.497622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.497698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.497784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.497868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.497951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.498039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.498120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.498200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.498279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.498357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.498435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.498513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.498593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.498674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.498754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.498833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.498912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.499001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.499086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.499170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.499251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.499331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.499410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.499489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.499567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.499644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.499722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.499801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.499879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.499957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.500049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.500125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.500204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.500284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.500361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.500439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.500515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.500592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.500670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.500748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.500824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.500900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.500979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.501064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.501142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.501218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.501294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.501371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.501447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.501522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.501597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.501676] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.501796] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.501800] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25716, lrc_seqno=25716, guc_id=0, flags=0x73 in no process [-1] <7> [105.501803] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.501871] ------------[ cut here ]------------ <4> [105.501872] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.501873] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [105.501951] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.502044] [last unloaded: snd_hda_intel] <4> [105.502048] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.502051] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.502052] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.502053] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.502059] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.502135] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.502137] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [105.502139] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.502141] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.502142] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.502143] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.502144] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.502146] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [105.502147] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.502149] CR2: 0000743421428000 CR3: 0000000140845005 CR4: 0000000000f72ef0 <4> [105.502150] PKRU: 55555554 <4> [105.502151] Call Trace: <4> [105.502152] <TASK> <4> [105.502157] ? lock_acquire+0x60/0x300 <4> [105.502162] ? lock_release+0xd0/0x2b0 <4> [105.502167] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.502173] process_one_work+0x239/0x740 <4> [105.502179] worker_thread+0x200/0x3f0 <4> [105.502182] ? __pfx_worker_thread+0x10/0x10 <4> [105.502185] kthread+0x10d/0x150 <4> [105.502187] ? __pfx_kthread+0x10/0x10 <4> [105.502190] ret_from_fork+0x3bd/0x470 <4> [105.502193] ? __pfx_kthread+0x10/0x10 <4> [105.502195] ret_from_fork_asm+0x1a/0x30 <4> [105.502203] </TASK> <4> [105.502204] irq event stamp: 1500177 <4> [105.502205] hardirqs last enabled at (1500183): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.502208] hardirqs last disabled at (1500188): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.502209] softirqs last enabled at (1499282): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.502212] softirqs last disabled at (1499275): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.502215] ---[ end trace 0000000000000000 ]--- <5> [105.503118] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25771, lrc_seqno=25771, guc_id=0, flags=0x73 in no process [-1] <7> [105.503128] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.503298] ------------[ cut here ]------------ <4> [105.503299] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.503302] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#12: kworker/u64:2/121 <4> [105.503430] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.503523] [last unloaded: snd_hda_intel] <4> [105.503528] CPU: 12 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.503533] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.503535] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.503537] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [105.503500] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [105.503546] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <7> [105.503613] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [105.503665] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.503668] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [105.503671] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.503673] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.503674] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.503676] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.503677] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.503679] FS: 0000000000000000(0000) GS:ffff8888db283000(0000) knlGS:0000000000000000 <4> [105.503681] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.503683] CR2: 000074342142b000 CR3: 000000000344a002 CR4: 0000000000f72ef0 <4> [105.503684] PKRU: 55555554 <4> [105.503686] Call Trace: <4> [105.503687] <TASK> <4> [105.503694] ? lock_acquire+0x60/0x300 <4> [105.503701] ? lock_release+0xd0/0x2b0 <4> [105.503709] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.503718] process_one_work+0x239/0x740 <4> [105.503730] worker_thread+0x200/0x3f0 <4> [105.503734] ? __pfx_worker_thread+0x10/0x10 <4> [105.503738] kthread+0x10d/0x150 <4> [105.503741] ? __pfx_kthread+0x10/0x10 <4> [105.503746] ret_from_fork+0x3bd/0x470 <4> [105.503749] ? __pfx_kthread+0x10/0x10 <4> [105.503753] ret_from_fork_asm+0x1a/0x30 <4> [105.503766] </TASK> <4> [105.503767] irq event stamp: 1502029 <4> [105.503769] hardirqs last enabled at (1502035): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.503773] hardirqs last disabled at (1502040): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.503775] softirqs last enabled at (1499282): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.503779] softirqs last disabled at (1499275): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.503783] ---[ end trace 0000000000000000 ]--- <6> [105.503785] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.503906] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.503917] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.504115] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.504332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.504427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.504525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.504616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.504706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.504794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.504882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.504972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.505067] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.505172] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.505265] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.506301] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.517003] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.517284] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.518284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.518370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.518451] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.518532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.518611] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.518689] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.518768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.518845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.518923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.519004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.519083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.519161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.519240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.519318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.519395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.519471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.519547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.519622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.519698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.519784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.519869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.519952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.520047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.520130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.520211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.520289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.520366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.520443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.520519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.520598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.520678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.520756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.520834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.520912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.520999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.521083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.521165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.521244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.521322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.521397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.521473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.521550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.521626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.521703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.521779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.521858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.521940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.522023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.522101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.522179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.522259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.522336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.522418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.522495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.522570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.522647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.522727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.522804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.522879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.522962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.523050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.523130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.523207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.523282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.523357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.523434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.523509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.523584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.523663] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.523782] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.523787] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25771, lrc_seqno=25771, guc_id=0, flags=0x73 in no process [-1] <7> [105.523790] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.523858] ------------[ cut here ]------------ <4> [105.523859] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.523861] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:2/121 <4> [105.523939] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.524013] [last unloaded: snd_hda_intel] <4> [105.524017] CPU: 10 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.524019] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.524021] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.524022] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.524028] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.524105] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.524106] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [105.524109] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.524110] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.524112] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.524113] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.524114] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.524115] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [105.524117] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.524118] CR2: 0000743421428000 CR3: 0000000140845005 CR4: 0000000000f72ef0 <4> [105.524120] PKRU: 55555554 <4> [105.524121] Call Trace: <4> [105.524122] <TASK> <4> [105.524126] ? lock_acquire+0x60/0x300 <4> [105.524132] ? lock_release+0xd0/0x2b0 <4> [105.524137] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.524143] process_one_work+0x239/0x740 <4> [105.524150] worker_thread+0x200/0x3f0 <4> [105.524153] ? __pfx_worker_thread+0x10/0x10 <4> [105.524156] kthread+0x10d/0x150 <4> [105.524159] ? __pfx_kthread+0x10/0x10 <4> [105.524162] ret_from_fork+0x3bd/0x470 <4> [105.524164] ? __pfx_kthread+0x10/0x10 <4> [105.524167] ret_from_fork_asm+0x1a/0x30 <4> [105.524175] </TASK> <4> [105.524176] irq event stamp: 1505201 <4> [105.524177] hardirqs last enabled at (1505207): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.524180] hardirqs last disabled at (1505212): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.524181] softirqs last enabled at (1504306): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.524185] softirqs last disabled at (1504299): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.524187] ---[ end trace 0000000000000000 ]--- <6> [105.524189] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.524264] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.524270] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.525512] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [105.525624] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [105.525733] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.525954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.526069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.526169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.526260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.526347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.526434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.526523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.526614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.526698] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.526797] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.526889] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.527924] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.538009] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.538267] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.539337] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.539422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.539503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.539584] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.539662] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.539739] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.539818] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.539895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.539972] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.540058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.540134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.540210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.540285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.540359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.540434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.540509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.540582] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.540656] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.540729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.540813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.540897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.540978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.541071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.541151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.541232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.541313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.541392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.541470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.541547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.541637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.541719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.541798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.541878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.541957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.542058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.542142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.542226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.542307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.542386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.542462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.542540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.542616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.542692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.542768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.542848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.542924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.543008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.543087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.543162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.543239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.543316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.543390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.543473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.543552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.543644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.543727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.543806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.543881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.543957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.544047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.544123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.544201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.544277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.544352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.544429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.544506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.544580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.544655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.544735] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.544857] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.544861] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25771, lrc_seqno=25771, guc_id=0, flags=0x73 in no process [-1] <7> [105.544864] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.544931] ------------[ cut here ]------------ <4> [105.544932] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.544933] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:6/205 <4> [105.545019] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.545086] [last unloaded: snd_hda_intel] <4> [105.545090] CPU: 0 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.545093] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.545094] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.545095] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.545101] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.545177] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.545179] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [105.545181] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.545182] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.545184] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.545185] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.545186] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.545188] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [105.545189] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.545191] CR2: 0000743421430000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.545192] PKRU: 55555554 <4> [105.545193] Call Trace: <4> [105.545194] <TASK> <4> [105.545198] ? lock_acquire+0x60/0x300 <4> [105.545203] ? lock_release+0xd0/0x2b0 <4> [105.545208] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.545214] process_one_work+0x239/0x740 <4> [105.545221] worker_thread+0x200/0x3f0 <4> [105.545224] ? __pfx_worker_thread+0x10/0x10 <4> [105.545226] kthread+0x10d/0x150 <4> [105.545229] ? __pfx_kthread+0x10/0x10 <4> [105.545231] ret_from_fork+0x3bd/0x470 <4> [105.545234] ? __pfx_kthread+0x10/0x10 <4> [105.545236] ret_from_fork_asm+0x1a/0x30 <4> [105.545244] </TASK> <4> [105.545245] irq event stamp: 1226331 <4> [105.545246] hardirqs last enabled at (1226337): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.545249] hardirqs last disabled at (1226342): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.545250] softirqs last enabled at (1225166): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.545253] softirqs last disabled at (1225157): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.545256] ---[ end trace 0000000000000000 ]--- <5> [105.546468] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25826, lrc_seqno=25826, guc_id=0, flags=0x73 in no process [-1] <7> [105.546471] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.546540] ------------[ cut here ]------------ <4> [105.546541] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.546542] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:6/205 <4> [105.546617] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.546683] [last unloaded: snd_hda_intel] <4> [105.546686] CPU: 0 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.546688] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.546689] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.546691] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.546696] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.546770] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.546771] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [105.546773] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.546774] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.546776] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.546777] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.546778] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.546779] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [105.546781] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.546782] CR2: 0000743421430000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.546783] PKRU: 55555554 <4> [105.546785] Call Trace: <4> [105.546786] <TASK> <4> [105.546789] ? lock_acquire+0x60/0x300 <4> [105.546794] ? lock_release+0xd0/0x2b0 <4> [105.546799] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.546805] process_one_work+0x239/0x740 <4> [105.546811] worker_thread+0x200/0x3f0 <4> [105.546814] ? __pfx_worker_thread+0x10/0x10 <4> [105.546817] kthread+0x10d/0x150 <4> [105.546819] ? __pfx_kthread+0x10/0x10 <4> [105.546822] ret_from_fork+0x3bd/0x470 <4> [105.546824] ? __pfx_kthread+0x10/0x10 <4> [105.546827] ret_from_fork_asm+0x1a/0x30 <4> [105.546834] </TASK> <4> [105.546835] irq event stamp: 1228197 <4> [105.546836] hardirqs last enabled at (1228203): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.546838] hardirqs last disabled at (1228208): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.546840] softirqs last enabled at (1225166): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.546843] softirqs last disabled at (1225157): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.546846] ---[ end trace 0000000000000000 ]--- <7> [105.546860] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [105.546972] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [105.547091] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.547174] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.547180] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.547422] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.547633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.547727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.547824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.547914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.548009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.548096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.548185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.548273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.548357] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.548457] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.548550] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.549595] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.560001] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.560261] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.561294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.561374] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.561446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.561517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.561588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.561658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.561728] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.561798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.561867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.561936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.562009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.562084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.562158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.562226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.562295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.562364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.562432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.562501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.562570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.562647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.562724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.562797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.562875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.562948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.563027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.563110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.563186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.563256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.563325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.563400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.563478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.563551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.563624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.563697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.563774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.563851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.563928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.564009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.564088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.564163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.564233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.564302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.564370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.564439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.564510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.564581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.564651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.564721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.564790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.564860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.564932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.565007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.565083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.565160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.565230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.565300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.565371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.565438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.565507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.565578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.565648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.565718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.565789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.565856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.565925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.565998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.566069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.566144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.566219] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.566333] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.566337] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25826, lrc_seqno=25826, guc_id=0, flags=0x73 in no process [-1] <7> [105.566339] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.566400] ------------[ cut here ]------------ <4> [105.566401] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.566402] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:6/205 <4> [105.566474] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.566533] [last unloaded: snd_hda_intel] <4> [105.566535] CPU: 0 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.566538] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.566539] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.566541] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.566546] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.566634] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.566636] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [105.566638] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.566640] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.566641] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.566643] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.566644] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.566645] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [105.566647] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.566649] CR2: 0000743421430000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.566650] PKRU: 55555554 <4> [105.566652] Call Trace: <4> [105.566653] <TASK> <4> [105.566657] ? lock_acquire+0x60/0x300 <4> [105.566662] ? lock_release+0xd0/0x2b0 <4> [105.566668] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.566675] process_one_work+0x239/0x740 <4> [105.566682] worker_thread+0x200/0x3f0 <4> [105.566685] ? __pfx_worker_thread+0x10/0x10 <4> [105.566688] kthread+0x10d/0x150 <4> [105.566691] ? __pfx_kthread+0x10/0x10 <4> [105.566694] ret_from_fork+0x3bd/0x470 <4> [105.566696] ? __pfx_kthread+0x10/0x10 <4> [105.566699] ret_from_fork_asm+0x1a/0x30 <4> [105.566708] </TASK> <4> [105.566709] irq event stamp: 1231369 <4> [105.566710] hardirqs last enabled at (1231375): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.566713] hardirqs last disabled at (1231380): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.566715] softirqs last enabled at (1230416): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.566718] softirqs last disabled at (1230409): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.566721] ---[ end trace 0000000000000000 ]--- <6> [105.566723] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.566795] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.566801] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.568097] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [105.568200] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [105.568303] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.568505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.568589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.568677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.568760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.568839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.568918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.569003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.569095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.569173] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.569265] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.569350] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.570373] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.580998] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.581252] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.582366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.582448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.582529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.582608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.582685] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.582760] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.582835] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.582906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.582979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.583067] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.583142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.583217] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.583295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.583372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.583450] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.583525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.583601] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.583676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.583752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.583837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.583922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.584001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.584080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.584159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.584234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.584310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.584383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.584455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.584525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.584596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.584669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.584744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.584817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.584890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.584968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.585057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.585143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.585225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.585309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.585387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.585464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.585540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.585617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.585695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.585773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.585851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.585928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.586014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.586092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.586170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.586248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.586324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.586399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.586474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.586549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.586625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.586701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.586774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.586848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.586924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.587010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.587090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.587168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.587244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.587322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.587399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.587473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.587547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.587624] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.587742] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.587747] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25826, lrc_seqno=25826, guc_id=0, flags=0x73 in no process [-1] <7> [105.587749] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.587818] ------------[ cut here ]------------ <4> [105.587819] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.587821] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:6/205 <4> [105.587898] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.587963] [last unloaded: snd_hda_intel] <4> [105.587966] CPU: 0 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.587968] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.587970] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.587971] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.587977] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.588063] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.588065] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [105.588067] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.588069] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.588070] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.588072] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.588073] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.588075] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [105.588076] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.588078] CR2: 0000743421430000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.588079] PKRU: 55555554 <4> [105.588081] Call Trace: <4> [105.588082] <TASK> <4> [105.588086] ? lock_acquire+0x60/0x300 <4> [105.588091] ? lock_release+0xd0/0x2b0 <4> [105.588096] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.588102] process_one_work+0x239/0x740 <4> [105.588108] worker_thread+0x200/0x3f0 <4> [105.588111] ? __pfx_worker_thread+0x10/0x10 <4> [105.588114] kthread+0x10d/0x150 <4> [105.588116] ? __pfx_kthread+0x10/0x10 <4> [105.588120] ret_from_fork+0x3bd/0x470 <4> [105.588122] ? __pfx_kthread+0x10/0x10 <4> [105.588124] ret_from_fork_asm+0x1a/0x30 <4> [105.588132] </TASK> <4> [105.588134] irq event stamp: 1234529 <4> [105.588135] hardirqs last enabled at (1234535): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.588137] hardirqs last disabled at (1234540): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.588139] softirqs last enabled at (1233358): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.588142] softirqs last disabled at (1233351): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.588144] ---[ end trace 0000000000000000 ]--- <5> [105.588707] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25881, lrc_seqno=25881, guc_id=0, flags=0x73 in no process [-1] <7> [105.588715] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.588853] ------------[ cut here ]------------ <4> [105.588855] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.588856] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:2/121 <4> [105.588943] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.589028] [last unloaded: snd_hda_intel] <4> [105.589033] CPU: 2 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.589039] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.589040] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.589041] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.589049] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.589138] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.589140] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [105.589143] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.589144] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.589146] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.589147] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.589148] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.589149] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [105.589151] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.589152] CR2: 0000743421433000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.589154] PKRU: 55555554 <4> [105.589155] Call Trace: <4> [105.589156] <TASK> <4> [105.589160] ? lock_acquire+0x60/0x300 <4> [105.589166] ? lock_release+0xd0/0x2b0 <4> [105.589171] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.589178] process_one_work+0x239/0x740 <4> [105.589185] worker_thread+0x200/0x3f0 <4> [105.589188] ? __pfx_worker_thread+0x10/0x10 <4> [105.589191] kthread+0x10d/0x150 <4> [105.589193] ? __pfx_kthread+0x10/0x10 <4> [105.589196] ret_from_fork+0x3bd/0x470 <4> [105.589198] ? __pfx_kthread+0x10/0x10 <4> [105.589201] ret_from_fork_asm+0x1a/0x30 <4> [105.589208] </TASK> <4> [105.589210] irq event stamp: 1507013 <4> [105.589211] hardirqs last enabled at (1507019): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.589215] hardirqs last disabled at (1507024): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.589217] softirqs last enabled at (1506584): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.589220] softirqs last disabled at (1506579): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.589222] ---[ end trace 0000000000000000 ]--- <6> [105.589225] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.589313] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.589655] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.589668] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [105.589778] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [105.589903] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.590133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.590236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.590336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.590428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.590517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.590602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.590689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.590775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.590858] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.590957] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.591078] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.592131] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.601998] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.602259] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.603221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.603309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.603391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.603471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.603551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.603630] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.603707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.603785] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.603865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.603943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.604028] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.604106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.604182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.604258] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.604334] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.604409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.604485] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.604561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.604635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.604722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.604807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.604890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.604970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.605063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.605144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.605222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.605300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.605377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.605454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.605535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.605615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.605694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.605773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.605853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.605937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.606026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.606111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.606193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.606273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.606351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.606429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.606507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.606584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.606663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.606743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.606823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.606902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.606980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.607085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.607164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.607244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.607321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.607398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.607474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.607550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.607628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.607705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.607780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.607855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.607936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.608018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.608095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.608173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.608249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.608327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.608404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.608480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.608553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.608631] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.608752] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.608757] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25881, lrc_seqno=25881, guc_id=0, flags=0x73 in no process [-1] <7> [105.608760] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.609683] ------------[ cut here ]------------ <4> [105.609684] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.609686] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:7/710 <4> [105.609765] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.609832] [last unloaded: snd_hda_intel] <4> [105.609835] CPU: 5 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.609838] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.609839] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.609841] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.609847] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.609923] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.609925] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [105.609927] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.609929] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.609930] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.609931] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.609933] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.609934] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [105.609935] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.609937] CR2: 0000743421431000 CR3: 0000000140845006 CR4: 0000000000f72ef0 <4> [105.609938] PKRU: 55555554 <4> [105.609940] Call Trace: <4> [105.609941] <TASK> <4> [105.609945] ? lock_acquire+0x60/0x300 <4> [105.609950] ? lock_release+0xd0/0x2b0 <4> [105.609955] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.609961] process_one_work+0x239/0x740 <4> [105.609968] worker_thread+0x200/0x3f0 <4> [105.609971] ? __pfx_worker_thread+0x10/0x10 <4> [105.609974] kthread+0x10d/0x150 <4> [105.609976] ? __pfx_kthread+0x10/0x10 <4> [105.609979] ret_from_fork+0x3bd/0x470 <4> [105.609981] ? __pfx_kthread+0x10/0x10 <4> [105.609984] ret_from_fork_asm+0x1a/0x30 <4> [105.609996] </TASK> <4> [105.609997] irq event stamp: 862603 <4> [105.609998] hardirqs last enabled at (862609): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.610001] hardirqs last disabled at (862614): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.610003] softirqs last enabled at (861702): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.610006] softirqs last disabled at (861695): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.610009] ---[ end trace 0000000000000000 ]--- <6> [105.610011] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.610087] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.610095] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.610513] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [105.610624] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [105.610735] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.610948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.611062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.611159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.611249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.611338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.611424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.611513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.611609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.611696] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.611796] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.611889] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.612923] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.622996] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.623253] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.624407] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.624492] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.624574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.624653] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.624733] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.624811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.624888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.624964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.625054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.625132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.625209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.625286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.625362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.625439] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.625515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.625592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.625667] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.625744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.625819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.625904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.625991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.626074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.626154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.626234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.626314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.626393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.626469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.626545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.626619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.626696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.626776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.626855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.626935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.627027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.627112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.627197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.627280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.627362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.627442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.627518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.627596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.627673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.627750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.627827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.627907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.627985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.628082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.628160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.628236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.628314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.628394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.628470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.628547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.628623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.628702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.628782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.628860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.628937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.629023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.629103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.629181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.629261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.629340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.629418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.629498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.629575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.629652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.629727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.629805] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.629924] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.629931] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25881, lrc_seqno=25881, guc_id=0, flags=0x73 in no process [-1] <7> [105.629934] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.630070] ------------[ cut here ]------------ <4> [105.630072] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.630074] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:6/205 <4> [105.630214] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.630285] [last unloaded: snd_hda_intel] <4> [105.630288] CPU: 0 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.630291] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.630294] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.630296] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.630302] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.630393] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.630395] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [105.630397] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.630399] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.630400] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.630402] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.630403] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.630404] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [105.630406] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.630407] CR2: 0000743421430000 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [105.630409] PKRU: 55555554 <4> [105.630410] Call Trace: <4> [105.630412] <TASK> <4> [105.630416] ? lock_acquire+0x60/0x300 <4> [105.630421] ? lock_release+0xd0/0x2b0 <4> [105.630426] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.630432] process_one_work+0x239/0x740 <4> [105.630440] worker_thread+0x200/0x3f0 <4> [105.630443] ? __pfx_worker_thread+0x10/0x10 <4> [105.630446] kthread+0x10d/0x150 <4> [105.630448] ? __pfx_kthread+0x10/0x10 <4> [105.630451] ret_from_fork+0x3bd/0x470 <4> [105.630454] ? __pfx_kthread+0x10/0x10 <4> [105.630457] ret_from_fork_asm+0x1a/0x30 <4> [105.630466] </TASK> <4> [105.630467] irq event stamp: 1236563 <4> [105.630468] hardirqs last enabled at (1236569): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.630472] hardirqs last disabled at (1236574): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.630473] softirqs last enabled at (1235802): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.630476] softirqs last disabled at (1235795): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.630479] ---[ end trace 0000000000000000 ]--- <7> [105.630860] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [105.630971] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [105.631152] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25936, lrc_seqno=25936, guc_id=0, flags=0x73 in no process [-1] <7> [105.631155] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.631224] ------------[ cut here ]------------ <4> [105.631225] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.631227] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:6/205 <4> [105.631303] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.631366] [last unloaded: snd_hda_intel] <4> [105.631369] CPU: 0 UID: 0 PID: 205 Comm: kworker/u64:6 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.631371] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.631372] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.631374] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.631379] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.631453] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.631454] RSP: 0018:ffffc90001647ca0 EFLAGS: 00010246 <4> [105.631457] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.631458] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.631459] RBP: ffffc90001647db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.631460] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.631461] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.631463] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [105.631464] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.631466] CR2: 0000743421430000 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [105.631467] PKRU: 55555554 <4> [105.631468] Call Trace: <4> [105.631469] <TASK> <4> [105.631473] ? lock_acquire+0x60/0x300 <4> [105.631478] ? lock_release+0xd0/0x2b0 <4> [105.631482] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.631488] process_one_work+0x239/0x740 <4> [105.631495] worker_thread+0x200/0x3f0 <4> [105.631498] ? __pfx_worker_thread+0x10/0x10 <4> [105.631500] kthread+0x10d/0x150 <4> [105.631503] ? __pfx_kthread+0x10/0x10 <4> [105.631505] ret_from_fork+0x3bd/0x470 <4> [105.631508] ? __pfx_kthread+0x10/0x10 <4> [105.631510] ret_from_fork_asm+0x1a/0x30 <4> [105.631518] </TASK> <4> [105.631519] irq event stamp: 1238489 <4> [105.631520] hardirqs last enabled at (1238495): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.631522] hardirqs last disabled at (1238500): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.631524] softirqs last enabled at (1235802): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.631527] softirqs last disabled at (1235795): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.631529] ---[ end trace 0000000000000000 ]--- <6> [105.631531] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.631607] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.631614] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.631718] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.631942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.632058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.632162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.632257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.632347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.632434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.632521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.632609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.632693] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.632794] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.632888] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.633921] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.644001] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.644261] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.645304] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.645391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.645474] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.645554] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.645633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.645711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.645789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.645866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.645943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.646029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.646106] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.646182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.646258] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.646333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.646409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.646485] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.646560] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.646635] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.646710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.646796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.646881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.646964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.647060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.647142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.647225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.647305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.647384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.647462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.647538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.647618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.647698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.647776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.647854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.647933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.648025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.648109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.648192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.648273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.648359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.648441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.648522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.648601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.648682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.648760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.648839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.648917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.648999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.649075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.649153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.649233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.649315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.649393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.649472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.649549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.649626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.649703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.649780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.649855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.649931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.650023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.650100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.650176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.650253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.650328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.650405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.650482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.650557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.650632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.650711] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.650834] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.650838] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25936, lrc_seqno=25936, guc_id=0, flags=0x73 in no process [-1] <7> [105.650841] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.650908] ------------[ cut here ]------------ <4> [105.650910] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.650911] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:7/710 <4> [105.650993] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.651061] [last unloaded: snd_hda_intel] <4> [105.651064] CPU: 8 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.651067] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.651069] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.651070] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.651076] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.651151] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.651153] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [105.651155] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.651157] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.651158] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.651159] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.651160] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.651162] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [105.651163] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.651165] CR2: 0000743421435000 CR3: 0000000140845004 CR4: 0000000000f72ef0 <4> [105.651166] PKRU: 55555554 <4> [105.651168] Call Trace: <4> [105.651169] <TASK> <4> [105.651173] ? lock_acquire+0x60/0x300 <4> [105.651178] ? lock_release+0xd0/0x2b0 <4> [105.651182] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.651189] process_one_work+0x239/0x740 <4> [105.651195] worker_thread+0x200/0x3f0 <4> [105.651198] ? __pfx_worker_thread+0x10/0x10 <4> [105.651201] kthread+0x10d/0x150 <4> [105.651203] ? __pfx_kthread+0x10/0x10 <4> [105.651206] ret_from_fork+0x3bd/0x470 <4> [105.651208] ? __pfx_kthread+0x10/0x10 <4> [105.651211] ret_from_fork_asm+0x1a/0x30 <4> [105.651219] </TASK> <4> [105.651220] irq event stamp: 868159 <4> [105.651221] hardirqs last enabled at (868165): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.651223] hardirqs last disabled at (868170): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.651225] softirqs last enabled at (867256): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.651228] softirqs last disabled at (867197): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.651230] ---[ end trace 0000000000000000 ]--- <6> [105.652112] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.652260] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.652272] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.652251] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [105.652363] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [105.652479] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.652754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.652901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.653075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.653177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.653271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.653360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.653449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.653540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.653625] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.653725] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.653818] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.654854] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.664993] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.665250] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.666339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.666425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.666507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.666586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.666664] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.666743] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.666820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.666900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.666977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.667070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.667145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.667221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.667295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.667371] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.667447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.667522] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.667596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.667671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.667746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.667832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.667916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.668001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.668081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.668160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.668240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.668319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.668398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.668476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.668552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.668631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.668711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.668790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.668868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.668948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.669040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.669124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.669207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.669288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.669368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.669445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.669523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.669599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.669675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.669752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.669830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.669909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.669994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.670073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.670148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.670226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.670306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.670381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.670457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.670533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.670607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.670685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.670760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.670838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.670919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.671007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.671085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.671163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.671245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.671323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.671403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.671481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.671558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.671634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.671714] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.671837] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.671841] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25936, lrc_seqno=25936, guc_id=0, flags=0x73 in no process [-1] <7> [105.671844] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.671912] ------------[ cut here ]------------ <4> [105.671913] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.671915] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:7/710 <4> [105.671997] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.672063] [last unloaded: snd_hda_intel] <4> [105.672067] CPU: 8 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.672070] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.672071] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.672072] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.672078] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.672154] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.672155] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [105.672158] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.672159] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.672160] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.672161] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.672163] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.672164] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [105.672166] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.672167] CR2: 0000743421435000 CR3: 0000000140845004 CR4: 0000000000f72ef0 <4> [105.672169] PKRU: 55555554 <4> [105.672170] Call Trace: <4> [105.672171] <TASK> <4> [105.672175] ? lock_acquire+0x60/0x300 <4> [105.672180] ? lock_release+0xd0/0x2b0 <4> [105.672184] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.672191] process_one_work+0x239/0x740 <4> [105.672198] worker_thread+0x200/0x3f0 <4> [105.672201] ? __pfx_worker_thread+0x10/0x10 <4> [105.672203] kthread+0x10d/0x150 <4> [105.672206] ? __pfx_kthread+0x10/0x10 <4> [105.672209] ret_from_fork+0x3bd/0x470 <4> [105.672211] ? __pfx_kthread+0x10/0x10 <4> [105.672214] ret_from_fork_asm+0x1a/0x30 <4> [105.672222] </TASK> <4> [105.672223] irq event stamp: 871409 <4> [105.672224] hardirqs last enabled at (871415): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.672226] hardirqs last disabled at (871420): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.672228] softirqs last enabled at (870506): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.672231] softirqs last disabled at (870495): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.672233] ---[ end trace 0000000000000000 ]--- <5> [105.672587] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25991, lrc_seqno=25991, guc_id=0, flags=0x73 in no process [-1] <7> [105.672594] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.672776] ------------[ cut here ]------------ <4> [105.672777] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.672779] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:2/121 <4> [105.672872] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.672944] [last unloaded: snd_hda_intel] <4> [105.672947] CPU: 2 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.672952] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.672953] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.672954] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.672963] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.673075] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.673078] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [105.673081] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.673083] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.673084] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.673085] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.673087] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.673088] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [105.673090] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.673091] CR2: 0000743421433000 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [105.673093] PKRU: 55555554 <4> [105.673095] Call Trace: <4> [105.673097] <TASK> <4> [105.673104] ? lock_acquire+0x60/0x300 <4> [105.673110] ? lock_release+0xd0/0x2b0 <4> [105.673115] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.673123] process_one_work+0x239/0x740 <4> [105.673131] worker_thread+0x200/0x3f0 <4> [105.673134] ? __pfx_worker_thread+0x10/0x10 <4> [105.673138] kthread+0x10d/0x150 <4> [105.673141] ? __pfx_kthread+0x10/0x10 <4> [105.673144] ret_from_fork+0x3bd/0x470 <4> [105.673147] ? __pfx_kthread+0x10/0x10 <4> [105.673150] ret_from_fork_asm+0x1a/0x30 <4> [105.673158] </TASK> <4> [105.673160] irq event stamp: 1510739 <4> [105.673161] hardirqs last enabled at (1510745): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.673164] hardirqs last disabled at (1510750): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.673165] softirqs last enabled at (1510578): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.673169] softirqs last disabled at (1510573): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.673172] ---[ end trace 0000000000000000 ]--- <6> [105.673175] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.673278] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.673302] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.673497] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [105.673608] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [105.673771] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.674016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.674126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.674231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.674327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.674421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.674511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.674604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.674698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.674786] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.674894] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.674997] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.676039] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.686831] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.687135] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.688222] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.688311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.688391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.688471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.688548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.688625] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.688706] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.688781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.688856] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.688933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.689020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.689104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.689187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.689269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.689350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.689432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.689514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.689596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.689677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.689770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.689862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.689950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.690045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.690133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.690219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.690304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.690388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.690472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.690555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.690641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.690727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.690812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.690898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.690991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.691083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.691174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.691264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.691351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.691437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.691518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.691602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.691684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.691765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.691848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.691930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.692025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.692109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.692190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.692271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.692353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.692436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.692515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.692598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.692682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.692761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.692843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.692930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.693024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.693108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.693192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.693274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.693359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.693445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.693526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.693609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.693691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.693774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.693854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.693939] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.694073] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.694078] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25991, lrc_seqno=25991, guc_id=0, flags=0x73 in no process [-1] <7> [105.694081] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.694154] ------------[ cut here ]------------ <4> [105.694155] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.694156] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:2/121 <4> [105.694240] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.694305] [last unloaded: snd_hda_intel] <4> [105.694308] CPU: 2 UID: 0 PID: 121 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.694311] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.694312] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.694314] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.694320] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.694400] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.694402] RSP: 0018:ffffc90000563ca0 EFLAGS: 00010246 <4> [105.694404] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.694406] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.694407] RBP: ffffc90000563db0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.694408] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.694410] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.694411] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [105.694413] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.694414] CR2: 0000743421433000 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [105.694416] PKRU: 55555554 <4> [105.694417] Call Trace: <4> [105.694418] <TASK> <4> [105.694422] ? lock_acquire+0x60/0x300 <4> [105.694427] ? lock_release+0xd0/0x2b0 <4> [105.694432] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.694439] process_one_work+0x239/0x740 <4> [105.694445] worker_thread+0x200/0x3f0 <4> [105.694448] ? __pfx_worker_thread+0x10/0x10 <4> [105.694451] kthread+0x10d/0x150 <4> [105.694453] ? __pfx_kthread+0x10/0x10 <4> [105.694456] ret_from_fork+0x3bd/0x470 <4> [105.694459] ? __pfx_kthread+0x10/0x10 <4> [105.694462] ret_from_fork_asm+0x1a/0x30 <4> [105.694469] </TASK> <4> [105.694471] irq event stamp: 1513931 <4> [105.694472] hardirqs last enabled at (1513937): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.694474] hardirqs last disabled at (1513942): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.694476] softirqs last enabled at (1513016): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.694479] softirqs last disabled at (1513009): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.694481] ---[ end trace 0000000000000000 ]--- <6> [105.694483] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.694563] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.694570] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.695817] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [105.695929] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [105.696054] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.696288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.696389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.696490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.696585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.696677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.696766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.696854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.696942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.697041] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.697158] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.697254] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.698313] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.708992] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.709249] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.710316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.710405] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.710487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.710570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.710649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.710727] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.710804] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.710881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.710958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.711050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.711145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.711224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.711302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.711379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.711456] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.711533] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.711609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.711685] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.711761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.711848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.711932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.712034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.712140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.712224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.712305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.712384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.712462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.712540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.712619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.712700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.712782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.712861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.712941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.713036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.713143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.713232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.713319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.713401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.713481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [105.713559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [105.713638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [105.713716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [105.713794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [105.713876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [105.713958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [105.714048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [105.714155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [105.714235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [105.714312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [105.714390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [105.714470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [105.714547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [105.714625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [105.714702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [105.714777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [105.714854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [105.714930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [105.715013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [105.715106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [105.715186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [105.715263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [105.715341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [105.715433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [105.715510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [105.715588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [105.715666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [105.715742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [105.715822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [105.715905] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [105.716336] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [105.716342] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=25991, lrc_seqno=25991, guc_id=0, flags=0x73 in no process [-1] <7> [105.716344] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.716417] ------------[ cut here ]------------ <4> [105.716419] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [105.716420] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#5: kworker/u64:7/710 <4> [105.716502] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [105.716568] [last unloaded: snd_hda_intel] <4> [105.716571] CPU: 5 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.716574] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.716575] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.716577] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.716582] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.716661] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.716663] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [105.716665] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.716667] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.716668] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.716669] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.716671] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.716672] FS: 0000000000000000(0000) GS:ffff8888daf03000(0000) knlGS:0000000000000000 <4> [105.716674] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.716675] CR2: 0000743421431000 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [105.716676] PKRU: 55555554 <4> [105.716678] Call Trace: <4> [105.716679] <TASK> <4> [105.716683] ? lock_acquire+0x60/0x300 <4> [105.716688] ? lock_release+0xd0/0x2b0 <4> [105.716693] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.716699] process_one_work+0x239/0x740 <4> [105.716706] worker_thread+0x200/0x3f0 <4> [105.716709] ? __pfx_worker_thread+0x10/0x10 <4> [105.716712] kthread+0x10d/0x150 <4> [105.716714] ? __pfx_kthread+0x10/0x10 <4> [105.716717] ret_from_fork+0x3bd/0x470 <4> [105.716719] ? __pfx_kthread+0x10/0x10 <4> [105.716722] ret_from_fork_asm+0x1a/0x30 <4> [105.716730] </TASK> <4> [105.716731] irq event stamp: 876317 <4> [105.716732] hardirqs last enabled at (876323): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.716734] hardirqs last disabled at (876328): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.716736] softirqs last enabled at (875224): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.716739] softirqs last disabled at (875217): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.716741] ---[ end trace 0000000000000000 ]--- <5> [105.718000] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=26046, lrc_seqno=26046, guc_id=0, flags=0x73 in no process [-1] <7> [105.718004] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [105.718090] ------------[ cut here ]------------ <4> [105.718092] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [105.718071] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [105.718094] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#4: kworker/u64:7/710 <4> [105.718223] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm <7> [105.718235] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [105.718306] idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [105.718341] CPU: 4 UID: 0 PID: 710 Comm: kworker/u64:7 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-pw-163606v3-debug+ #1 PREEMPT(lazy) <4> [105.718345] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [105.718346] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [105.718348] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [105.718356] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [105.718448] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [105.718450] RSP: 0018:ffffc90001ffbca0 EFLAGS: 00010246 <4> [105.718452] RAX: ffffffffa12bbfb9 RBX: 0000000000000000 RCX: 0000000000000000 <4> [105.718453] RDX: ffff888104000010 RSI: ffffffffa12bbfb9 RDI: ffffffffa0c03f80 <4> [105.718455] RBP: ffffc90001ffbdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [105.718456] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [105.718457] R13: ffff888104000010 R14: ffff88812d966818 R15: 00000000ffffffc2 <4> [105.718458] FS: 0000000000000000(0000) GS:ffff8888dae83000(0000) knlGS:0000000000000000 <4> [105.718460] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [105.718461] CR2: 0000743421434000 CR3: 0000000126b65006 CR4: 0000000000f72ef0 <4> [105.718463] PKRU: 55555554 <4> [105.718464] Call Trace: <4> [105.718465] <TASK> <4> [105.718469] ? lock_acquire+0x60/0x300 <4> [105.718474] ? lock_release+0xd0/0x2b0 <4> [105.718479] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [105.718485] process_one_work+0x239/0x740 <4> [105.718492] worker_thread+0x200/0x3f0 <4> [105.718495] ? __pfx_worker_thread+0x10/0x10 <4> [105.718498] kthread+0x10d/0x150 <4> [105.718500] ? __pfx_kthread+0x10/0x10 <4> [105.718503] ret_from_fork+0x3bd/0x470 <4> [105.718505] ? __pfx_kthread+0x10/0x10 <4> [105.718508] ret_from_fork_asm+0x1a/0x30 <4> [105.718515] </TASK> <4> [105.718517] irq event stamp: 877857 <4> [105.718518] hardirqs last enabled at (877863): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [105.718520] hardirqs last disabled at (877868): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [105.718522] softirqs last enabled at (877062): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.718524] softirqs last disabled at (877047): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [105.718527] ---[ end trace 0000000000000000 ]--- <6> [105.718529] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [105.718607] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [105.718615] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [105.718670] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [105.718941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [105.719107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [105.719257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [105.719395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [105.719531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [105.719662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [105.719795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [105.719931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [105.720308] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [105.720425] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [105.720528] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [105.721570] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [105.731989] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [105.732250] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [105.733283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [105.733371] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [105.733454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [105.733536] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [105.733617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [105.733697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [105.733779] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [105.733858] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [105.733936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [105.734024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [105.734101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [105.734178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [105.734254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [105.734330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [105.734407] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [105.734482] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [105.734558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [105.734633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [105.734707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [105.734794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [105.734879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [105.734961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [105.735052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [105.735132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [105.735212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [105.735290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [105.735369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [105.735448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [105.735526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [105.735607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [105.735688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [105.735767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [105.735847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [105.735928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [105.736020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [105.736105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [105.736190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [105.736271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [105.736353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs

<4> [104.326419] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.326588] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.350296] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.350465] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.372828] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.372990] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.374106] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.374261] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.394518] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.394676] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.416141] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.416300] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.417915] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore

<4> [104.418076] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.438159] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.438314] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.459031] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.459342] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.460785] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.460945] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.484493] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.484636] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.505579] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.505723] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.506802] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.507047] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.528386] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.528529] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.551454] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.551596] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.552627] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.552794] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.573370] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.573527] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.595126] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.595286] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.597435] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.597669] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.618939] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.619109] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.639044] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.639202] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.640044] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.640327] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.661434] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.661595] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.683050] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.683429] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.685596] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.685755] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.706066] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.706222] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.726173] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.726328] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.727240] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.727423] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.747994] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.748156] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.769223] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.769378] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.771691] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.771850] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.792011] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.792171] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.811938] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.812099] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.813478] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.813637] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.832945] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.833105] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.853971] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.854130] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.855793] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.856071] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.877123] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.877281] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.898987] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.899411] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.900831] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr

<4> [104.900850] intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel]

<4> [104.900992] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.921015] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.921179] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.942894] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.943059] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.943850] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.944009] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.963975] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.964133] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.984977] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.985138] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [104.986612] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [104.986823] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.007074] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.007231] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.027939] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.028106] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.029866] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.030028] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.050616] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.050794] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.070956] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.071113] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.072743] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.072895] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.093012] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.093174] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.113919] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.114083] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.115622] drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel]

<4> [105.115768] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.135020] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.135182] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.156339] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.156496] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.158101] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.158255] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.178511] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.178826] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.198982] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.199142] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.200579] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.200826] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.221301] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.221455] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.242987] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.243152] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.244800] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.244955] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.265464] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.265756] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.285994] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.286157] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.287751] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.287901] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.307891] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.308057] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.328917] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.329083] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.330849] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.331019] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.351409] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.351565] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.373203] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.373359] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.374667] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.374887] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.395142] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.395297] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.416928] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.417086] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.418677] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.418839] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.439000] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.439159] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.459544] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.459685] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.461041] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.461202] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.481028] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.481184] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.501951] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.502135] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.503430] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.503665] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.523939] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.524105] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.545019] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.545177] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.546617] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.546770] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.566474] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.566634] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.587898] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.588063] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.588943] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.589138] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.609765] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.609923] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.630214] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.630393] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.631303] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.631453] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.650993] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.651151] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.671997] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.672154] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.672872] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.673075] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.694240] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.694400] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.716502] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [105.716661] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [105.718223] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart binfmt_misc asus_nb_wmi asus_wmi spi_nor sparse_keymap mei_pxp mei_hdcp mtd wmi_bmof kvm_intel kvm irqbypass r8169 aesni_intel gf128mul usbhid rapl hid realtek intel_cstate phy_package snd_intel_dspcfg nls_iso8859_1 snd_hda_codec video snd_hda_core intel_pmc_core snd_hwdep pmt_telemetry snd_pcm

<4> [105.718306] idma64 pmt_discovery i2c_i801 snd_timer pmt_class i2c_mux pinctrl_alderlake acpi_pad intel_pmc_ssram_telemetry acpi_tad snd spi_intel_pci mei_me soundcore spi_intel i2c_smbus intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel]

<4> [105.718448] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 60 d8 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

Results for igt@xe_pat@pt-caching-random-offsets