igt@xe_exec_system_allocator@threads-shared-vm-many-execqueues-new on shard-bmg@IGTPW

Detail	Value
Duration	unknown
Hostname	shard-bmg-3
Igt-Version	IGT-Version: 2.4-g80b96fa9b (x86_64) (Linux: 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ x86_64)
Out	Using IGT_SRANDOM=1780921944 for randomisation Opened device: /dev/dri/card0 Starting subtest: threads-shared-vm-many-execqueues-new [thread:12037] Stack trace: [thread:12037] #0 ../lib/igt_core.c:2106 __igt_fail_assert() [thread:12037] #1 [xe_wait_ufence+0x57] [thread:12037] #2 ../tests/intel/xe_exec_system_allocator.c:1789 test_exec() [thread:12037] #3 ../tests/intel/xe_exec_system_allocator.c:2082 thread() [thread:12037] #4 [pthread_condattr_setpshared+0x684] [thread:12037] #5 [__clone+0x24c] [thread:12031] Stack trace: [thread:12032] Stack trace: [thread:12033] Stack trace: [thread:12032] #0 ../lib/igt_core.c:2106 __igt_fail_assert() [thread:12031] #0 ../lib/igt_core.c:2106 __igt_fail_assert() [thread:12033] #0 ../lib/igt_core.c:2106 __igt_fail_assert() [thread:12031] #1 [xe_wait_ufence+0x57] [thread:12032] #1 [xe_wait_ufence+0x57] [thread:12033] #1 [xe_wait_ufence+0x57] [thread:12031] #2 ../tests/intel/xe_exec_system_allocator.c:1789 test_exec() [thread:12031] #3 ../tests/intel/xe_exec_system_allocator.c:2082 thread() [thread:12032] #2 ../tests/intel/xe_exec_system_allocator.c:1789 test_exec() [thread:12032] #3 ../tests/intel/xe_exec_system_allocator.c:2082 thread() [thread:12033] #2 ../tests/intel/xe_exec_system_allocator.c:1789 test_exec() [thread:12033] #3 ../tests/intel/xe_exec_system_allocator.c:2082 thread() [thread:12031] #4 [pthread_condattr_setpshared+0x684] [thread:12032] #4 [pthread_condattr_setpshared+0x684] [thread:12033] #4 [pthread_condattr_setpshared+0x684] [thread:12031] #5 [__clone+0x24c] [thread:12032] #5 [__clone+0x24c] [thread:12033] #5 [__clone+0x24c] runner: This test was killed due to a kernel taint (0x244). This test caused an abort condition: Kernel badly tainted (0x244, 0x200) (check dmesg for details): TAINT_WARN: WARN_ON has happened.
Err	Starting subtest: threads-shared-vm-many-execqueues-new [467.700250] (xe_exec_system_allocator:12028) [thread:12037] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:783: [467.700353] (xe_exec_system_allocator:12028) [thread:12037] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 [467.700393] (xe_exec_system_allocator:12028) [thread:12037] xe/xe_ioctl-CRITICAL: Last errno: 62, Timer expired [467.700426] (xe_exec_system_allocator:12028) [thread:12037] xe/xe_ioctl-CRITICAL: error: -62 != 0 [479.101007] (xe_exec_system_allocator:12028) [thread:12031] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:783: [479.101033] (xe_exec_system_allocator:12028) [thread:12031] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 [479.101014] (xe_exec_system_allocator:12028) [thread:12032] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:783: [479.101063] (xe_exec_system_allocator:12028) [thread:12032] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 [479.101044] (xe_exec_system_allocator:12028) [thread:12031] xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error [479.101084] (xe_exec_system_allocator:12028) [thread:12031] xe/xe_ioctl-CRITICAL: error: -5 != 0 [479.101064] (xe_exec_system_allocator:12028) [thread:12033] xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:783: [479.101074] (xe_exec_system_allocator:12028) [thread:12032] xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error [479.101173] (xe_exec_system_allocator:12028) [thread:12032] xe/xe_ioctl-CRITICAL: error: -5 != 0 [479.101164] (xe_exec_system_allocator:12028) [thread:12033] xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 [479.101205] (xe_exec_system_allocator:12028) [thread:12033] xe/xe_ioctl-CRITICAL: Last errno: 5, Input/output error [479.101222] (xe_exec_system_allocator:12028) [thread:12033] xe/xe_ioctl-CRITICAL: error: -5 != 0 Received signal SIGQUIT. Stack trace: #0 [fatal_sig_handler+0x17b] #1 [__sigaction+0x50] #2 [__nptl_death_event+0x17f] #3 [pthread_join+0x173] #4 [threads.constprop.0+0x29f] #5 [__igt_unique____real_main2422+0x25ef] #6 [main+0x2d] #7 [__libc_init_first+0x8a] #8 [__libc_start_main+0x8b] #9 [_start+0x25]
Dmesg Scroll to first warning	<6> [463.778538] Console: switching to colour dummy device 80x25 <6> [463.778839] [IGT] xe_exec_system_allocator: executing <6> [463.809413] [IGT] xe_exec_system_allocator: starting subtest threads-shared-vm-many-execqueues-new <7> [463.809989] xe 0000:03:00.0: [drm:drm_pagemap_dev_unhold_work [drm_gpusvm_helper]] Releasing reference on provider device and module. <7> [463.848064] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [469.277343] xe 0000:03:00.0: [drm:xe_hw_engine_snapshot_capture [xe]] Tile0: GT0: Proceeding with manual engine snapshot <4> [469.278749] ------------[ cut here ]------------ <4> [469.278759] xe 0000:03:00.0: [drm] Tile0: GT0: Unexpected engine class:instance 3:8 for utilization <4> [469.278768] WARNING: drivers/gpu/drm/xe/xe_lrc.c:2627 at engine_id_to_hwe+0x7a/0xc0 [xe], CPU#3: kworker/u64:66/10933 <4> [469.278890] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [469.278951] [last unloaded: snd_hda_intel] <4> [469.278955] CPU: 3 UID: 0 PID: 10933 Comm: kworker/u64:66 Tainted: G S U 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [469.278957] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER <4> [469.278958] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [469.278960] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [469.278965] RIP: 0010:engine_id_to_hwe+0x89/0xc0 [xe] <4> [469.279030] Code: 3f 45 0f b6 64 24 26 44 0f b6 70 08 e8 70 c3 5b e1 48 89 c6 48 8d 3d 26 52 38 00 53 41 0f b6 ce 45 89 e9 45 0f b6 c4 4c 89 fa <67> 48 0f b9 3a 45 31 f6 58 48 8d 65 d8 4c 89 f0 5b 41 5c 41 5d 41 <4> [469.279031] RSP: 0018:ffffc9000396fbd8 EFLAGS: 00010246 <4> [469.279034] RAX: ffffffffa12094ec RBX: 0000000000000008 RCX: 0000000000000000 <4> [469.279035] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1004990 <4> [469.279036] RBP: ffffc9000396fc08 R08: 0000000000000000 R09: 0000000000000003 <4> [469.279037] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [469.279038] R13: 0000000000000003 R14: 0000000000000000 R15: ffff888101713890 <4> [469.279039] FS: 0000000000000000(0000) GS:ffff8888dac02000(0000) knlGS:0000000000000000 <4> [469.279041] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [469.279042] CR2: 00007cffc8204ff8 CR3: 000000000364a003 CR4: 0000000000f72ef0 <4> [469.279043] PKRU: 55555554 <4> [469.279044] Call Trace: <4> [469.279045] <TASK> <4> [469.279048] xe_lrc_context_timestamp+0x9e/0x200 [xe] <4> [469.279112] ? xe_lrc_start_seqno+0x33/0x70 [xe] <4> [469.279177] xe_lrc_timestamp+0x25/0x30 [xe] <4> [469.279240] guc_exec_queue_timedout_job+0xf76/0x2400 [xe] <4> [469.279305] ? lock_acquire+0x80/0x300 <4> [469.279311] ? lock_release+0xd0/0x2b0 <4> [469.279315] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [469.279320] process_one_work+0x239/0x740 <4> [469.279326] worker_thread+0x200/0x3f0 <4> [469.279329] ? __pfx_worker_thread+0x10/0x10 <4> [469.279332] kthread+0x10d/0x150 <4> [469.279334] ? __pfx_kthread+0x10/0x10 <4> [469.279337] ret_from_fork+0x3bd/0x470 <4> [469.279339] ? __pfx_kthread+0x10/0x10 <4> [469.279341] ret_from_fork_asm+0x1a/0x30 <4> [469.279348] </TASK> <4> [469.279350] irq event stamp: 221607 <4> [469.279351] hardirqs last enabled at (221613): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [469.279353] hardirqs last disabled at (221618): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [469.279355] softirqs last enabled at (220814): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [469.279358] softirqs last disabled at (220809): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [469.279360] ---[ end trace 0000000000000000 ]--- <7> [469.279365] xe 0000:03:00.0: [drm:guc_exec_queue_timedout_job [xe]] Tile0: GT0: Check job timeout: seqno=12634, lrc_seqno=12634, guc_id=0, running_time_ms=233997, timeout_ms=5000, diff=0xff099761 <6> [469.920307] xe 0000:03:00.0: [drm] Tile0: GT0: Engine reset: engine_class=bcs, logical_mask: 0x2, guc_id=0, state=0x209 <5> [469.920963] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12634, lrc_seqno=12634, guc_id=0, flags=0x73 in no process [-1] <6> [470.104821] xe 0000:03:00.0: [drm] Xe device coredump has been created <6> [470.104848] xe 0000:03:00.0: [drm] Check your /sys/class/drm/card0/device/devcoredump/data <4> [470.104851] ------------[ cut here ]------------ <4> [470.104853] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [470.104854] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:66/10933 <4> [470.104941] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [470.105005] [last unloaded: snd_hda_intel] <4> [470.105009] CPU: 11 UID: 0 PID: 10933 Comm: kworker/u64:66 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [470.105012] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [470.105013] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [470.105015] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [470.105021] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [470.105103] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [470.105106] RSP: 0018:ffffc9000396fca0 EFLAGS: 00010246 <4> [470.105110] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [470.105113] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [470.105114] RBP: ffffc9000396fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [470.105116] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [470.105118] R13: ffff888101713890 R14: ffff88816b100000 R15: 00000000ffffffc2 <4> [470.105120] FS: 0000000000000000(0000) GS:ffff8888db002000(0000) knlGS:0000000000000000 <4> [470.105123] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [470.105125] CR2: 0000780ced28b940 CR3: 0000000119019002 CR4: 0000000000f72ef0 <4> [470.105128] PKRU: 55555554 <4> [470.105130] Call Trace: <4> [470.105132] <TASK> <4> [470.105139] ? lock_acquire+0x80/0x300 <4> [470.105149] ? __pfx_autoremove_wake_function+0x10/0x10 <4> [470.105159] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [470.105169] process_one_work+0x239/0x740 <4> [470.105182] worker_thread+0x200/0x3f0 <4> [470.105188] ? __pfx_worker_thread+0x10/0x10 <4> [470.105193] kthread+0x10d/0x150 <4> [470.105197] ? __pfx_kthread+0x10/0x10 <4> [470.105203] ret_from_fork+0x3bd/0x470 <4> [470.105207] ? __pfx_kthread+0x10/0x10 <4> [470.105212] ret_from_fork_asm+0x1a/0x30 <4> [470.105225] </TASK> <4> [470.105227] irq event stamp: 223215 <4> [470.105229] hardirqs last enabled at (223221): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [470.105234] hardirqs last disabled at (223226): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [470.105236] softirqs last enabled at (222280): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [470.105241] softirqs last disabled at (222275): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [470.105245] ---[ end trace 0000000000000000 ]--- <6> [470.105248] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [470.105354] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [470.105929] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [470.106024] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [470.106587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [470.106689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [470.106782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [470.106869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [470.106951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [470.107030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [470.107111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [470.107193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [470.107273] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [470.107364] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [470.107479] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [470.108623] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [470.119400] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [470.119716] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [470.121009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [470.121092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [470.121169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [470.121246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [470.121319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [470.121392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [470.121474] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [470.121547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [470.121614] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [470.121680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [470.121745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [470.121811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [470.121884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [470.121957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [470.122030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [470.122104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [470.122177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [470.122249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [470.122321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [470.122401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [470.122491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [470.122565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [470.122637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [470.122708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [470.122780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [470.122850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [470.122917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [470.122984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [470.123052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [470.123123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [470.123195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [470.123265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [470.123334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [470.123404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [470.123490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [470.123568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [470.123641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [470.123712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [470.123781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [470.123850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [470.123920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [470.123989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [470.124057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [470.124127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [470.124197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [470.124266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [470.124336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [470.124405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [470.124482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [470.124554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [470.124623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [470.124692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [470.124761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [470.124830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [470.124896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [470.124966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [470.125035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [470.125103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [470.125170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [470.125240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [470.125309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [470.125380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [470.125458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [470.125535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [470.125604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [470.125672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [470.125740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [470.125806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [470.125876] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [470.126903] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <7> [470.128631] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [470.128743] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [475.284671] xe 0000:03:00.0: [drm:xe_hwmon_read [xe]] thermal data for group 0 val 0x2d2d2b2b <7> [475.284889] xe 0000:03:00.0: [drm:xe_hwmon_read [xe]] thermal data for group 1 val 0x302e2e2e <5> [475.417609] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12634, lrc_seqno=12634, guc_id=0, flags=0x73 in no process [-1] <7> [475.417617] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [475.418022] ------------[ cut here ]------------ <4> [475.418030] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [475.418038] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:66/10933 <4> [475.418544] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [475.418893] [last unloaded: snd_hda_intel] <4> [475.418913] CPU: 8 UID: 0 PID: 10933 Comm: kworker/u64:66 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [475.418930] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [475.418937] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [475.418946] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [475.418975] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [475.419388] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [475.419398] RSP: 0018:ffffc9000396fca0 EFLAGS: 00010246 <4> [475.419411] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [475.419420] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [475.419427] RBP: ffffc9000396fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [475.419435] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [475.419442] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [475.419450] FS: 0000000000000000(0000) GS:ffff8888dae82000(0000) knlGS:0000000000000000 <4> [475.419460] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [475.419468] CR2: 0000780cc0006000 CR3: 000000000364a005 CR4: 0000000000f72ef0 <4> [475.419477] PKRU: 55555554 <4> [475.419484] Call Trace: <4> [475.419492] <TASK> <4> [475.419515] ? lock_acquire+0x80/0x300 <4> [475.419544] ? lock_release+0xd0/0x2b0 <4> [475.419569] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [475.419600] process_one_work+0x239/0x740 <4> [475.419635] worker_thread+0x200/0x3f0 <4> [475.419652] ? __pfx_worker_thread+0x10/0x10 <4> [475.419667] kthread+0x10d/0x150 <4> [475.419679] ? __pfx_kthread+0x10/0x10 <4> [475.419696] ret_from_fork+0x3bd/0x470 <4> [475.419710] ? __pfx_kthread+0x10/0x10 <4> [475.419724] ret_from_fork_asm+0x1a/0x30 <4> [475.419764] </TASK> <4> [475.419772] irq event stamp: 231225 <4> [475.419779] hardirqs last enabled at (231231): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [475.419793] hardirqs last disabled at (231236): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [475.419803] softirqs last enabled at (230474): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [475.419819] softirqs last disabled at (230467): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [475.419835] ---[ end trace 0000000000000000 ]--- <6> [475.419846] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [475.420229] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [475.420271] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [475.420401] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [475.422743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [475.423384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [475.423808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [475.423886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [475.423962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [475.424036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [475.424110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [475.424185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [475.424255] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [475.424351] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [475.424433] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [475.425461] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [475.435310] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [475.435752] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [475.437070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [475.437324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [475.437553] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [475.437756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [475.437956] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [475.438154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [475.438378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [475.438568] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [475.438760] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [475.438937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [475.439107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [475.439281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [475.439493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [475.439665] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [475.439827] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [475.439992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [475.440155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [475.440328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [475.440491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [475.440668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [475.440836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [475.440998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [475.441154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [475.441318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [475.441478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [475.441626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [475.441765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [475.441904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [475.442045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [475.442192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [475.442349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [475.442486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [475.442620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [475.442748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [475.442882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [475.443018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [475.443147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [475.443276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [475.443439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [475.443568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [475.443691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [475.443809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [475.443921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [475.444035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [475.444147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [475.444256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [475.444381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [475.444492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [475.444596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [475.444704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [475.444812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [475.444915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [475.445020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [475.445119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [475.445216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [475.445323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [475.445424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [475.445516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [475.445607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [475.445702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [475.445793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [475.445882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [475.445971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [475.446057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [475.446146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [475.446239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [475.446339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [475.446425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [475.446510] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [475.446824] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <7> [475.447745] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [475.447850] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [480.537695] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12634, lrc_seqno=12634, guc_id=0, flags=0x73 in no process [-1] <7> [480.537727] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [480.538275] ------------[ cut here ]------------ <4> [480.538284] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [480.538294] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#13: kworker/u64:5/202 <4> [480.538812] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [480.539255] [last unloaded: snd_hda_intel] <4> [480.539277] CPU: 13 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [480.539296] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [480.539304] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [480.539314] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [480.539353] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [480.539883] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [480.539894] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [480.539909] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [480.539918] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [480.539927] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [480.539935] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [480.539943] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [480.539951] FS: 0000000000000000(0000) GS:ffff8888db102000(0000) knlGS:0000000000000000 <4> [480.539961] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [480.539969] CR2: 00007a2f4da0b048 CR3: 000000000364a001 CR4: 0000000000f72ef0 <4> [480.539978] PKRU: 55555554 <4> [480.539985] Call Trace: <4> [480.539992] <TASK> <4> [480.540020] ? lock_acquire+0x80/0x300 <4> [480.540054] ? lock_release+0xd0/0x2b0 <4> [480.540087] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [480.540127] process_one_work+0x239/0x740 <4> [480.540198] worker_thread+0x200/0x3f0 <4> [480.540220] ? __pfx_worker_thread+0x10/0x10 <4> [480.540237] kthread+0x10d/0x150 <4> [480.540251] ? __pfx_kthread+0x10/0x10 <4> [480.540270] ret_from_fork+0x3bd/0x470 <4> [480.540284] ? __pfx_kthread+0x10/0x10 <4> [480.540301] ret_from_fork_asm+0x1a/0x30 <4> [480.540353] </TASK> <4> [480.540360] irq event stamp: 709191 <4> [480.540368] hardirqs last enabled at (709197): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [480.540393] hardirqs last disabled at (709204): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [480.540405] softirqs last enabled at (709142): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.540422] softirqs last disabled at (709137): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.540437] ---[ end trace 0000000000000000 ]--- <5> [480.542586] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12660, lrc_seqno=12660, guc_id=0, flags=0x73 in no process [-1] <7> [480.542613] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [480.542940] ------------[ cut here ]------------ <4> [480.542948] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [480.542955] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:66/10933 <4> [480.543405] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [480.543741] [last unloaded: snd_hda_intel] <4> [480.543757] CPU: 10 UID: 0 PID: 10933 Comm: kworker/u64:66 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [480.543772] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [480.543778] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [480.543786] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [480.543813] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [480.543997] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [480.543999] RSP: 0018:ffffc9000396fca0 EFLAGS: 00010246 <4> [480.544001] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [480.544002] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [480.544003] RBP: ffffc9000396fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [480.544004] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [480.544006] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [480.544007] FS: 0000000000000000(0000) GS:ffff8888daf82000(0000) knlGS:0000000000000000 <4> [480.544008] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [480.544009] CR2: 00007a49500952b8 CR3: 000000000364a001 CR4: 0000000000f72ef0 <4> [480.544011] PKRU: 55555554 <4> [480.544012] Call Trace: <4> [480.544013] <TASK> <4> [480.544017] ? lock_acquire+0x80/0x300 <4> [480.544021] ? lock_release+0xd0/0x2b0 <4> [480.544026] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [480.544031] process_one_work+0x239/0x740 <4> [480.544037] worker_thread+0x200/0x3f0 <4> [480.544039] ? __pfx_worker_thread+0x10/0x10 <4> [480.544042] kthread+0x10d/0x150 <4> [480.544044] ? __pfx_kthread+0x10/0x10 <4> [480.544046] ret_from_fork+0x3bd/0x470 <4> [480.544048] ? __pfx_kthread+0x10/0x10 <4> [480.544051] ret_from_fork_asm+0x1a/0x30 <4> [480.544057] </TASK> <4> [480.544058] irq event stamp: 234613 <4> [480.544059] hardirqs last enabled at (234619): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [480.544062] hardirqs last disabled at (234624): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [480.544063] softirqs last enabled at (233472): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.544066] softirqs last disabled at (233467): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.544068] ---[ end trace 0000000000000000 ]--- <6> [480.544070] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [480.544135] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [480.544140] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [480.544220] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [480.544483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [480.544568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [480.544652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [480.544731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [480.544807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [480.544883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [480.544958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [480.545033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [480.545103] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [480.545222] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [480.545311] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [480.546339] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [480.556213] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [480.556530] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [480.557681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [480.557783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [480.557876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [480.557967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [480.558056] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [480.558145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [480.558256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [480.558344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [480.558432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [480.558523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [480.558614] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [480.558706] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [480.558797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [480.558888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [480.558975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [480.559062] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [480.559149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [480.559261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [480.559349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [480.559445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [480.559536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [480.559628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [480.559717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [480.559804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [480.559888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [480.559970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [480.560051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [480.560134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [480.560228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [480.560315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [480.560398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [480.560477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [480.560557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [480.560638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [480.560721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [480.560804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [480.560884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [480.560963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [480.561040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [480.561115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [480.561197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [480.561273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [480.561348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [480.561423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [480.561499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [480.561576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [480.561655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [480.561731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [480.561806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [480.561883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [480.561962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [480.562037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [480.562113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [480.562195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [480.562271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [480.562348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [480.562424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [480.562497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [480.562570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [480.562647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [480.562722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [480.562796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [480.562874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [480.562951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [480.563028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [480.563104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [480.563185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [480.563258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [480.563335] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [480.563867] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [480.563873] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12660, lrc_seqno=12660, guc_id=0, flags=0x73 in no process [-1] <7> [480.563876] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [480.563937] ------------[ cut here ]------------ <4> [480.563939] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [480.563940] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:66/10933 <4> [480.564018] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [480.564083] [last unloaded: snd_hda_intel] <4> [480.564087] CPU: 10 UID: 0 PID: 10933 Comm: kworker/u64:66 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [480.564090] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [480.564091] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [480.564093] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [480.564098] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [480.564172] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [480.564174] RSP: 0018:ffffc9000396fca0 EFLAGS: 00010246 <4> [480.564176] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [480.564178] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [480.564180] RBP: ffffc9000396fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [480.564181] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [480.564182] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [480.564184] FS: 0000000000000000(0000) GS:ffff8888daf82000(0000) knlGS:0000000000000000 <4> [480.564186] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [480.564187] CR2: 00007a49500952b8 CR3: 000000000364a001 CR4: 0000000000f72ef0 <4> [480.564189] PKRU: 55555554 <4> [480.564190] Call Trace: <4> [480.564191] <TASK> <4> [480.564195] ? lock_acquire+0x80/0x300 <4> [480.564201] ? lock_release+0xd0/0x2b0 <4> [480.564206] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [480.564212] process_one_work+0x239/0x740 <4> [480.564218] worker_thread+0x200/0x3f0 <4> [480.564221] ? __pfx_worker_thread+0x10/0x10 <4> [480.564224] kthread+0x10d/0x150 <4> [480.564226] ? __pfx_kthread+0x10/0x10 <4> [480.564229] ret_from_fork+0x3bd/0x470 <4> [480.564232] ? __pfx_kthread+0x10/0x10 <4> [480.564234] ret_from_fork_asm+0x1a/0x30 <4> [480.564242] </TASK> <4> [480.564243] irq event stamp: 238865 <4> [480.564244] hardirqs last enabled at (238871): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [480.564247] hardirqs last disabled at (238876): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [480.564249] softirqs last enabled at (237664): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.564252] softirqs last disabled at (237659): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.564254] ---[ end trace 0000000000000000 ]--- <6> [480.565059] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [480.565129] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [480.565136] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [480.565364] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [480.565468] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [480.566076] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [480.566539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [480.566631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [480.566724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [480.566811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [480.566897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [480.566983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [480.567071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [480.567166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [480.567248] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [480.567343] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [480.567431] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [480.568456] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [480.579161] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [480.579413] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [480.580057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [480.580134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [480.580223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [480.580300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [480.580375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [480.580452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [480.580525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [480.580597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [480.580670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [480.580741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [480.580813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [480.580899] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [480.580971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [480.581044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [480.581115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [480.581200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [480.581272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [480.581344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [480.581415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [480.581496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [480.581575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [480.581656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [480.581734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [480.581810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [480.581884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [480.581958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [480.582035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [480.582114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [480.582199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [480.582278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [480.582357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [480.582434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [480.582511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [480.582588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [480.582669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [480.582751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [480.582836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [480.582916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [480.582995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [480.583070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [480.583146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [480.583234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [480.583309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [480.583387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [480.583467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [480.583546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [480.583624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [480.583700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [480.583775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [480.583851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [480.583928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [480.584003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [480.584077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [480.584152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [480.584242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [480.584323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [480.584400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [480.584476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [480.584551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [480.584630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [480.584706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [480.584782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [480.584857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [480.584931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [480.585007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [480.585082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [480.585159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [480.585232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [480.585308] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [480.585594] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [480.585598] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12660, lrc_seqno=12660, guc_id=0, flags=0x73 in no process [-1] <7> [480.585601] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [480.585661] ------------[ cut here ]------------ <4> [480.585662] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [480.585663] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:66/10933 <4> [480.585734] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [480.585799] [last unloaded: snd_hda_intel] <4> [480.585802] CPU: 10 UID: 0 PID: 10933 Comm: kworker/u64:66 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [480.585805] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [480.585806] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [480.585807] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [480.585813] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [480.585882] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [480.585883] RSP: 0018:ffffc9000396fca0 EFLAGS: 00010246 <4> [480.585886] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [480.585887] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [480.585888] RBP: ffffc9000396fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [480.585890] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [480.585891] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [480.585892] FS: 0000000000000000(0000) GS:ffff8888daf82000(0000) knlGS:0000000000000000 <4> [480.585894] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [480.585895] CR2: 00007a49500952b8 CR3: 000000000364a001 CR4: 0000000000f72ef0 <4> [480.585897] PKRU: 55555554 <4> [480.585898] Call Trace: <4> [480.585899] <TASK> <4> [480.585903] ? lock_acquire+0x80/0x300 <4> [480.585908] ? lock_release+0xd0/0x2b0 <4> [480.585913] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [480.585918] process_one_work+0x239/0x740 <4> [480.585925] worker_thread+0x200/0x3f0 <4> [480.585928] ? __pfx_worker_thread+0x10/0x10 <4> [480.585930] kthread+0x10d/0x150 <4> [480.585933] ? __pfx_kthread+0x10/0x10 <4> [480.585936] ret_from_fork+0x3bd/0x470 <4> [480.585938] ? __pfx_kthread+0x10/0x10 <4> [480.585941] ret_from_fork_asm+0x1a/0x30 <4> [480.585948] </TASK> <4> [480.585949] irq event stamp: 243167 <4> [480.585950] hardirqs last enabled at (243173): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [480.585953] hardirqs last disabled at (243178): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [480.585954] softirqs last enabled at (241970): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.585957] softirqs last disabled at (241963): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.585960] ---[ end trace 0000000000000000 ]--- <7> [480.587162] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [480.587275] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [480.589200] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12661, lrc_seqno=12661, guc_id=0, flags=0x73 in no process [-1] <7> [480.589226] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <7> [480.589205] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [480.589276] ------------[ cut here ]------------ <4> [480.589277] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [480.589278] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:14/2404 <4> [480.589351] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [480.589420] [last unloaded: snd_hda_intel] <4> [480.589424] CPU: 11 UID: 0 PID: 2404 Comm: kworker/u64:14 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [480.589427] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [480.589429] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [480.589430] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [480.589436] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [480.589506] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [480.589508] RSP: 0018:ffffc90003d8fca0 EFLAGS: 00010246 <4> [480.589511] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [480.589512] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [480.589513] RBP: ffffc90003d8fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [480.589514] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [480.589516] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [480.589517] FS: 0000000000000000(0000) GS:ffff8888db002000(0000) knlGS:0000000000000000 <4> [480.589519] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [480.589520] CR2: 00007a4950096068 CR3: 000000000364a003 CR4: 0000000000f72ef0 <4> [480.589521] PKRU: 55555554 <4> [480.589523] Call Trace: <4> [480.589524] <TASK> <4> [480.589528] ? lock_acquire+0x80/0x300 <4> [480.589534] ? lock_release+0xd0/0x2b0 <4> [480.589538] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [480.589544] process_one_work+0x239/0x740 <4> [480.589551] worker_thread+0x200/0x3f0 <4> [480.589554] ? __pfx_worker_thread+0x10/0x10 <4> [480.589557] kthread+0x10d/0x150 <4> [480.589559] ? __pfx_kthread+0x10/0x10 <4> [480.589562] ret_from_fork+0x3bd/0x470 <4> [480.589564] ? __pfx_kthread+0x10/0x10 <4> [480.589567] ret_from_fork_asm+0x1a/0x30 <4> [480.589575] </TASK> <4> [480.589576] irq event stamp: 388753 <4> [480.589577] hardirqs last enabled at (388759): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [480.589580] hardirqs last disabled at (388764): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [480.589581] softirqs last enabled at (387444): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.589584] softirqs last disabled at (387439): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.589587] ---[ end trace 0000000000000000 ]--- <6> [480.589589] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [480.589659] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [480.589668] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [480.589722] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [480.590067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [480.590222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [480.590364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [480.590500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [480.590634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [480.590767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [480.590901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [480.591037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [480.591176] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [480.591321] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [480.591461] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [480.592842] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [480.603161] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [480.603422] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [480.604056] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [480.604137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [480.604230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [480.604308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [480.604382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [480.604455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [480.604528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [480.604603] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [480.604677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [480.604750] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [480.604823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [480.604895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [480.604968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [480.605042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [480.605114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [480.605198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [480.605272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [480.605344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [480.605416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [480.605497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [480.605579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [480.605658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [480.605734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [480.605811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [480.605887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [480.605962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [480.606037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [480.606114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [480.606202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [480.606286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [480.606365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [480.606442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [480.606519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [480.606597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [480.606680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [480.606760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [480.606842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [480.606923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [480.607004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [480.607082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [480.607162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [480.607238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [480.607311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [480.607386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [480.607462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [480.607537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [480.607612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [480.607688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [480.607762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [480.607838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [480.607916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [480.607991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [480.608067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [480.608143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [480.608231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [480.608308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [480.608383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [480.608457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [480.608535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [480.608615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [480.608692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [480.608769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [480.608843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [480.608917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [480.608993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [480.609069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [480.609142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [480.609228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [480.609305] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [480.609594] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [480.609599] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12661, lrc_seqno=12661, guc_id=0, flags=0x73 in no process [-1] <7> [480.609602] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [480.609662] ------------[ cut here ]------------ <4> [480.609664] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [480.609666] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:66/10933 <4> [480.609736] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [480.609818] [last unloaded: snd_hda_intel] <4> [480.609822] CPU: 9 UID: 0 PID: 10933 Comm: kworker/u64:66 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [480.609825] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [480.609827] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [480.609829] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [480.609834] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [480.609903] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [480.609905] RSP: 0018:ffffc9000396fca0 EFLAGS: 00010246 <4> [480.609907] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [480.609909] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [480.609910] RBP: ffffc9000396fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [480.609911] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [480.609912] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [480.609914] FS: 0000000000000000(0000) GS:ffff8888daf02000(0000) knlGS:0000000000000000 <4> [480.609915] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [480.609917] CR2: 00007cffdf86f000 CR3: 000000000364a005 CR4: 0000000000f72ef0 <4> [480.609918] PKRU: 55555554 <4> [480.609920] Call Trace: <4> [480.609921] <TASK> <4> [480.609925] ? lock_acquire+0x80/0x300 <4> [480.609931] ? lock_release+0xd0/0x2b0 <4> [480.609935] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [480.609941] process_one_work+0x239/0x740 <4> [480.609948] worker_thread+0x200/0x3f0 <4> [480.609951] ? __pfx_worker_thread+0x10/0x10 <4> [480.609954] kthread+0x10d/0x150 <4> [480.609956] ? __pfx_kthread+0x10/0x10 <4> [480.609961] ret_from_fork+0x3bd/0x470 <4> [480.609964] ? __pfx_kthread+0x10/0x10 <4> [480.609967] ret_from_fork_asm+0x1a/0x30 <4> [480.609975] </TASK> <4> [480.609976] irq event stamp: 247887 <4> [480.609977] hardirqs last enabled at (247893): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [480.609980] hardirqs last disabled at (247898): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [480.609981] softirqs last enabled at (246468): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.609984] softirqs last disabled at (246461): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.609987] ---[ end trace 0000000000000000 ]--- <6> [480.610797] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [480.610872] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [480.610878] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [480.610934] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [480.611037] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [480.611142] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [480.611417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [480.611505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [480.611595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [480.611681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [480.611768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [480.611854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [480.611939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [480.612027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [480.612112] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [480.612217] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [480.612307] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [480.613333] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [480.623163] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [480.623415] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [480.624048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [480.624128] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [480.624214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [480.624291] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [480.624365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [480.624438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [480.624511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [480.624584] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [480.624657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [480.624730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [480.624806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [480.624881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [480.624952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [480.625023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [480.625094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [480.625169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [480.625242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [480.625313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [480.625385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [480.625467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [480.625550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [480.625630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [480.625708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [480.625785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [480.625862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [480.625938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [480.626013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [480.626089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [480.626168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [480.626247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [480.626330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [480.626409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [480.626486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [480.626563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [480.626644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [480.626725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [480.626805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [480.626885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [480.626963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [480.627038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [480.627115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [480.627198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [480.627272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [480.627351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [480.627430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [480.627507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [480.627583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [480.627658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [480.627734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [480.627810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [480.627889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [480.627964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [480.628040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [480.628116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [480.628201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [480.628281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [480.628358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [480.628433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [480.628506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [480.628582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [480.628657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [480.628733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [480.628809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [480.628882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [480.628958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [480.629034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [480.629107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [480.629187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [480.629267] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [480.629532] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [480.629536] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12661, lrc_seqno=12661, guc_id=0, flags=0x73 in no process [-1] <7> [480.629538] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [480.629599] ------------[ cut here ]------------ <4> [480.629600] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [480.629601] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:66/10933 <4> [480.629674] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [480.629739] [last unloaded: snd_hda_intel] <4> [480.629742] CPU: 9 UID: 0 PID: 10933 Comm: kworker/u64:66 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [480.629745] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [480.629746] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [480.629747] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [480.629753] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [480.629821] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [480.629823] RSP: 0018:ffffc9000396fca0 EFLAGS: 00010246 <4> [480.629825] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [480.629826] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [480.629827] RBP: ffffc9000396fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [480.629829] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [480.629830] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [480.629831] FS: 0000000000000000(0000) GS:ffff8888daf02000(0000) knlGS:0000000000000000 <4> [480.629833] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [480.629834] CR2: 00007cffdf86f000 CR3: 000000000364a005 CR4: 0000000000f72ef0 <4> [480.629836] PKRU: 55555554 <4> [480.629837] Call Trace: <4> [480.629838] <TASK> <4> [480.629842] ? lock_acquire+0x80/0x300 <4> [480.629847] ? lock_release+0xd0/0x2b0 <4> [480.629851] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [480.629857] process_one_work+0x239/0x740 <4> [480.629864] worker_thread+0x200/0x3f0 <4> [480.629867] ? __pfx_worker_thread+0x10/0x10 <4> [480.629869] kthread+0x10d/0x150 <4> [480.629872] ? __pfx_kthread+0x10/0x10 <4> [480.629874] ret_from_fork+0x3bd/0x470 <4> [480.629877] ? __pfx_kthread+0x10/0x10 <4> [480.629879] ret_from_fork_asm+0x1a/0x30 <4> [480.629887] </TASK> <4> [480.629888] irq event stamp: 252293 <4> [480.629889] hardirqs last enabled at (252299): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [480.629891] hardirqs last disabled at (252304): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [480.629893] softirqs last enabled at (250776): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.629896] softirqs last disabled at (250771): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.629899] ---[ end trace 0000000000000000 ]--- <5> [480.630850] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12663, lrc_seqno=12663, guc_id=0, flags=0x73 in no process [-1] <7> [480.630857] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [480.630930] ------------[ cut here ]------------ <4> [480.630932] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [480.630889] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [480.630933] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:34/4935 <4> [480.631020] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit <7> [480.630991] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [480.631038] kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [480.631096] CPU: 3 UID: 0 PID: 4935 Comm: kworker/u64:34 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [480.631099] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [480.631100] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [480.631101] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [480.631107] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [480.631208] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [480.631210] RSP: 0018:ffffc90002aa3ca0 EFLAGS: 00010246 <4> [480.631213] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [480.631214] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [480.631216] RBP: ffffc90002aa3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [480.631217] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [480.631218] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [480.631220] FS: 0000000000000000(0000) GS:ffff8888dac02000(0000) knlGS:0000000000000000 <4> [480.631221] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [480.631223] CR2: 00007cffc8204ff8 CR3: 000000000364a003 CR4: 0000000000f72ef0 <4> [480.631224] PKRU: 55555554 <4> [480.631225] Call Trace: <4> [480.631227] <TASK> <4> [480.631231] ? lock_acquire+0x80/0x300 <4> [480.631236] ? lock_release+0xd0/0x2b0 <4> [480.631241] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [480.631247] process_one_work+0x239/0x740 <4> [480.631254] worker_thread+0x200/0x3f0 <4> [480.631257] ? __pfx_worker_thread+0x10/0x10 <4> [480.631260] kthread+0x10d/0x150 <4> [480.631262] ? __pfx_kthread+0x10/0x10 <4> [480.631265] ret_from_fork+0x3bd/0x470 <4> [480.631267] ? __pfx_kthread+0x10/0x10 <4> [480.631270] ret_from_fork_asm+0x1a/0x30 <4> [480.631278] </TASK> <4> [480.631279] irq event stamp: 71937 <4> [480.631280] hardirqs last enabled at (71943): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [480.631283] hardirqs last disabled at (71948): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [480.631285] softirqs last enabled at (71776): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.631288] softirqs last disabled at (71771): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.631290] ---[ end trace 0000000000000000 ]--- <6> [480.631292] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [480.631363] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [480.631371] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [480.631419] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [480.631685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [480.631776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [480.631867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [480.631953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [480.632036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [480.632119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [480.632218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [480.632303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [480.632384] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [480.632481] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [480.632569] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [480.633596] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [480.644172] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [480.644423] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [480.645051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [480.645132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [480.645223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [480.645299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [480.645374] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [480.645447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [480.645521] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [480.645593] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [480.645666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [480.645740] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [480.645812] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [480.645886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [480.645960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [480.646036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [480.646110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [480.646195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [480.646268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [480.646340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [480.646413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [480.646494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [480.646575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [480.646654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [480.646732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [480.646811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [480.646891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [480.646968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [480.647043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [480.647117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [480.647205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [480.647284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [480.647361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [480.647436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [480.647515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [480.647593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [480.647674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [480.647758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [480.647841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [480.647921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [480.648001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [480.648076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [480.648430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [480.648516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [480.648595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [480.648675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [480.648756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [480.648834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [480.648913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [480.648992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [480.649068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [480.649146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [480.649244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [480.649323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [480.649402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [480.649476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [480.649551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [480.649627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [480.649706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [480.649784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [480.649860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [480.649939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [480.650014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [480.650090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [480.650168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [480.650243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [480.650319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [480.650394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [480.650468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [480.650541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [480.650618] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [480.650883] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [480.650887] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12663, lrc_seqno=12663, guc_id=0, flags=0x73 in no process [-1] <7> [480.650890] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [480.650951] ------------[ cut here ]------------ <4> [480.650952] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [480.651185] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:66/10933 <4> [480.651260] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [480.651326] [last unloaded: snd_hda_intel] <4> [480.651329] CPU: 8 UID: 0 PID: 10933 Comm: kworker/u64:66 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [480.651332] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [480.651334] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [480.651335] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [480.651341] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [480.651410] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [480.651412] RSP: 0018:ffffc9000396fca0 EFLAGS: 00010246 <4> [480.651414] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [480.651416] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [480.651417] RBP: ffffc9000396fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [480.651418] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [480.651420] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [480.651421] FS: 0000000000000000(0000) GS:ffff8888dae82000(0000) knlGS:0000000000000000 <4> [480.651423] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [480.651424] CR2: 0000780ce7621000 CR3: 0000000120b45002 CR4: 0000000000f72ef0 <4> [480.651425] PKRU: 55555554 <4> [480.651426] Call Trace: <4> [480.651428] <TASK> <4> [480.651432] ? lock_acquire+0x80/0x300 <4> [480.651437] ? lock_release+0xd0/0x2b0 <4> [480.651441] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [480.651447] process_one_work+0x239/0x740 <4> [480.651454] worker_thread+0x200/0x3f0 <4> [480.651457] ? __pfx_worker_thread+0x10/0x10 <4> [480.651459] kthread+0x10d/0x150 <4> [480.651461] ? __pfx_kthread+0x10/0x10 <4> [480.651464] ret_from_fork+0x3bd/0x470 <4> [480.651467] ? __pfx_kthread+0x10/0x10 <4> [480.651469] ret_from_fork_asm+0x1a/0x30 <4> [480.651477] </TASK> <4> [480.651478] irq event stamp: 256755 <4> [480.651479] hardirqs last enabled at (256761): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [480.651481] hardirqs last disabled at (256766): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [480.651483] softirqs last enabled at (255482): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.651486] softirqs last disabled at (255475): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.651488] ---[ end trace 0000000000000000 ]--- <6> [480.652163] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [480.652291] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [480.652298] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [480.652363] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [480.652466] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [480.652572] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [480.652835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [480.652928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [480.653022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [480.653109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [480.653206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [480.653291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [480.653373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [480.653458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [480.653539] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [480.653635] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [480.653724] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [480.654754] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [480.665161] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [480.665413] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [480.666041] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [480.666123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [480.666214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [480.666293] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [480.666368] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [480.666442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [480.666516] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [480.666592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [480.666666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [480.666740] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [480.666813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [480.666887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [480.666961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [480.667034] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [480.667108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [480.667197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [480.667271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [480.667343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [480.667416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [480.667497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [480.667578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [480.667658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [480.667735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [480.667812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [480.667887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [480.667961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [480.668034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [480.668108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [480.668192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [480.668272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [480.668350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [480.668426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [480.668503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [480.668583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [480.668666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [480.668748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [480.668829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [480.668909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [480.668987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [480.669063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [480.669139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [480.669226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [480.669300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [480.669375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [480.669451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [480.669528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [480.669605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [480.669680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [480.669753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [480.669827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [480.669904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [480.669978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [480.670054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [480.670130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [480.670214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [480.670291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [480.670367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [480.670441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [480.670514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [480.670590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [480.670667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [480.670742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [480.670815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [480.670888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [480.670962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [480.671035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [480.671108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [480.671189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [480.671270] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [480.671544] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [480.671548] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12663, lrc_seqno=12663, guc_id=0, flags=0x73 in no process [-1] <7> [480.671551] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [480.671611] ------------[ cut here ]------------ <4> [480.671612] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [480.671614] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:34/4935 <4> [480.671684] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [480.671750] [last unloaded: snd_hda_intel] <4> [480.671753] CPU: 3 UID: 0 PID: 4935 Comm: kworker/u64:34 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [480.671756] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [480.671758] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [480.671759] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [480.671765] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [480.671833] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [480.671835] RSP: 0018:ffffc90002aa3ca0 EFLAGS: 00010246 <4> [480.671838] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [480.671839] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [480.671840] RBP: ffffc90002aa3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [480.671842] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [480.671843] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [480.671844] FS: 0000000000000000(0000) GS:ffff8888dac02000(0000) knlGS:0000000000000000 <4> [480.671846] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [480.671847] CR2: 00007cffc8204ff8 CR3: 0000000120b45005 CR4: 0000000000f72ef0 <4> [480.671849] PKRU: 55555554 <4> [480.671850] Call Trace: <4> [480.671851] <TASK> <4> [480.671855] ? lock_acquire+0x80/0x300 <4> [480.671860] ? lock_release+0xd0/0x2b0 <4> [480.671865] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [480.671871] process_one_work+0x239/0x740 <4> [480.671877] worker_thread+0x200/0x3f0 <4> [480.671881] ? __pfx_worker_thread+0x10/0x10 <4> [480.671883] kthread+0x10d/0x150 <4> [480.671885] ? __pfx_kthread+0x10/0x10 <4> [480.671888] ret_from_fork+0x3bd/0x470 <4> [480.671891] ? __pfx_kthread+0x10/0x10 <4> [480.671893] ret_from_fork_asm+0x1a/0x30 <4> [480.671901] </TASK> <4> [480.671902] irq event stamp: 77177 <4> [480.671903] hardirqs last enabled at (77183): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [480.671905] hardirqs last disabled at (77188): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [480.671907] softirqs last enabled at (75660): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.671910] softirqs last disabled at (75653): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.671912] ---[ end trace 0000000000000000 ]--- <7> [480.673288] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [480.673400] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [480.673653] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12664, lrc_seqno=12664, guc_id=0, flags=0x73 in no process [-1] <7> [480.673658] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [480.673745] ------------[ cut here ]------------ <4> [480.673747] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [480.673767] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <4> [480.673748] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:20/2410 <4> [480.673825] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [480.673892] [last unloaded: snd_hda_intel] <4> [480.673896] CPU: 1 UID: 0 PID: 2410 Comm: kworker/u64:20 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [480.673899] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [480.673900] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [480.673901] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [480.673907] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [480.673980] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [480.673982] RSP: 0018:ffffc90003da7ca0 EFLAGS: 00010246 <4> [480.673985] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [480.673986] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [480.673987] RBP: ffffc90003da7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [480.673989] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [480.673990] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [480.673991] FS: 0000000000000000(0000) GS:ffff8888dab02000(0000) knlGS:0000000000000000 <4> [480.673993] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [480.673994] CR2: 0000780ce761d000 CR3: 000000000364a001 CR4: 0000000000f72ef0 <4> [480.673996] PKRU: 55555554 <4> [480.673997] Call Trace: <4> [480.673998] <TASK> <4> [480.674002] ? lock_acquire+0x80/0x300 <4> [480.674007] ? lock_release+0xd0/0x2b0 <4> [480.674012] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [480.674018] process_one_work+0x239/0x740 <4> [480.674025] worker_thread+0x200/0x3f0 <4> [480.674028] ? __pfx_worker_thread+0x10/0x10 <4> [480.674030] kthread+0x10d/0x150 <4> [480.674033] ? __pfx_kthread+0x10/0x10 <4> [480.674036] ret_from_fork+0x3bd/0x470 <4> [480.674038] ? __pfx_kthread+0x10/0x10 <4> [480.674041] ret_from_fork_asm+0x1a/0x30 <4> [480.674048] </TASK> <4> [480.674049] irq event stamp: 260607 <4> [480.674050] hardirqs last enabled at (260613): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [480.674053] hardirqs last disabled at (260618): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [480.674055] softirqs last enabled at (258980): [<ffffffff8133bd03>] kernel_fpu_end+0x53/0x70 <4> [480.674057] softirqs last disabled at (258978): [<ffffffff8133c414>] kernel_fpu_begin_mask+0xc4/0x120 <4> [480.674060] ---[ end trace 0000000000000000 ]--- <6> [480.674062] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [480.674134] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [480.674140] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [480.674163] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <6> [480.674556] xe 0000:03:00.0: [drm] exec queue reset detected <6> [480.674565] xe 0000:03:00.0: [drm] exec queue reset detected <6> [480.674608] xe 0000:03:00.0: [drm] exec queue reset detected <7> [480.674753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [480.674846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [480.674939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [480.675025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [480.675108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [480.675208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [480.675292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [480.675378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [480.675456] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [480.675552] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [480.675641] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [480.676671] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [480.687158] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [480.687412] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [480.688043] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [480.688120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [480.688212] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [480.688288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [480.688362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [480.688434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [480.688508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [480.688580] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [480.688653] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [480.688726] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [480.688798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [480.688870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [480.688942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [480.689015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [480.689090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [480.689167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [480.689241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [480.689313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [480.689384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [480.689465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [480.689545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [480.689626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [480.689702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [480.689778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [480.689855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [480.689933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [480.690007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [480.690082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [480.690162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [480.690241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [480.690318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [480.690396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [480.690474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [480.690551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [480.690633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [480.690715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [480.690800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [480.690881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [480.690961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [480.691037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [480.691114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [480.691199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [480.691274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [480.691351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [480.691428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [480.691503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [480.691579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [480.691653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [480.691727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [480.691802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [480.691879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [480.691954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [480.692028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [480.692103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [480.692191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [480.692271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [480.692348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [480.692423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [480.692497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [480.692573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [480.692649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [480.692724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [480.692799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [480.692872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [480.692947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [480.693022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [480.693095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [480.693176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [480.693256] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [480.693536] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [480.693541] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12664, lrc_seqno=12664, guc_id=0, flags=0x73 in no process [-1] <7> [480.693544] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [480.693604] ------------[ cut here ]------------ <4> [480.693605] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [480.693606] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:20/2410 <4> [480.693679] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [480.693745] [last unloaded: snd_hda_intel] <4> [480.693748] CPU: 1 UID: 0 PID: 2410 Comm: kworker/u64:20 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [480.693751] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [480.693752] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [480.693754] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [480.693759] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [480.693831] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [480.693833] RSP: 0018:ffffc90003da7ca0 EFLAGS: 00010246 <4> [480.693835] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [480.693837] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [480.693838] RBP: ffffc90003da7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [480.693839] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [480.693840] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [480.693842] FS: 0000000000000000(0000) GS:ffff8888dab02000(0000) knlGS:0000000000000000 <4> [480.693843] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [480.693844] CR2: 0000780ce761d000 CR3: 000000000364a001 CR4: 0000000000f72ef0 <4> [480.693846] PKRU: 55555554 <4> [480.693847] Call Trace: <4> [480.693848] <TASK> <4> [480.693852] ? lock_acquire+0x80/0x300 <4> [480.693858] ? lock_release+0xd0/0x2b0 <4> [480.693862] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [480.693868] process_one_work+0x239/0x740 <4> [480.693875] worker_thread+0x200/0x3f0 <4> [480.693878] ? __pfx_worker_thread+0x10/0x10 <4> [480.693880] kthread+0x10d/0x150 <4> [480.693883] ? __pfx_kthread+0x10/0x10 <4> [480.693885] ret_from_fork+0x3bd/0x470 <4> [480.693888] ? __pfx_kthread+0x10/0x10 <4> [480.693890] ret_from_fork_asm+0x1a/0x30 <4> [480.693898] </TASK> <4> [480.693899] irq event stamp: 265061 <4> [480.693900] hardirqs last enabled at (265067): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [480.693902] hardirqs last disabled at (265072): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [480.693904] softirqs last enabled at (263454): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.693907] softirqs last disabled at (263445): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.693909] ---[ end trace 0000000000000000 ]--- <6> [480.693911] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [480.693980] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <5> [480.693988] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=2, flags=0x0 in xe_exec_system_ [12028] <7> [480.693991] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [480.694334] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=3, flags=0x0 in xe_exec_system_ [12028] <7> [480.694364] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <5> [480.694558] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=4, flags=0x0 in xe_exec_system_ [12028] <7> [480.694564] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [480.694676] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [480.695179] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [480.695285] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [480.695391] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [480.695655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [480.695748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [480.695843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [480.695934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [480.696020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [480.696103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [480.696196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [480.696281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [480.696363] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [480.696456] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [480.696547] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [480.697574] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [480.708295] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [480.708547] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [480.709185] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [480.709264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [480.709341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [480.709417] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [480.709493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [480.709567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [480.709643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [480.709718] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [480.709796] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [480.709870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [480.709943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [480.710016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [480.710090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [480.710168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [480.710243] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [480.710316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [480.710390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [480.710462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [480.710534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [480.710614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [480.710695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [480.710774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [480.710849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [480.710926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [480.711005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [480.711082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [480.711160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [480.711235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [480.711309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [480.711387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [480.711465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [480.711541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [480.711618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [480.711694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [480.711775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [480.711856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [480.711940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [480.712022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [480.712100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [480.712180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [480.712255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [480.712332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [480.712410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [480.712488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [480.712566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [480.712643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [480.712720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [480.712798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [480.712874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [480.712953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [480.713031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [480.713108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [480.713192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [480.713267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [480.713342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [480.713417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [480.713493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [480.713566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [480.713643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [480.713722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [480.713799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [480.713877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [480.713953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [480.714027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [480.714103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [480.714184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [480.714259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [480.714333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [480.714410] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [480.714802] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [480.714807] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12664, lrc_seqno=12664, guc_id=0, flags=0x73 in no process [-1] <7> [480.714810] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [480.714872] ------------[ cut here ]------------ <4> [480.714873] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [480.714874] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:20/2410 <4> [480.714949] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [480.715225] [last unloaded: snd_hda_intel] <4> [480.715228] CPU: 2 UID: 0 PID: 2410 Comm: kworker/u64:20 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [480.715232] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [480.715233] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [480.715234] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [480.715240] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [480.715311] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [480.715313] RSP: 0018:ffffc90003da7ca0 EFLAGS: 00010246 <4> [480.715315] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [480.715317] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [480.715318] RBP: ffffc90003da7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [480.715319] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [480.715320] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [480.715322] FS: 0000000000000000(0000) GS:ffff8888dab82000(0000) knlGS:0000000000000000 <4> [480.715323] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [480.715325] CR2: 0000780cb00120b8 CR3: 000000000364a003 CR4: 0000000000f72ef0 <4> [480.715326] PKRU: 55555554 <4> [480.715327] Call Trace: <4> [480.715328] <TASK> <4> [480.715332] ? lock_acquire+0x80/0x300 <4> [480.715338] ? lock_release+0xd0/0x2b0 <4> [480.715343] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [480.715348] process_one_work+0x239/0x740 <4> [480.715355] worker_thread+0x200/0x3f0 <4> [480.715358] ? __pfx_worker_thread+0x10/0x10 <4> [480.715361] kthread+0x10d/0x150 <4> [480.715363] ? __pfx_kthread+0x10/0x10 <4> [480.715366] ret_from_fork+0x3bd/0x470 <4> [480.715368] ? __pfx_kthread+0x10/0x10 <4> [480.715371] ret_from_fork_asm+0x1a/0x30 <4> [480.715378] </TASK> <4> [480.715379] irq event stamp: 269657 <4> [480.715380] hardirqs last enabled at (269663): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [480.715383] hardirqs last disabled at (269668): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [480.715384] softirqs last enabled at (268318): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.715387] softirqs last disabled at (268311): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.715390] ---[ end trace 0000000000000000 ]--- <7> [480.716351] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [480.716458] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [480.716511] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12666, lrc_seqno=12666, guc_id=0, flags=0x73 in no process [-1] <7> [480.716516] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [480.716581] ------------[ cut here ]------------ <4> [480.716583] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [480.716584] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:20/2410 <4> [480.716662] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [480.716727] [last unloaded: snd_hda_intel] <4> [480.716730] CPU: 9 UID: 0 PID: 2410 Comm: kworker/u64:20 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [480.716733] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [480.716734] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [480.716736] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [480.716741] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [480.716813] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [480.716815] RSP: 0018:ffffc90003da7ca0 EFLAGS: 00010246 <4> [480.716818] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [480.716819] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [480.716820] RBP: ffffc90003da7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [480.716821] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [480.716823] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [480.716824] FS: 0000000000000000(0000) GS:ffff8888daf02000(0000) knlGS:0000000000000000 <4> [480.716826] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [480.716827] CR2: 00007cffdf86f000 CR3: 000000000364a005 CR4: 0000000000f72ef0 <4> [480.716828] PKRU: 55555554 <4> [480.716830] Call Trace: <4> [480.716831] <TASK> <4> [480.716835] ? lock_acquire+0x80/0x300 <4> [480.716840] ? lock_release+0xd0/0x2b0 <4> [480.716844] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [480.716850] process_one_work+0x239/0x740 <4> [480.716857] worker_thread+0x200/0x3f0 <4> [480.716860] ? __pfx_worker_thread+0x10/0x10 <4> [480.716862] kthread+0x10d/0x150 <4> [480.716865] ? __pfx_kthread+0x10/0x10 <4> [480.716868] ret_from_fork+0x3bd/0x470 <4> [480.716870] ? __pfx_kthread+0x10/0x10 <4> [480.716873] ret_from_fork_asm+0x1a/0x30 <4> [480.716880] </TASK> <4> [480.716881] irq event stamp: 270537 <4> [480.716882] hardirqs last enabled at (270543): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [480.716884] hardirqs last disabled at (270548): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [480.716886] softirqs last enabled at (268318): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.716889] softirqs last disabled at (268311): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.716892] ---[ end trace 0000000000000000 ]--- <6> [480.716894] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [480.716965] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [480.716973] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [480.717023] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [480.717296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [480.717395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [480.717490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [480.717581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [480.717670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [480.717756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [480.717842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [480.717929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [480.718014] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [480.718113] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [480.718217] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [480.719249] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [480.729173] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [480.729445] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [480.730093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [480.730196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [480.730274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [480.730351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [480.730427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [480.730501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [480.730573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [480.730648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [480.730722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [480.730797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [480.730870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [480.730944] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [480.731017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [480.731090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [480.731171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [480.731244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [480.731317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [480.731389] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [480.731461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [480.731544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [480.731624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [480.731707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [480.731784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [480.731862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [480.731938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [480.732012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [480.732086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [480.732167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [480.732242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [480.732321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [480.732401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [480.732480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [480.732558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [480.732635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [480.732721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [480.732806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [480.732904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [480.732986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [480.733063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [480.733140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [480.733231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [480.733308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [480.733382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [480.733459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [480.733535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [480.733609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [480.733685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [480.733759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [480.733832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [480.733907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [480.733984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [480.734058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [480.734136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [480.734228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [480.734305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [480.734382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [480.734458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [480.734531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [480.734608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [480.734687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [480.734764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [480.734841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [480.734915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [480.734988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [480.735084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [480.735198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [480.735306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [480.735388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [480.735467] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [480.736076] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [480.736082] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12666, lrc_seqno=12666, guc_id=0, flags=0x73 in no process [-1] <7> [480.736086] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [480.736148] ------------[ cut here ]------------ <4> [480.736155] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [480.736158] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:66/10933 <4> [480.736243] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [480.736310] [last unloaded: snd_hda_intel] <4> [480.736314] CPU: 7 UID: 0 PID: 10933 Comm: kworker/u64:66 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [480.736317] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [480.736318] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [480.736320] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [480.736325] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [480.736394] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [480.736396] RSP: 0018:ffffc9000396fca0 EFLAGS: 00010246 <4> [480.736398] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [480.736400] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [480.736401] RBP: ffffc9000396fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [480.736402] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [480.736404] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [480.736405] FS: 0000000000000000(0000) GS:ffff8888dae02000(0000) knlGS:0000000000000000 <4> [480.736407] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [480.736408] CR2: 00007cffc8202c58 CR3: 000000000364a001 CR4: 0000000000f72ef0 <4> [480.736409] PKRU: 55555554 <4> [480.736411] Call Trace: <4> [480.736412] <TASK> <4> [480.736416] ? lock_acquire+0x80/0x300 <4> [480.736421] ? lock_release+0xd0/0x2b0 <4> [480.736426] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [480.736432] process_one_work+0x239/0x740 <4> [480.736439] worker_thread+0x200/0x3f0 <4> [480.736442] ? __pfx_worker_thread+0x10/0x10 <4> [480.736444] kthread+0x10d/0x150 <4> [480.736447] ? __pfx_kthread+0x10/0x10 <4> [480.736450] ret_from_fork+0x3bd/0x470 <4> [480.736452] ? __pfx_kthread+0x10/0x10 <4> [480.736455] ret_from_fork_asm+0x1a/0x30 <4> [480.736462] </TASK> <4> [480.736463] irq event stamp: 262365 <4> [480.736464] hardirqs last enabled at (262371): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [480.736467] hardirqs last disabled at (262376): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [480.736469] softirqs last enabled at (260940): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.736471] softirqs last disabled at (260933): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.736474] ---[ end trace 0000000000000000 ]--- <6> [480.737271] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [480.737373] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [480.737382] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [480.737370] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [480.737482] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [480.737591] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [480.737853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [480.737943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [480.738034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [480.738122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [480.738243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [480.738332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [480.738420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [480.738507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [480.738587] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [480.738682] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [480.738771] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [480.739804] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [480.750159] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [480.750411] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [480.751039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [480.751116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [480.751215] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [480.751312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [480.751390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [480.751463] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [480.751536] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [480.751609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [480.751683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [480.751757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [480.751830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [480.751904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [480.751976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [480.752048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [480.752122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [480.752213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [480.752300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [480.752373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [480.752447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [480.752530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [480.752611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [480.752690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [480.752766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [480.752843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [480.752920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [480.752994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [480.753071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [480.753147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [480.753242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [480.753331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [480.753410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [480.753488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [480.753566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [480.753643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [480.753725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [480.753808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [480.753889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [480.753968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [480.754047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [480.754122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [480.754212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [480.754304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [480.754381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [480.754457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [480.754535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [480.754611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [480.754687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [480.754763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [480.754838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [480.754914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [480.754993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [480.755068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [480.755144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [480.755237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [480.755323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [480.755401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [480.755479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [480.755555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [480.755630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [480.755708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [480.755783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [480.755858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [480.755933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [480.756007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [480.756084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [480.756167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [480.756252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [480.756325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [480.756402] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [480.756682] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [480.756687] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12666, lrc_seqno=12666, guc_id=0, flags=0x73 in no process [-1] <7> [480.756690] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [480.756750] ------------[ cut here ]------------ <4> [480.756752] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [480.756753] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:66/10933 <4> [480.756825] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [480.756891] [last unloaded: snd_hda_intel] <4> [480.756894] CPU: 6 UID: 0 PID: 10933 Comm: kworker/u64:66 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [480.756897] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [480.756898] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [480.756900] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [480.756905] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [480.756976] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [480.756978] RSP: 0018:ffffc9000396fca0 EFLAGS: 00010246 <4> [480.756980] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [480.756981] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [480.756983] RBP: ffffc9000396fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [480.756984] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [480.756985] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [480.756987] FS: 0000000000000000(0000) GS:ffff8888dad82000(0000) knlGS:0000000000000000 <4> [480.756988] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [480.756989] CR2: 0000780ce7622000 CR3: 0000000119019005 CR4: 0000000000f72ef0 <4> [480.756991] PKRU: 55555554 <4> [480.756992] Call Trace: <4> [480.756993] <TASK> <4> [480.756997] ? lock_acquire+0x80/0x300 <4> [480.757002] ? lock_release+0xd0/0x2b0 <4> [480.757010] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [480.757015] process_one_work+0x239/0x740 <4> [480.757022] worker_thread+0x200/0x3f0 <4> [480.757025] ? __pfx_worker_thread+0x10/0x10 <4> [480.757028] kthread+0x10d/0x150 <4> [480.757030] ? __pfx_kthread+0x10/0x10 <4> [480.757033] ret_from_fork+0x3bd/0x470 <4> [480.757035] ? __pfx_kthread+0x10/0x10 <4> [480.757038] ret_from_fork_asm+0x1a/0x30 <4> [480.757045] </TASK> <4> [480.757046] irq event stamp: 266803 <4> [480.757047] hardirqs last enabled at (266809): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [480.757050] hardirqs last disabled at (266814): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [480.757051] softirqs last enabled at (265284): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.757054] softirqs last disabled at (265275): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.757057] ---[ end trace 0000000000000000 ]--- <7> [480.758125] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <5> [480.758251] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12667, lrc_seqno=12667, guc_id=0, flags=0x73 in no process [-1] <7> [480.758256] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [480.758254] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [480.758320] ------------[ cut here ]------------ <4> [480.758321] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [480.758322] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:14/2404 <7> [480.758357] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0. <4> [480.758398] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [480.758463] [last unloaded: snd_hda_intel] <4> [480.758467] CPU: 11 UID: 0 PID: 2404 Comm: kworker/u64:14 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [480.758470] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [480.758471] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [480.758472] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [480.758478] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [480.758549] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [480.758551] RSP: 0018:ffffc90003d8fca0 EFLAGS: 00010246 <4> [480.758553] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [480.758554] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [480.758556] RBP: ffffc90003d8fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [480.758557] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [480.758558] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [480.758559] FS: 0000000000000000(0000) GS:ffff8888db002000(0000) knlGS:0000000000000000 <4> [480.758561] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [480.758562] CR2: 00007a4950096068 CR3: 000000000364a003 CR4: 0000000000f72ef0 <4> [480.758564] PKRU: 55555554 <4> [480.758565] Call Trace: <4> [480.758566] <TASK> <4> [480.758570] ? lock_acquire+0x80/0x300 <4> [480.758576] ? lock_release+0xd0/0x2b0 <4> [480.758580] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [480.758586] process_one_work+0x239/0x740 <4> [480.758592] worker_thread+0x200/0x3f0 <4> [480.758596] ? __pfx_worker_thread+0x10/0x10 <4> [480.758598] kthread+0x10d/0x150 <4> [480.758600] ? __pfx_kthread+0x10/0x10 <4> [480.758603] ret_from_fork+0x3bd/0x470 <4> [480.758605] ? __pfx_kthread+0x10/0x10 <4> [480.758608] ret_from_fork_asm+0x1a/0x30 <4> [480.758616] </TASK> <4> [480.758617] irq event stamp: 391401 <4> [480.758618] hardirqs last enabled at (391407): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [480.758620] hardirqs last disabled at (391412): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [480.758622] softirqs last enabled at (388864): [<ffffffff8133bd03>] kernel_fpu_end+0x53/0x70 <4> [480.758624] softirqs last disabled at (388862): [<ffffffff8133c414>] kernel_fpu_begin_mask+0xc4/0x120 <4> [480.758627] ---[ end trace 0000000000000000 ]--- <6> [480.758629] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [480.758698] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [480.758707] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [480.758754] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [480.759016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [480.759105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [480.759212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [480.759300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [480.759386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [480.759470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [480.759554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [480.759640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [480.759722] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [480.759817] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [480.759908] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [480.760937] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [480.771158] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [480.771410] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [480.772051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [480.772130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [480.772220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [480.772297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [480.772374] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [480.772449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [480.772523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [480.772598] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [480.772670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [480.772742] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [480.772814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [480.772887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [480.772959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [480.773031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [480.773105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [480.773198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [480.773272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [480.773345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [480.773416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [480.773497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [480.773581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [480.773661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [480.773738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [480.773815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [480.773890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [480.773963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [480.774037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [480.774111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [480.774195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [480.774273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [480.774353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [480.774429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [480.774505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [480.774582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [480.774663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [480.774744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [480.774824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [480.774903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [480.774982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [480.775058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [480.775135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [480.775222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [480.775297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [480.775374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [480.775452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [480.775528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [480.775604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [480.775678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [480.775751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [480.775826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [480.775902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [480.775976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [480.776052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [480.776126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [480.776208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [480.776285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [480.776359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [480.776432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [480.776505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [480.776582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [480.776656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [480.776730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [480.776804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [480.776877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [480.776952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [480.777027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [480.777101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [480.777181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [480.777259] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [480.777532] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [480.777536] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12667, lrc_seqno=12667, guc_id=0, flags=0x73 in no process [-1] <7> [480.777539] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [480.777600] ------------[ cut here ]------------ <4> [480.777601] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [480.777602] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:14/2404 <4> [480.777675] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [480.777739] [last unloaded: snd_hda_intel] <4> [480.777742] CPU: 11 UID: 0 PID: 2404 Comm: kworker/u64:14 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [480.777745] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [480.777746] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [480.777747] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [480.777753] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [480.777822] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [480.777824] RSP: 0018:ffffc90003d8fca0 EFLAGS: 00010246 <4> [480.777826] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [480.777827] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [480.777829] RBP: ffffc90003d8fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [480.777830] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [480.777831] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [480.777832] FS: 0000000000000000(0000) GS:ffff8888db002000(0000) knlGS:0000000000000000 <4> [480.777834] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [480.777835] CR2: 00007a4950096068 CR3: 000000000364a003 CR4: 0000000000f72ef0 <4> [480.777837] PKRU: 55555554 <4> [480.777838] Call Trace: <4> [480.777839] <TASK> <4> [480.777843] ? lock_acquire+0x80/0x300 <4> [480.777848] ? lock_release+0xd0/0x2b0 <4> [480.777852] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [480.777858] process_one_work+0x239/0x740 <4> [480.777864] worker_thread+0x200/0x3f0 <4> [480.777867] ? __pfx_worker_thread+0x10/0x10 <4> [480.777870] kthread+0x10d/0x150 <4> [480.777872] ? __pfx_kthread+0x10/0x10 <4> [480.777875] ret_from_fork+0x3bd/0x470 <4> [480.777878] ? __pfx_kthread+0x10/0x10 <4> [480.777880] ret_from_fork_asm+0x1a/0x30 <4> [480.777888] </TASK> <4> [480.777889] irq event stamp: 395857 <4> [480.777890] hardirqs last enabled at (395863): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [480.777892] hardirqs last disabled at (395868): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [480.777894] softirqs last enabled at (394340): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.777896] softirqs last disabled at (394333): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.777899] ---[ end trace 0000000000000000 ]--- <6> [480.777901] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [480.777971] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [480.777976] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [480.778234] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [480.778501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [480.778593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [480.778687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [480.778775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [480.778862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [480.778946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [480.779030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [480.779116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [480.779210] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [480.779307] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [480.779395] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [480.780422] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [480.790160] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [480.790411] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [480.791224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [480.791306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [480.791383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [480.791459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [480.791536] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [480.791611] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [480.791685] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [480.791758] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [480.791833] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [480.791910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [480.791982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [480.792057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [480.792133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [480.792228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [480.792312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [480.792384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [480.792458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [480.792532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [480.792605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [480.792685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [480.792764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [480.792841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [480.792916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [480.792996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [480.793074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [480.793376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [480.793452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [480.793527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [480.793601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [480.793696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [480.793774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [480.793849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [480.793925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [480.794004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [480.794088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [480.794184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [480.794274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [480.794355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [480.794433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [480.794510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [480.794589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [480.794665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [480.794739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [480.794815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [480.794892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [480.794968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [480.795046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [480.795123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [480.795212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [480.795299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [480.795378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [480.795454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [480.795532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [480.795609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [480.795686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [480.795762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [480.795838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [480.795911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [480.795985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [480.796061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [480.796136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [480.796231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [480.796319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [480.796395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [480.796470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [480.796545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [480.796618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [480.796692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [480.796769] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [480.797077] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [480.797082] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12667, lrc_seqno=12667, guc_id=0, flags=0x73 in no process [-1] <7> [480.797084] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [480.797145] ------------[ cut here ]------------ <4> [480.797146] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [480.797153] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:14/2404 <4> [480.797239] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [480.797303] [last unloaded: snd_hda_intel] <4> [480.797307] CPU: 6 UID: 0 PID: 2404 Comm: kworker/u64:14 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [480.797310] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [480.797311] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [480.797313] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [480.797318] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [480.797388] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [480.797390] RSP: 0018:ffffc90003d8fca0 EFLAGS: 00010246 <4> [480.797392] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [480.797393] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [480.797395] RBP: ffffc90003d8fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [480.797396] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [480.797397] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [480.797398] FS: 0000000000000000(0000) GS:ffff8888dad82000(0000) knlGS:0000000000000000 <4> [480.797400] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [480.797401] CR2: 0000780ce7622000 CR3: 0000000119019005 CR4: 0000000000f72ef0 <4> [480.797403] PKRU: 55555554 <4> [480.797404] Call Trace: <4> [480.797405] <TASK> <4> [480.797409] ? lock_acquire+0x80/0x300 <4> [480.797414] ? lock_release+0xd0/0x2b0 <4> [480.797419] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [480.797424] process_one_work+0x239/0x740 <4> [480.797430] worker_thread+0x200/0x3f0 <4> [480.797434] ? __pfx_worker_thread+0x10/0x10 <4> [480.797436] kthread+0x10d/0x150 <4> [480.797438] ? __pfx_kthread+0x10/0x10 <4> [480.797441] ret_from_fork+0x3bd/0x470 <4> [480.797443] ? __pfx_kthread+0x10/0x10 <4> [480.797446] ret_from_fork_asm+0x1a/0x30 <4> [480.797453] </TASK> <4> [480.797454] irq event stamp: 400269 <4> [480.797456] hardirqs last enabled at (400275): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [480.797458] hardirqs last disabled at (400280): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [480.797459] softirqs last enabled at (398904): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.797462] softirqs last disabled at (398897): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.797465] ---[ end trace 0000000000000000 ]--- <7> [480.798345] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [480.798451] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [480.798557] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12669, lrc_seqno=12669, guc_id=0, flags=0x73 in no process [-1] <7> [480.798561] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [480.798624] ------------[ cut here ]------------ <4> [480.798626] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [480.798627] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:14/2404 <4> [480.798701] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [480.798766] [last unloaded: snd_hda_intel] <4> [480.798769] CPU: 10 UID: 0 PID: 2404 Comm: kworker/u64:14 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [480.798772] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [480.798773] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [480.798775] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [480.798780] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [480.798851] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [480.798853] RSP: 0018:ffffc90003d8fca0 EFLAGS: 00010246 <4> [480.798855] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [480.798856] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [480.798857] RBP: ffffc90003d8fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [480.798858] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [480.798860] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [480.798861] FS: 0000000000000000(0000) GS:ffff8888daf82000(0000) knlGS:0000000000000000 <4> [480.798862] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [480.798864] CR2: 0000780ce6a227fd CR3: 000000000364a001 CR4: 0000000000f72ef0 <4> [480.798865] PKRU: 55555554 <4> [480.798866] Call Trace: <4> [480.798868] <TASK> <4> [480.798872] ? lock_acquire+0x80/0x300 <4> [480.798876] ? lock_release+0xd0/0x2b0 <4> [480.798881] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [480.798887] process_one_work+0x239/0x740 <4> [480.798893] worker_thread+0x200/0x3f0 <4> [480.798896] ? __pfx_worker_thread+0x10/0x10 <4> [480.798899] kthread+0x10d/0x150 <4> [480.798901] ? __pfx_kthread+0x10/0x10 <4> [480.798904] ret_from_fork+0x3bd/0x470 <4> [480.798906] ? __pfx_kthread+0x10/0x10 <4> [480.798909] ret_from_fork_asm+0x1a/0x30 <4> [480.798916] </TASK> <4> [480.798917] irq event stamp: 401255 <4> [480.798918] hardirqs last enabled at (401261): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [480.798921] hardirqs last disabled at (401266): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [480.798922] softirqs last enabled at (398904): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.798925] softirqs last disabled at (398897): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.798927] ---[ end trace 0000000000000000 ]--- <6> [480.798929] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [480.798999] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [480.799006] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [480.799055] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [480.799327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [480.799420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [480.799513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [480.799602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [480.799690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [480.799775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [480.799860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [480.799947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [480.800027] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [480.800122] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [480.800256] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [480.801282] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [480.811156] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [480.811408] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [480.812031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [480.812112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [480.812198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [480.812273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [480.812346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [480.812420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [480.812493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [480.812568] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [480.812642] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [480.812717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [480.812791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [480.812865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [480.812940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [480.813013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [480.813087] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [480.813175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [480.813247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [480.813320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [480.813391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [480.813473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [480.813554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [480.813633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [480.813710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [480.813786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [480.813862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [480.813937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [480.814010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [480.814084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [480.814162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [480.814242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [480.814322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [480.814398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [480.814478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [480.814558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [480.814640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [480.814722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [480.814802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [480.814881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [480.814959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [480.815034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [480.815109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [480.815192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [480.815266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [480.815342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [480.815424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [480.815502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [480.815579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [480.815656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [480.815729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [480.815804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [480.815883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [480.815959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [480.816035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [480.816110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [480.816198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [480.816277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [480.816354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [480.816428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [480.816501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [480.816577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [480.816652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [480.816727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [480.816801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [480.816875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [480.816949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [480.817024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [480.817098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [480.817185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [480.817263] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [480.817537] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [480.817542] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12669, lrc_seqno=12669, guc_id=0, flags=0x73 in no process [-1] <7> [480.817544] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [480.817604] ------------[ cut here ]------------ <4> [480.817605] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [480.817607] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:47/4949 <4> [480.817679] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [480.817744] [last unloaded: snd_hda_intel] <4> [480.817747] CPU: 8 UID: 0 PID: 4949 Comm: kworker/u64:47 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [480.817750] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [480.817751] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [480.817753] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [480.817758] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [480.817827] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [480.817829] RSP: 0018:ffffc90002c93ca0 EFLAGS: 00010246 <4> [480.817831] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [480.817833] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [480.817834] RBP: ffffc90002c93db0 R08: 0000000000000000 R09: 0000000000000000 <4> [480.817835] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [480.817836] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [480.817838] FS: 0000000000000000(0000) GS:ffff8888dae82000(0000) knlGS:0000000000000000 <4> [480.817839] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [480.817841] CR2: 0000780ce72227fd CR3: 0000000119019003 CR4: 0000000000f72ef0 <4> [480.817842] PKRU: 55555554 <4> [480.817844] Call Trace: <4> [480.817845] <TASK> <4> [480.817849] ? lock_acquire+0x80/0x300 <4> [480.817853] ? lock_release+0xd0/0x2b0 <4> [480.817858] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [480.817864] process_one_work+0x239/0x740 <4> [480.817870] worker_thread+0x200/0x3f0 <4> [480.817873] ? __pfx_worker_thread+0x10/0x10 <4> [480.817876] kthread+0x10d/0x150 <4> [480.817878] ? __pfx_kthread+0x10/0x10 <4> [480.817881] ret_from_fork+0x3bd/0x470 <4> [480.817883] ? __pfx_kthread+0x10/0x10 <4> [480.817886] ret_from_fork_asm+0x1a/0x30 <4> [480.817893] </TASK> <4> [480.817894] irq event stamp: 698475 <4> [480.817896] hardirqs last enabled at (698481): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [480.817898] hardirqs last disabled at (698486): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [480.817900] softirqs last enabled at (696958): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.817902] softirqs last disabled at (696949): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.817905] ---[ end trace 0000000000000000 ]--- <6> [480.817907] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [480.817977] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [480.817983] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [480.818898] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [480.819001] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [480.819341] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [480.819612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [480.819703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [480.819795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [480.819884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [480.819969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [480.820053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [480.820135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [480.820237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [480.820320] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [480.820415] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [480.820506] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [480.821538] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [480.832263] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [480.832514] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [480.833189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [480.833268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [480.833344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [480.833421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [480.833496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [480.833573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [480.833647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [480.833721] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [480.833793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [480.833865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [480.833937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [480.834010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [480.834082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [480.834160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [480.834233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [480.834305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [480.834377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [480.834448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [480.834521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [480.834602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [480.834682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [480.834765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [480.834844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [480.834923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [480.835001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [480.835077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [480.835161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [480.835237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [480.835312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [480.835388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [480.835466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [480.835545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [480.835623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [480.835700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [480.835782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [480.835864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [480.835945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [480.836028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [480.836110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [480.836201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [480.836278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [480.836352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [480.836426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [480.836504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [480.836582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [480.836659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [480.836736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [480.836811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [480.836885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [480.836959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [480.837037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [480.837116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [480.837203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [480.837279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [480.837354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [480.837429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [480.837504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [480.837578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [480.837651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [480.837729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [480.837804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [480.837879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [480.837952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [480.838026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [480.838101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [480.838182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [480.838258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [480.838338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [480.838416] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [480.838709] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [480.838714] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12669, lrc_seqno=12669, guc_id=0, flags=0x73 in no process [-1] <7> [480.838716] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [480.838776] ------------[ cut here ]------------ <4> [480.838778] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [480.838779] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:47/4949 <4> [480.838850] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [480.838915] [last unloaded: snd_hda_intel] <4> [480.838919] CPU: 9 UID: 0 PID: 4949 Comm: kworker/u64:47 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [480.838921] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [480.838923] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [480.838924] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [480.838929] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [480.839002] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [480.839003] RSP: 0018:ffffc90002c93ca0 EFLAGS: 00010246 <4> [480.839006] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [480.839007] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [480.839008] RBP: ffffc90002c93db0 R08: 0000000000000000 R09: 0000000000000000 <4> [480.839010] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [480.839011] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [480.839012] FS: 0000000000000000(0000) GS:ffff8888daf02000(0000) knlGS:0000000000000000 <4> [480.839014] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [480.839015] CR2: 00007cffdf86f000 CR3: 000000000364a005 CR4: 0000000000f72ef0 <4> [480.839017] PKRU: 55555554 <4> [480.839018] Call Trace: <4> [480.839019] <TASK> <4> [480.839023] ? lock_acquire+0x80/0x300 <4> [480.839028] ? lock_release+0xd0/0x2b0 <4> [480.839033] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [480.839039] process_one_work+0x239/0x740 <4> [480.839045] worker_thread+0x200/0x3f0 <4> [480.839048] ? __pfx_worker_thread+0x10/0x10 <4> [480.839051] kthread+0x10d/0x150 <4> [480.839053] ? __pfx_kthread+0x10/0x10 <4> [480.839056] ret_from_fork+0x3bd/0x470 <4> [480.839058] ? __pfx_kthread+0x10/0x10 <4> [480.839061] ret_from_fork_asm+0x1a/0x30 <4> [480.839068] </TASK> <4> [480.839069] irq event stamp: 702901 <4> [480.839070] hardirqs last enabled at (702907): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [480.839073] hardirqs last disabled at (702912): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [480.839074] softirqs last enabled at (701564): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.839077] softirqs last disabled at (701557): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [480.839080] ---[ end trace 0000000000000000 ]--- <7> [480.839949] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [480.840064] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [483.233979] Console: switching to colour frame buffer device 240x67 <6> [483.236110] xe 0000:03:00.0: [drm] Tile0: GT1: ASID: 78 Faulted Address: 0x0000780cd8001000 FaultType: 0 AccessType: 0 FaultLevel: 4 EngineClass: 2 vecs EngineInstance: 0 <6> [483.236135] xe 0000:03:00.0: [drm] Tile0: GT1: Fault response: Unsuccessful -EFAULT <6> [483.236158] xe 0000:03:00.0: [drm] Tile0: GT1: ASID: 78 Faulted Address: 0x0000780cc0001000 FaultType: 0 AccessType: 0 FaultLevel: 4 EngineClass: 1 vcs EngineInstance: 0 <6> [483.236164] xe 0000:03:00.0: [drm] Tile0: GT1: Fault response: Unsuccessful -EFAULT <6> [483.236182] xe 0000:03:00.0: [drm] Tile0: GT1: ASID: 78 Faulted Address: 0x0000780ce0001000 FaultType: 0 AccessType: 0 FaultLevel: 4 EngineClass: 1 vcs EngineInstance: 2 <6> [483.236187] xe 0000:03:00.0: [drm] Tile0: GT1: Fault response: Unsuccessful -EFAULT <6> [483.236204] xe 0000:03:00.0: [drm] Tile0: GT1: ASID: 78 Faulted Address: 0x0000780cc8001000 FaultType: 0 AccessType: 0 FaultLevel: 4 EngineClass: 2 vecs EngineInstance: 1 <6> [483.236208] xe 0000:03:00.0: [drm] Tile0: GT1: Fault response: Unsuccessful -EFAULT <6> [483.236426] xe 0000:03:00.0: [drm] Tile0: GT1: Engine memory CAT error [18]: class=vecs, logical_mask: 0x1, guc_id=3 <6> [483.237043] xe 0000:03:00.0: [drm] Tile0: GT1: Engine memory CAT error [18]: class=vcs, logical_mask: 0x1, guc_id=0 <6> [483.237239] xe 0000:03:00.0: [drm] Tile0: GT1: Engine memory CAT error [18]: class=vcs, logical_mask: 0x2, guc_id=2 <6> [483.237244] xe 0000:03:00.0: [drm] Tile0: GT1: Engine memory CAT error [18]: class=vecs, logical_mask: 0x2, guc_id=1 <5> [483.237901] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12670, lrc_seqno=12670, guc_id=0, flags=0x73 in no process [-1] <7> [483.237909] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <6> [483.238034] xe 0000:03:00.0: [drm] Tile0: GT1: Engine reset: engine_class=vecs, logical_mask: 0x1, guc_id=3, state=0x249 <4> [483.238048] ------------[ cut here ]------------ <4> [483.238050] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [483.237975] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <4> [483.238052] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:66/10933 <5> [483.238108] xe 0000:03:00.0: [drm] Tile0: GT1: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=3, flags=0x0 in xe_exec_system_ [12028] <7> [483.238121] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [483.238198] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [483.238322] [last unloaded: snd_hda_intel] <4> [483.238328] CPU: 8 UID: 0 PID: 10933 Comm: kworker/u64:66 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [483.238333] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [483.238336] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [483.238338] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [483.238349] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [483.238462] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [483.238465] RSP: 0018:ffffc9000396fca0 EFLAGS: 00010246 <4> [483.238469] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [483.238472] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [483.238475] RBP: ffffc9000396fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [483.238477] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [483.238479] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [483.238482] FS: 0000000000000000(0000) GS:ffff8888dae82000(0000) knlGS:0000000000000000 <4> [483.238485] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [483.238487] CR2: 0000780ce72227fd CR3: 000000000364a005 CR4: 0000000000f72ef0 <4> [483.238490] PKRU: 55555554 <4> [483.238493] Call Trace: <4> [483.238495] <TASK> <4> [483.238503] ? lock_acquire+0x80/0x300 <4> [483.238514] ? lock_release+0xd0/0x2b0 <4> [483.238523] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [483.238534] process_one_work+0x239/0x740 <4> [483.238547] worker_thread+0x200/0x3f0 <4> [483.238552] ? __pfx_worker_thread+0x10/0x10 <4> [483.238558] kthread+0x10d/0x150 <4> [483.238562] ? __pfx_kthread+0x10/0x10 <4> [483.238568] ret_from_fork+0x3bd/0x470 <4> [483.238572] ? __pfx_kthread+0x10/0x10 <4> [483.238577] ret_from_fork_asm+0x1a/0x30 <4> [483.238591] </TASK> <4> [483.238594] irq event stamp: 268545 <4> [483.238596] hardirqs last enabled at (268551): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [483.238600] hardirqs last disabled at (268556): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [483.238603] softirqs last enabled at (267796): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.238608] softirqs last disabled at (267789): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.238613] ---[ end trace 0000000000000000 ]--- <6> [483.238616] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [483.238727] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [483.238765] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [483.238823] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [483.238952] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <6> [483.239393] xe 0000:03:00.0: [drm] Tile0: GT1: Engine reset: engine_class=vcs, logical_mask: 0x1, guc_id=0, state=0x249 <5> [483.239402] xe 0000:03:00.0: [drm] Tile0: GT1: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=0, flags=0x0 in xe_exec_system_ [12028] <7> [483.239406] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [483.239390] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [483.239690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [483.239703] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma. <7> [483.239792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [483.240019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <6> [483.240348] xe 0000:03:00.0: [drm] Tile0: GT1: Engine reset: engine_class=vcs, logical_mask: 0x2, guc_id=2, state=0x249 <5> [483.240370] xe 0000:03:00.0: [drm] Tile0: GT1: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=2, flags=0x0 in xe_exec_system_ [12028] <7> [483.240383] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [483.240394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [483.240600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [483.240720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [483.240808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [483.240896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <6> [483.240934] xe 0000:03:00.0: [drm] Tile0: GT1: Engine reset: engine_class=vecs, logical_mask: 0x2, guc_id=1, state=0x249 <5> [483.240943] xe 0000:03:00.0: [drm] Tile0: GT1: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=1, flags=0x0 in xe_exec_system_ [12028] <7> [483.240945] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [483.240978] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [483.241082] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [483.241205] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [483.242486] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [483.253096] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [483.253375] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [483.254460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [483.254569] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [483.254666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [483.254764] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [483.254859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [483.254950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [483.255037] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [483.255202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [483.255290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [483.255378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [483.255459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [483.255540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [483.255620] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [483.255698] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [483.255777] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [483.255855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [483.255932] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [483.256011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [483.256171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [483.256259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [483.256347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [483.256434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [483.256517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [483.256596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [483.256674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [483.256750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [483.256825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [483.256899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [483.256976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [483.257054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [483.257143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [483.257221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [483.257298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [483.257375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [483.257458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [483.257540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [483.257622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [483.257703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [483.257783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [483.257858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [483.257935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [483.258009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [483.258083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [483.258176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [483.258254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [483.258333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [483.258407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [483.258482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [483.258556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [483.258633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [483.258713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [483.258790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [483.258865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [483.259242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [483.259325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [483.259405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [483.259484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [483.259560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [483.259635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [483.259712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [483.259789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [483.259867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [483.259943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [483.260017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [483.260130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [483.260206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [483.260279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [483.260351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [483.260429] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [483.260881] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [483.260889] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12670, lrc_seqno=12670, guc_id=0, flags=0x73 in no process [-1] <7> [483.260894] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [483.261251] ------------[ cut here ]------------ <4> [483.261254] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [483.261258] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#12: kworker/u64:34/4935 <4> [483.261417] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [483.261525] [last unloaded: snd_hda_intel] <4> [483.261533] CPU: 12 UID: 0 PID: 4935 Comm: kworker/u64:34 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [483.261539] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [483.261542] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [483.261546] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [483.261560] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [483.261755] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [483.261759] RSP: 0018:ffffc90002aa3ca0 EFLAGS: 00010246 <4> [483.261764] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [483.261767] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [483.261770] RBP: ffffc90002aa3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [483.261773] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [483.261776] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [483.261779] FS: 0000000000000000(0000) GS:ffff8888db082000(0000) knlGS:0000000000000000 <4> [483.261784] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [483.261789] CR2: 000077cfa6918fc0 CR3: 000000000364a002 CR4: 0000000000f72ef0 <4> [483.261794] PKRU: 55555554 <4> [483.261798] Call Trace: <4> [483.261802] <TASK> <4> [483.261820] ? lock_acquire+0x80/0x300 <4> [483.261840] ? lock_release+0xd0/0x2b0 <4> [483.261858] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [483.261881] process_one_work+0x239/0x740 <4> [483.261907] worker_thread+0x200/0x3f0 <4> [483.261918] ? __pfx_worker_thread+0x10/0x10 <4> [483.261927] kthread+0x10d/0x150 <4> [483.261935] ? __pfx_kthread+0x10/0x10 <4> [483.261945] ret_from_fork+0x3bd/0x470 <4> [483.261953] ? __pfx_kthread+0x10/0x10 <4> [483.261963] ret_from_fork_asm+0x1a/0x30 <4> [483.261993] </TASK> <4> [483.261997] irq event stamp: 83999 <4> [483.262001] hardirqs last enabled at (84005): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [483.262009] hardirqs last disabled at (84010): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [483.262015] softirqs last enabled at (82726): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.262024] softirqs last disabled at (82693): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.262032] ---[ end trace 0000000000000000 ]--- <6> [483.262504] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [483.262651] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [483.262666] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [483.262988] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [483.263118] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [483.263222] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [483.263442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [483.263535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [483.263628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [483.263715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [483.263800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [483.263898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [483.263981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [483.264066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [483.264173] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [483.264303] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [483.264448] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [483.265668] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [483.276121] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [483.276383] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [483.277367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [483.277449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [483.277526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [483.277603] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [483.277680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [483.277754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [483.277828] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [483.277901] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [483.277977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [483.278058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [483.278175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [483.278282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [483.278355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [483.278428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [483.278503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [483.278576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [483.278649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [483.278721] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [483.278792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [483.278875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [483.278958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [483.279038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [483.279125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [483.279206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [483.279285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [483.279361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [483.279437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [483.279511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [483.279584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [483.279660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [483.279737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [483.279814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [483.279891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [483.279978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [483.280063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [483.280160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [483.280243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [483.280322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [483.280402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [483.280480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [483.280558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [483.280635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [483.280709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [483.280786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [483.280864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [483.280940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [483.281017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [483.281095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [483.281169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [483.281245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [483.281323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [483.281398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [483.281473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [483.281549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [483.281623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [483.281699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [483.281775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [483.281849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [483.281924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [483.282001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [483.282076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [483.282171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [483.282248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [483.282324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [483.282400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [483.282476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [483.282550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [483.282627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [483.282707] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [483.282822] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [483.282827] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12670, lrc_seqno=12670, guc_id=0, flags=0x73 in no process [-1] <7> [483.282830] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [483.282891] ------------[ cut here ]------------ <4> [483.282892] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [483.282893] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:11/2401 <4> [483.282967] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [483.283035] [last unloaded: snd_hda_intel] <4> [483.283038] CPU: 8 UID: 0 PID: 2401 Comm: kworker/u64:11 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [483.283042] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [483.283043] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [483.283044] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [483.283050] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [483.283158] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [483.283162] RSP: 0018:ffffc90003d7fca0 EFLAGS: 00010246 <4> [483.283166] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [483.283169] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [483.283171] RBP: ffffc90003d7fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [483.283174] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [483.283176] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [483.283178] FS: 0000000000000000(0000) GS:ffff8888dae82000(0000) knlGS:0000000000000000 <4> [483.283181] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [483.283184] CR2: 0000780ce72227fd CR3: 000000000364a005 CR4: 0000000000f72ef0 <4> [483.283187] PKRU: 55555554 <4> [483.283189] Call Trace: <4> [483.283191] <TASK> <4> [483.283199] ? lock_acquire+0x80/0x300 <4> [483.283208] ? lock_release+0xd0/0x2b0 <4> [483.283216] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [483.283227] process_one_work+0x239/0x740 <4> [483.283238] worker_thread+0x200/0x3f0 <4> [483.283244] ? __pfx_worker_thread+0x10/0x10 <4> [483.283248] kthread+0x10d/0x150 <4> [483.283252] ? __pfx_kthread+0x10/0x10 <4> [483.283257] ret_from_fork+0x3bd/0x470 <4> [483.283261] ? __pfx_kthread+0x10/0x10 <4> [483.283266] ret_from_fork_asm+0x1a/0x30 <4> [483.283279] </TASK> <4> [483.283281] irq event stamp: 412825 <4> [483.283284] hardirqs last enabled at (412831): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [483.283288] hardirqs last disabled at (412836): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [483.283291] softirqs last enabled at (412664): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.283295] softirqs last disabled at (412659): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.283299] ---[ end trace 0000000000000000 ]--- <5> [483.284329] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12671, lrc_seqno=12671, guc_id=0, flags=0x73 in no process [-1] <7> [483.284338] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [483.284440] ------------[ cut here ]------------ <4> [483.284442] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [483.284444] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:34/4935 <4> [483.284521] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [483.284589] [last unloaded: snd_hda_intel] <4> [483.284592] CPU: 3 UID: 0 PID: 4935 Comm: kworker/u64:34 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [483.284595] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [483.284597] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [483.284598] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [483.284604] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [483.284674] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [483.284676] RSP: 0000:ffffc90002aa3ca0 EFLAGS: 00010246 <4> [483.284679] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [483.284680] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [483.284681] RBP: ffffc90002aa3db0 R08: 0000000000000000 R09: 0000000000000000 <7> [483.284629] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [483.284683] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [483.284684] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [483.284685] FS: 0000000000000000(0000) GS:ffff8888dac02000(0000) knlGS:0000000000000000 <4> [483.284687] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [483.284688] CR2: 00007cffc8204ff8 CR3: 000000000364a003 CR4: 0000000000f72ef0 <4> [483.284689] PKRU: 55555554 <4> [483.284690] Call Trace: <4> [483.284691] <TASK> <4> [483.284695] ? lock_acquire+0x80/0x300 <4> [483.284701] ? lock_release+0xd0/0x2b0 <4> [483.284705] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [483.284711] process_one_work+0x239/0x740 <4> [483.284718] worker_thread+0x200/0x3f0 <4> [483.284720] ? __pfx_worker_thread+0x10/0x10 <4> [483.284723] kthread+0x10d/0x150 <4> [483.284725] ? __pfx_kthread+0x10/0x10 <4> [483.284728] ret_from_fork+0x3bd/0x470 <4> [483.284730] ? __pfx_kthread+0x10/0x10 <4> [483.284732] ret_from_fork_asm+0x1a/0x30 <4> [483.284744] </TASK> <4> [483.284745] irq event stamp: 86237 <4> [483.284747] hardirqs last enabled at (86243): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [483.284749] hardirqs last disabled at (86248): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [483.284751] softirqs last enabled at (84754): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.284753] softirqs last disabled at (84589): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.284756] ---[ end trace 0000000000000000 ]--- <7> [483.284742] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [483.284758] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [483.284830] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [483.284837] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [483.284892] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [483.285182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [483.285276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [483.285370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [483.285459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [483.285545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [483.285628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [483.285711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [483.285799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [483.285879] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [483.285974] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [483.286065] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [483.287108] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [483.297092] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [483.297346] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [483.298363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [483.298441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [483.298514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [483.298587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [483.298661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [483.298734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [483.298806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [483.298880] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [483.298953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [483.299025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [483.299108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [483.299180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [483.299252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [483.299326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [483.299398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [483.299472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [483.299544] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [483.299617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [483.299688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [483.299768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [483.299848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [483.299927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [483.300004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [483.300080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [483.300174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [483.300248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [483.300321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [483.300393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [483.300466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [483.300543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [483.300620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [483.300696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [483.300773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [483.300849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [483.300934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [483.301015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [483.301101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [483.301180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [483.301256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [483.301330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [483.301405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [483.301479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [483.301553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [483.301629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [483.301706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [483.301781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [483.301856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [483.301930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [483.302004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [483.302082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [483.302177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [483.302253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [483.302329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [483.302404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [483.302478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [483.302553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [483.302628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [483.302701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [483.302773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [483.302849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [483.302923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [483.302999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [483.303076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [483.303169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [483.303245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [483.303322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [483.303396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [483.303470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [483.303546] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [483.303659] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [483.303663] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12671, lrc_seqno=12671, guc_id=0, flags=0x73 in no process [-1] <7> [483.303666] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [483.303728] ------------[ cut here ]------------ <4> [483.303729] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [483.303731] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:20/2410 <4> [483.303802] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [483.303868] [last unloaded: snd_hda_intel] <4> [483.303871] CPU: 10 UID: 0 PID: 2410 Comm: kworker/u64:20 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [483.303874] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [483.303875] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [483.303877] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [483.303882] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [483.303951] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [483.303953] RSP: 0018:ffffc90003da7ca0 EFLAGS: 00010246 <4> [483.303955] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [483.303957] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [483.303958] RBP: ffffc90003da7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [483.303959] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [483.303960] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [483.303962] FS: 0000000000000000(0000) GS:ffff8888daf82000(0000) knlGS:0000000000000000 <4> [483.303963] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [483.303965] CR2: 0000780ce6a227fd CR3: 000000000364a001 CR4: 0000000000f72ef0 <4> [483.303966] PKRU: 55555554 <4> [483.303967] Call Trace: <4> [483.303969] <TASK> <4> [483.303973] ? lock_acquire+0x80/0x300 <4> [483.303978] ? lock_release+0xd0/0x2b0 <4> [483.303983] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [483.303988] process_one_work+0x239/0x740 <4> [483.303995] worker_thread+0x200/0x3f0 <4> [483.303998] ? __pfx_worker_thread+0x10/0x10 <4> [483.304000] kthread+0x10d/0x150 <4> [483.304003] ? __pfx_kthread+0x10/0x10 <4> [483.304005] ret_from_fork+0x3bd/0x470 <4> [483.304008] ? __pfx_kthread+0x10/0x10 <4> [483.304010] ret_from_fork_asm+0x1a/0x30 <4> [483.304018] </TASK> <4> [483.304019] irq event stamp: 275493 <4> [483.304020] hardirqs last enabled at (275499): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [483.304023] hardirqs last disabled at (275504): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [483.304024] softirqs last enabled at (274336): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.304027] softirqs last disabled at (274327): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.304030] ---[ end trace 0000000000000000 ]--- <6> [483.304031] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [483.304110] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [483.304116] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [483.305361] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [483.305467] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [483.305572] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [483.305778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [483.305867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [483.305961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [483.306050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [483.306155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [483.306239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [483.306324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [483.306408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [483.306488] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [483.306583] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [483.306672] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [483.307703] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [483.318091] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [483.318348] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [483.319323] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [483.319402] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [483.319477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [483.319552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [483.319626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [483.319700] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [483.319774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [483.319847] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [483.319919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [483.319993] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [483.320065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [483.320155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [483.320227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [483.320302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [483.320377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [483.320451] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [483.320525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [483.320598] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [483.320671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [483.320752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [483.320832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [483.320911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [483.320988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [483.321067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [483.321157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [483.321233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [483.321309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [483.321383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [483.321459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [483.321537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [483.321615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [483.321691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [483.321769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [483.321846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [483.321928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [483.322010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [483.322097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [483.322184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [483.322264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [483.322341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [483.322418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [483.322492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [483.322566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [483.322643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [483.322720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [483.322797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [483.322876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [483.322952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [483.323028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [483.323108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [483.323187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [483.323263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [483.323340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [483.323415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [483.323489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [483.323565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [483.323642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [483.323717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [483.323791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [483.323869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [483.323945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [483.324020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [483.324099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [483.324174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [483.324250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [483.324326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [483.324399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [483.324473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [483.324549] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [483.324662] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [483.324666] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12671, lrc_seqno=12671, guc_id=0, flags=0x73 in no process [-1] <7> [483.324669] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [483.324729] ------------[ cut here ]------------ <4> [483.324730] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [483.324731] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:34/4935 <4> [483.324804] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [483.324868] [last unloaded: snd_hda_intel] <4> [483.324872] CPU: 3 UID: 0 PID: 4935 Comm: kworker/u64:34 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [483.324874] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [483.324876] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [483.324877] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [483.324882] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [483.324965] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [483.324967] RSP: 0018:ffffc90002aa3ca0 EFLAGS: 00010246 <4> [483.324969] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [483.324971] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [483.324972] RBP: ffffc90002aa3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [483.324973] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [483.324975] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [483.324976] FS: 0000000000000000(0000) GS:ffff8888dac02000(0000) knlGS:0000000000000000 <4> [483.324978] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [483.324979] CR2: 00007cffc8204ff8 CR3: 000000014180c001 CR4: 0000000000f72ef0 <4> [483.324980] PKRU: 55555554 <4> [483.324982] Call Trace: <4> [483.324983] <TASK> <4> [483.324987] ? lock_acquire+0x80/0x300 <4> [483.324991] ? lock_release+0xd0/0x2b0 <4> [483.324996] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [483.325002] process_one_work+0x239/0x740 <4> [483.325008] worker_thread+0x200/0x3f0 <4> [483.325011] ? __pfx_worker_thread+0x10/0x10 <4> [483.325014] kthread+0x10d/0x150 <4> [483.325016] ? __pfx_kthread+0x10/0x10 <4> [483.325019] ret_from_fork+0x3bd/0x470 <4> [483.325021] ? __pfx_kthread+0x10/0x10 <4> [483.325024] ret_from_fork_asm+0x1a/0x30 <4> [483.325031] </TASK> <4> [483.325032] irq event stamp: 89593 <4> [483.325034] hardirqs last enabled at (89599): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [483.325036] hardirqs last disabled at (89604): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [483.325038] softirqs last enabled at (88434): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.325040] softirqs last disabled at (88427): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.325043] ---[ end trace 0000000000000000 ]--- <7> [483.326073] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [483.326654] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [483.326760] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12672, lrc_seqno=12672, guc_id=0, flags=0x73 in no process [-1] <7> [483.326763] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [483.326823] ------------[ cut here ]------------ <4> [483.326824] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [483.326825] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:34/4935 <4> [483.326899] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [483.326963] [last unloaded: snd_hda_intel] <4> [483.326966] CPU: 3 UID: 0 PID: 4935 Comm: kworker/u64:34 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [483.326969] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [483.326970] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [483.326971] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [483.326976] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [483.327047] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [483.327048] RSP: 0018:ffffc90002aa3ca0 EFLAGS: 00010246 <4> [483.327051] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [483.327052] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [483.327053] RBP: ffffc90002aa3db0 R08: 0000000000000000 R09: 0000000000000000 <4> [483.327054] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [483.327056] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [483.327057] FS: 0000000000000000(0000) GS:ffff8888dac02000(0000) knlGS:0000000000000000 <4> [483.327058] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [483.327060] CR2: 00007cffc8204ff8 CR3: 000000014180c001 CR4: 0000000000f72ef0 <4> [483.327061] PKRU: 55555554 <4> [483.327062] Call Trace: <4> [483.327063] <TASK> <4> [483.327067] ? lock_acquire+0x80/0x300 <4> [483.327072] ? lock_release+0xd0/0x2b0 <4> [483.327077] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [483.327088] process_one_work+0x239/0x740 <4> [483.327095] worker_thread+0x200/0x3f0 <4> [483.327098] ? __pfx_worker_thread+0x10/0x10 <4> [483.327101] kthread+0x10d/0x150 <4> [483.327103] ? __pfx_kthread+0x10/0x10 <4> [483.327106] ret_from_fork+0x3bd/0x470 <4> [483.327108] ? __pfx_kthread+0x10/0x10 <4> [483.327111] ret_from_fork_asm+0x1a/0x30 <4> [483.327118] </TASK> <4> [483.327119] irq event stamp: 90543 <4> [483.327120] hardirqs last enabled at (90549): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [483.327123] hardirqs last disabled at (90554): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [483.327124] softirqs last enabled at (90488): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.327127] softirqs last disabled at (90481): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.327130] ---[ end trace 0000000000000000 ]--- <6> [483.327132] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [483.327202] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [483.327209] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [483.327615] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [483.327818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [483.327907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [483.327999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [483.328092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [483.328181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [483.328263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [483.328346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [483.328431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [483.328511] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [483.328606] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [483.328695] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [483.329721] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [483.340092] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [483.340342] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [483.341308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [483.341387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [483.341462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [483.341538] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [483.341613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [483.341689] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [483.341763] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [483.341836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [483.341909] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [483.341984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [483.342059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [483.342144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [483.342219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [483.342292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [483.342363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [483.342434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [483.342505] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [483.342575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [483.342648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [483.342728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [483.342808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [483.342888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [483.342966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [483.343044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [483.343129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [483.343205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [483.343279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [483.343353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [483.343427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [483.343505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [483.343582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [483.343658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [483.343735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [483.343813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [483.343896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [483.343979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [483.344060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [483.344148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [483.344226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [483.344301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [483.344382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [483.344460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [483.344535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [483.344615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [483.344695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [483.344772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [483.344853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [483.344932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [483.345012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [483.345094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [483.345173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [483.345249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [483.345326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [483.345401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [483.345476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [483.345551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [483.345628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [483.345701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [483.345775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [483.345852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [483.345927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [483.346003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [483.346078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [483.346165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [483.346242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [483.346317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [483.346391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [483.346465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [483.346543] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [483.346654] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [483.346658] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12672, lrc_seqno=12672, guc_id=0, flags=0x73 in no process [-1] <7> [483.346660] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [483.346720] ------------[ cut here ]------------ <4> [483.346721] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [483.346723] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:11/2401 <4> [483.346792] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [483.346857] [last unloaded: snd_hda_intel] <4> [483.346860] CPU: 10 UID: 0 PID: 2401 Comm: kworker/u64:11 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [483.346863] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [483.346864] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [483.346865] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [483.346870] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [483.346940] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [483.347170] RSP: 0018:ffffc90003d7fca0 EFLAGS: 00010246 <4> [483.347174] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [483.347175] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [483.347177] RBP: ffffc90003d7fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [483.347178] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [483.347180] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [483.347181] FS: 0000000000000000(0000) GS:ffff8888daf82000(0000) knlGS:0000000000000000 <4> [483.347183] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [483.347185] CR2: 0000780ce6a227fd CR3: 000000000364a001 CR4: 0000000000f72ef0 <4> [483.347186] PKRU: 55555554 <4> [483.347187] Call Trace: <4> [483.347188] <TASK> <4> [483.347192] ? lock_acquire+0x80/0x300 <4> [483.347197] ? lock_release+0xd0/0x2b0 <4> [483.347203] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [483.347209] process_one_work+0x239/0x740 <4> [483.347216] worker_thread+0x200/0x3f0 <4> [483.347219] ? __pfx_worker_thread+0x10/0x10 <4> [483.347221] kthread+0x10d/0x150 <4> [483.347224] ? __pfx_kthread+0x10/0x10 <4> [483.347227] ret_from_fork+0x3bd/0x470 <4> [483.347229] ? __pfx_kthread+0x10/0x10 <4> [483.347232] ret_from_fork_asm+0x1a/0x30 <4> [483.347239] </TASK> <4> [483.347241] irq event stamp: 415991 <4> [483.347242] hardirqs last enabled at (415997): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [483.347244] hardirqs last disabled at (416002): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [483.347246] softirqs last enabled at (414732): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.347249] softirqs last disabled at (414727): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.347252] ---[ end trace 0000000000000000 ]--- <6> [483.348104] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [483.348215] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [483.348228] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [483.348499] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [483.348606] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [483.348710] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [483.348914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [483.349004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [483.349101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [483.349191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [483.349278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [483.349363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [483.349448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [483.349535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [483.349616] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [483.349711] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [483.349803] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [483.350833] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [483.361092] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [483.361343] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [483.362369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [483.362447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [483.362524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [483.362600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [483.362674] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [483.362749] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [483.362824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [483.362898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [483.362972] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [483.363046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [483.363134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [483.363207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [483.363280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [483.363352] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [483.363424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [483.363498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [483.363570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [483.363642] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [483.363713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [483.363796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [483.363877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [483.363957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [483.364033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [483.364120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [483.364200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [483.364277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [483.364354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [483.364429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [483.364504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [483.364583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [483.364664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [483.364742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [483.364820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [483.364897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [483.364983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [483.365068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [483.365164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [483.365246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [483.365324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [483.365400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [483.365477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [483.365553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [483.365627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [483.365705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [483.365784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [483.365860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [483.365938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [483.366016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [483.366096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [483.366174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [483.366253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [483.366328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [483.366405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [483.366480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [483.366554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [483.366630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [483.366706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [483.366779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [483.366853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [483.366932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [483.367011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [483.367094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [483.367170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [483.367245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [483.367321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [483.367396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [483.367472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [483.367548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [483.367629] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [483.367746] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [483.367750] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12672, lrc_seqno=12672, guc_id=0, flags=0x73 in no process [-1] <7> [483.367753] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [483.367813] ------------[ cut here ]------------ <4> [483.367814] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [483.367816] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:11/2401 <4> [483.367887] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [483.367952] [last unloaded: snd_hda_intel] <4> [483.368156] CPU: 2 UID: 0 PID: 2401 Comm: kworker/u64:11 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [483.368159] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [483.368160] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [483.368162] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [483.368168] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [483.368239] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [483.368240] RSP: 0018:ffffc90003d7fca0 EFLAGS: 00010246 <4> [483.368243] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [483.368244] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [483.368245] RBP: ffffc90003d7fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [483.368247] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [483.368248] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [483.368249] FS: 0000000000000000(0000) GS:ffff8888dab82000(0000) knlGS:0000000000000000 <4> [483.368251] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [483.368252] CR2: 0000780cb00120b8 CR3: 000000000364a003 CR4: 0000000000f72ef0 <4> [483.368254] PKRU: 55555554 <4> [483.368255] Call Trace: <4> [483.368256] <TASK> <4> [483.368260] ? lock_acquire+0x80/0x300 <4> [483.368265] ? lock_release+0xd0/0x2b0 <4> [483.368270] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [483.368276] process_one_work+0x239/0x740 <4> [483.368282] worker_thread+0x200/0x3f0 <4> [483.368285] ? __pfx_worker_thread+0x10/0x10 <4> [483.368288] kthread+0x10d/0x150 <4> [483.368290] ? __pfx_kthread+0x10/0x10 <4> [483.368293] ret_from_fork+0x3bd/0x470 <4> [483.368295] ? __pfx_kthread+0x10/0x10 <4> [483.368298] ret_from_fork_asm+0x1a/0x30 <4> [483.368306] </TASK> <4> [483.368307] irq event stamp: 419165 <4> [483.368308] hardirqs last enabled at (419171): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [483.368310] hardirqs last disabled at (419176): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [483.368312] softirqs last enabled at (418970): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.368315] softirqs last disabled at (418965): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.368317] ---[ end trace 0000000000000000 ]--- <5> [483.369616] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12673, lrc_seqno=12673, guc_id=0, flags=0x73 in no process [-1] <7> [483.369621] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [483.369687] ------------[ cut here ]------------ <4> [483.369689] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [483.369690] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:66/10933 <4> [483.369765] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common <7> [483.369734] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [483.369786] intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel] <4> [483.369833] CPU: 9 UID: 0 PID: 10933 Comm: kworker/u64:66 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [483.369836] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [483.369837] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [483.369839] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [483.369844] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <7> [483.369841] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [483.369915] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [483.369917] RSP: 0018:ffffc9000396fca0 EFLAGS: 00010246 <4> [483.369919] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [483.369920] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [483.369921] RBP: ffffc9000396fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [483.369922] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [483.369923] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [483.369925] FS: 0000000000000000(0000) GS:ffff8888daf02000(0000) knlGS:0000000000000000 <4> [483.369926] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [483.369927] CR2: 00007cffdf86f000 CR3: 000000000364a005 CR4: 0000000000f72ef0 <4> [483.369928] PKRU: 55555554 <4> [483.369929] Call Trace: <4> [483.369930] <TASK> <4> [483.369934] ? lock_acquire+0x80/0x300 <4> [483.369939] ? lock_release+0xd0/0x2b0 <4> [483.369944] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [483.369950] process_one_work+0x239/0x740 <4> [483.369956] worker_thread+0x200/0x3f0 <4> [483.369959] ? __pfx_worker_thread+0x10/0x10 <4> [483.369962] kthread+0x10d/0x150 <4> [483.369964] ? __pfx_kthread+0x10/0x10 <4> [483.369967] ret_from_fork+0x3bd/0x470 <4> [483.369969] ? __pfx_kthread+0x10/0x10 <4> [483.369972] ret_from_fork_asm+0x1a/0x30 <4> [483.369979] </TASK> <4> [483.369981] irq event stamp: 270159 <4> [483.369982] hardirqs last enabled at (270165): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [483.369984] hardirqs last disabled at (270170): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [483.369986] softirqs last enabled at (267796): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.369988] softirqs last disabled at (267789): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.369991] ---[ end trace 0000000000000000 ]--- <6> [483.369993] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [483.370064] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [483.370070] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [483.370484] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [483.370690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [483.370779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [483.370870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [483.370955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [483.371039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [483.371134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [483.371218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [483.371304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [483.371398] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [483.371494] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [483.371584] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [483.372625] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [483.383088] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [483.383337] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [483.384446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [483.384527] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [483.384603] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [483.384678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [483.384754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [483.384829] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [483.384904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [483.384977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [483.385051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [483.385140] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [483.385214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [483.385288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [483.385360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [483.385433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [483.385506] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [483.385577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [483.385648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [483.385720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [483.385794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [483.385873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [483.385953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [483.386033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [483.386121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [483.386202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [483.386280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [483.386356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [483.386431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [483.386506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [483.386583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [483.386660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [483.386739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [483.386817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [483.386896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [483.386975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [483.387061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [483.387155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [483.387238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [483.387321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [483.387405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [483.387482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [483.387558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [483.387634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [483.387708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [483.387784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [483.387863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [483.387941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [483.388017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [483.388104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [483.388178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [483.388254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [483.388333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [483.388407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [483.388483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [483.388557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [483.388632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [483.388707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [483.388782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [483.388855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [483.388929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [483.389005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [483.389079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [483.389169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [483.389246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [483.389321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [483.389397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [483.389473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [483.389547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [483.389622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [483.389701] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [483.389812] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [483.389816] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12673, lrc_seqno=12673, guc_id=0, flags=0x73 in no process [-1] <7> [483.389818] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [483.389878] ------------[ cut here ]------------ <4> [483.389880] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [483.389881] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:66/10933 <4> [483.389953] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [483.390017] [last unloaded: snd_hda_intel] <4> [483.390020] CPU: 9 UID: 0 PID: 10933 Comm: kworker/u64:66 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [483.390023] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [483.390024] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [483.390025] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [483.390030] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [483.390108] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [483.390110] RSP: 0018:ffffc9000396fca0 EFLAGS: 00010246 <4> [483.390112] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [483.390114] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [483.390115] RBP: ffffc9000396fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [483.390117] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [483.390118] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [483.390120] FS: 0000000000000000(0000) GS:ffff8888daf02000(0000) knlGS:0000000000000000 <4> [483.390121] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [483.390123] CR2: 00007cffdf86f000 CR3: 000000000364a005 CR4: 0000000000f72ef0 <4> [483.390124] PKRU: 55555554 <4> [483.390126] Call Trace: <4> [483.390127] <TASK> <4> [483.390130] ? lock_acquire+0x80/0x300 <4> [483.390135] ? lock_release+0xd0/0x2b0 <4> [483.390140] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [483.390146] process_one_work+0x239/0x740 <4> [483.390153] worker_thread+0x200/0x3f0 <4> [483.390156] ? __pfx_worker_thread+0x10/0x10 <4> [483.390158] kthread+0x10d/0x150 <4> [483.390160] ? __pfx_kthread+0x10/0x10 <4> [483.390163] ret_from_fork+0x3bd/0x470 <4> [483.390166] ? __pfx_kthread+0x10/0x10 <4> [483.390168] ret_from_fork_asm+0x1a/0x30 <4> [483.390176] </TASK> <4> [483.390177] irq event stamp: 273401 <4> [483.390178] hardirqs last enabled at (273407): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [483.390180] hardirqs last disabled at (273412): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [483.390182] softirqs last enabled at (272508): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.390185] softirqs last disabled at (272501): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.390188] ---[ end trace 0000000000000000 ]--- <6> [483.390189] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [483.390259] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [483.390264] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [483.390673] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [483.390873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [483.390959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [483.391049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [483.391142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [483.391225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [483.391307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [483.391389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [483.391475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [483.391556] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [483.391651] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [483.391740] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [483.392775] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [483.403436] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [483.403687] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [483.404688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [483.404767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [483.404841] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [483.404916] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [483.404990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [483.405064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [483.405154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [483.405229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [483.405302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [483.405376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [483.405447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [483.405520] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [483.405597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [483.405670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [483.405743] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [483.405814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [483.405886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [483.405958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [483.406031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [483.406119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [483.406199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [483.406280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [483.406361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [483.406439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [483.406517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [483.406592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [483.406667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [483.406741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [483.406817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [483.406896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [483.406975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [483.407052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [483.407138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [483.407215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [483.407297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [483.407381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [483.407468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [483.407550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [483.407631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [483.407708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [483.407785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [483.407860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [483.407933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [483.408009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [483.408090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [483.408167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [483.408243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [483.408319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [483.408395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [483.408473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [483.408552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [483.408628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [483.408704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [483.408780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [483.408856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [483.408933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [483.409011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [483.409088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [483.409163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [483.409239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [483.409314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [483.409389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [483.409463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [483.409535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [483.409611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [483.409686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [483.409759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [483.409834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [483.409915] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [483.410026] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [483.410030] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=12673, lrc_seqno=12673, guc_id=0, flags=0x73 in no process [-1] <7> [483.410032] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [483.410947] ------------[ cut here ]------------ <4> [483.410948] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [483.410950] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1615 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:66/10933 <4> [483.411025] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [483.411094] [last unloaded: snd_hda_intel] <4> [483.411097] CPU: 9 UID: 0 PID: 10933 Comm: kworker/u64:66 Tainted: G S U W 7.1.0-rc7-lgci-xe-xe-5218-0375ba98c1fdf69bc-debug+ #1 PREEMPT(lazy) <4> [483.411100] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [483.411101] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024 <4> [483.411103] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [483.411108] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [483.411177] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [483.411178] RSP: 0018:ffffc9000396fca0 EFLAGS: 00010246 <4> [483.411181] RAX: ffffffffa12094ec RBX: 0000000000000000 RCX: 0000000000000000 <4> [483.411182] RDX: ffff888101713890 RSI: ffffffffa12094ec RDI: ffffffffa1003fd0 <4> [483.411183] RBP: ffffc9000396fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [483.411185] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [483.411186] R13: ffff888101713890 R14: ffff8881708f3818 R15: 00000000ffffffc2 <4> [483.411187] FS: 0000000000000000(0000) GS:ffff8888daf02000(0000) knlGS:0000000000000000 <4> [483.411189] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [483.411190] CR2: 00007cffdf86f000 CR3: 000000000364a005 CR4: 0000000000f72ef0 <4> [483.411191] PKRU: 55555554 <4> [483.411193] Call Trace: <4> [483.411194] <TASK> <4> [483.411197] ? lock_acquire+0x80/0x300 <4> [483.411202] ? lock_release+0xd0/0x2b0 <4> [483.411207] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [483.411212] process_one_work+0x239/0x740 <4> [483.411219] worker_thread+0x200/0x3f0 <4> [483.411222] ? __pfx_worker_thread+0x10/0x10 <4> [483.411224] kthread+0x10d/0x150 <4> [483.411227] ? __pfx_kthread+0x10/0x10 <4> [483.411230] ret_from_fork+0x3bd/0x470 <4> [483.411232] ? __pfx_kthread+0x10/0x10 <4> [483.411234] ret_from_fork_asm+0x1a/0x30 <4> [483.411242] </TASK> <4> [483.411243] irq event stamp: 276597 <4> [483.411244] hardirqs last enabled at (276603): [<ffffffff814ac659>] __up_console_sem+0x79/0xa0 <4> [483.411246] hardirqs last disabled at (276608): [<ffffffff814ac63e>] __up_console_sem+0x5e/0xa0 <4> [483.411248] softirqs last enabled at (276310): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.411250] softirqs last disabled at (276303): [<ffffffff813d32bb>] __irq_exit_rcu+0xdb/0x1c0 <4> [483.411253] ---[ end trace 0000000000000000 ]--- <7> [483.411267] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [483.411371] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [483.412430] xe 0000:03:00.0: [drm:drm_pagemap_dev_unhold_work [drm_gpusvm_helper]] Releasing reference on provider device and module. <7> [483.427658] xe 0000:03:00.0: [drm:drm_client_dev_restore] fbdev: ret=0

<4> [469.278890] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [469.279030] Code: 3f 45 0f b6 64 24 26 44 0f b6 70 08 e8 70 c3 5b e1 48 89 c6 48 8d 3d 26 52 38 00 53 41 0f b6 ce 45 89 e9 45 0f b6 c4 4c 89 fa <67> 48 0f b9 3a 45 31 f6 58 48 8d 65 d8 4c 89 f0 5b 41 5c 41 5d 41

<4> [470.104941] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [470.105103] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [475.418544] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [475.419388] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [480.538812] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [480.539883] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [480.543405] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [480.543997] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [480.564018] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [480.564172] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [480.585734] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [480.585882] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [480.589351] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [480.589506] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [480.609736] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [480.609903] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [480.629674] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [480.629821] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [480.631020] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit

<4> [480.631038] kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel]

<4> [480.631208] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [480.651260] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [480.651410] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [480.671684] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [480.671833] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [480.673825] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [480.673980] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [480.693679] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [480.693831] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [480.714949] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [480.715311] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [480.716662] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [480.716813] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [480.736243] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [480.736394] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [480.756825] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [480.756976] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [480.758398] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [480.758549] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [480.777675] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [480.777822] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [480.797239] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [480.797388] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [480.798701] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [480.798851] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [480.817679] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [480.817827] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [480.838850] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [480.839002] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [483.238198] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [483.238462] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [483.261417] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [483.261755] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [483.282967] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [483.283158] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [483.284521] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [483.284674] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [483.303802] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [483.303951] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [483.324804] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [483.324965] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [483.326899] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [483.327047] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [483.346792] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [483.346940] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [483.367887] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [483.368239] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [483.369765] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common

<4> [483.369786] intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel]

<4> [483.369915] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [483.389953] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [483.390108] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [483.411025] Modules linked in: vgem snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic coretemp mtd asus_nb_wmi asus_wmi sparse_keymap mei_pxp binfmt_misc mei_hdcp kvm_intel wmi_bmof snd_intel_dspcfg snd_hda_codec snd_hda_core kvm snd_hwdep irqbypass r8169 aesni_intel gf128mul snd_pcm usbhid rapl snd_timer hid intel_cstate realtek phy_package i2c_i801 i2c_mux spi_intel_pci snd spi_intel i2c_smbus video soundcore intel_pmc_core nls_iso8859_1 pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake acpi_tad acpi_pad mei_me idma64 intel_vsec mei wmi dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [483.411177] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b0 0c 5d e1 48 89 c6 48 8d 3d a6 91 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

Results for igt@xe_exec_system_allocator@threads-shared-vm-many-execqueues-new