[Unstable test] general/scheduler/sched_stress: cgroup: fork rejected by pids controller in /system.slice/restraintd.service [moved to RHELTEST-239]
This issue has been closed and moved to JIRA: https://issues.redhat.com/browse/RHELTEST-239
Please continue with your actions and comments in the linked Jira ticket.
Snippet of test failure
Job: https://beaker.engineering.redhat.com/jobs/10038891 (ppc64le)
5.14.0-518.5433_1496784485.el9.ppc64le:
[ 6980.051745] restraintd[1165]: ** Running task: 185516327 [git://repo.usersys.redhat.com/kernel-tests?master#general/scheduler/sched_stress]
[ 7040.002941] restraintd[1165]: *** Current Time: Fri Oct 18 17:36:07 2024 Localwatchdog at: Fri Oct 18 19:35:07 2024
[ 7100.003010] restraintd[1165]: *** Current Time: Fri Oct 18 17:37:07 2024 Localwatchdog at: Fri Oct 18 19:35:07 2024
[ 7160.002826] restraintd[1165]: *** Current Time: Fri Oct 18 17:38:07 2024 Localwatchdog at: Fri Oct 18 19:35:07 2024
[ 7220.002662] restraintd[1165]: *** Current Time: Fri Oct 18 17:39:07 2024 Localwatchdog at: Fri Oct 18 19:35:07 2024
[-- MARK -- Fri Oct 18 21:40:00 2024]
[ 7280.007829] restraintd[1165]: *** Current Time: Fri Oct 18 17:40:07 2024 Localwatchdog at: Fri Oct 18 19:35:07 2024
[ 7340.002496] restraintd[1165]: *** Current Time: Fri Oct 18 17:41:07 2024 Localwatchdog at: Fri Oct 18 19:35:07 2024
[ 7400.025090] restraintd[1165]: *** Current Time: Fri Oct 18 17:42:07 2024 Localwatchdog at: Fri Oct 18 19:35:07 2024
[ 7460.002672] restraintd[1165]: *** Current Time: Fri Oct 18 17:43:07 2024 Localwatchdog at: Fri Oct 18 19:35:07 2024
[ 7520.002527] restraintd[1165]: *** Current Time: Fri Oct 18 17:44:07 2024 Localwatchdog at: Fri Oct 18 19:35:07 2024
[-- MARK -- Fri Oct 18 21:45:00 2024]
[ 7580.006604] restraintd[1165]: *** Current Time: Fri Oct 18 17:45:07 2024 Localwatchdog at: Fri Oct 18 19:35:07 2024
[ 7640.031731] restraintd[1165]: *** Current Time: Fri Oct 18 17:46:07 2024 Localwatchdog at: Fri Oct 18 19:35:07 2024
[ 7700.002690] restraintd[1165]: *** Current Time: Fri Oct 18 17:47:07 2024 Localwatchdog at: Fri Oct 18 19:35:07 2024
[ 7760.007665] restraintd[1165]: *** Current Time: Fri Oct 18 17:48:07 2024 Localwatchdog at: Fri Oct 18 19:35:07 2024
[ 7820.004507] restraintd[1165]: *** Current Time: Fri Oct 18 17:49:07 2024 Localwatchdog at: Fri Oct 18 19:35:07 2024
[-- MARK -- Fri Oct 18 21:50:00 2024]
[ 7880.001732] restraintd[1165]: *** Current Time: Fri Oct 18 17:50:07 2024 Localwatchdog at: Fri Oct 18 19:35:07 2024
[ 7940.002358] restraintd[1165]: *** Current Time: Fri Oct 18 17:51:07 2024 Localwatchdog at: Fri Oct 18 19:35:07 2024
[ 7981.823377] stress-ng-clone invoked oom-killer: gfp_mask=0x140cca(GFP_HIGHUSER_MOVABLE|__GFP_COMP), order=0, oom_score_adj=1000
[ 7981.823413] CPU: 4 PID: 238555 Comm: stress-ng-clone Kdump: loaded Tainted: G OE ------- --- 5.14.0-518.5433_1496784485.el9.ppc64le #1
[ 7981.823429] Call Trace:
[ 7981.823434] [c000000046e67480] [c0000000008fe6e0] dump_stack_lvl+0x74/0xa8 (unreliable)
[ 7981.823456] [c000000046e674c0] [c000000000473d68] dump_header+0x64/0x264
[ 7981.823471] [c000000046e67540] [c000000000472fd4] oom_kill_process+0x314/0x320
[ 7981.823486] [c000000046e67580] [c00000000047395c] out_of_memory+0x11c/0x430
[ 7981.823499] [c000000046e67610] [c000000000514c64] __alloc_pages_may_oom+0x154/0x230
[ 7981.823515] [c000000046e676b0] [c0000000005158bc] __alloc_pages_slowpath.constprop.0+0x80c/0xb40
[ 7981.823530] [c000000046e677e0] [c000000000515e00] __alloc_pages+0x210/0x2c0
[ 7981.823543] [c000000046e67870] [c000000000516814] __folio_alloc+0x34/0x90
[ 7981.823556] [c000000046e678a0] [c00000000054c188] vma_alloc_folio+0xd8/0x500
[ 7981.823571] [c000000046e67950] [c0000000004d6fa8] do_anonymous_page+0x98/0x610
[ 7981.823585] [c000000046e679b0] [c0000000004def58] __handle_mm_fault+0x428/0x620
[ 7981.823599] [c000000046e67ab0] [c0000000004df234] handle_mm_fault+0xe4/0x410
[ 7981.823614] [c000000046e67b00] [c0000000004cb3dc] faultin_page+0x7c/0x170
[ 7981.823627] [c000000046e67b40] [c0000000004ce594] __get_user_pages+0x204/0x410
[ 7981.823640] [c000000046e67bd0] [c0000000004d1908] populate_vma_page_range+0x88/0xf0
[ 7981.823655] [c000000046e67c10] [c0000000004d1b18] __mm_populate+0xe8/0x270
[ 7981.823669] [c000000046e67c90] [c0000000004a626c] vm_mmap_pgoff+0x19c/0x1f0
[ 7981.823682] [c000000046e67d20] [c0000000004eac30] ksys_mmap_pgoff+0x70/0x2c0
[ 7981.823694] [c000000046e67d90] [c000000000012b78] sys_mmap+0x48/0x90
[ 7981.823707] [c000000046e67db0] [c00000000002ee54] system_call_exception+0x164/0x310
[ 7981.823720] [c000000046e67e10] [c00000000000bfe8] system_call_vectored_common+0xe8/0x278
[ 7981.823735] --- interrupt: 3000 at 0x7fff90ebcd74
[ 7981.823746] NIP: 00007fff90ebcd74 LR: 0000000000000000 CTR: 0000000000000000
[ 7981.823756] REGS: c000000046e67e80 TRAP: 3000 Tainted: G OE ------- --- (5.14.0-518.5433_1496784485.el9.ppc64le)
[ 7981.823769] MSR: 800000000000d033 <SF,EE,PR,ME,IR,DR,RI,LE> CR: 44042484 XER: 00000000
[ 7981.823798] IRQMASK: 0
[ 7981.823798] GPR00: 000000000000005a 00007fffd1fdc6c0 00007fff90fb7200 0000000000000000
[ 7981.823798] GPR04: 0000000080000000 0000000000000003 0000000000008022 ffffffffffffffff
[ 7981.823798] GPR08: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 7981.823798] GPR12: 0000000000000000 00007fff912cc600 0000000000000000 000000013b7e7d68
[ 7981.823798] GPR16: 000000013b7e7cb8 0000000000000000 0000000000000000 0000000000000000
[ 7981.823798] GPR20: 0000000000000000 00007fff900e0000 0000000000000001 000000013b7e7c60
[ 7981.823798] GPR24: 0000000080000000 0000000000000001 000000001dcd6500 000000013b7e9f80
[ 7981.823798] GPR28: 00007fffd1fdc8b4 00007fff90bc1568 0000000000000000 00007fff900e0000
[ 7981.823923] NIP [00007fff90ebcd74] 0x7fff90ebcd74
[ 7981.823931] LR [0000000000000000] 0x0
[ 7981.823938] --- interrupt: 3000
[ 7981.823944] Mem-Info:
[ 7981.823950] active_anon:52811 inactive_anon:51108 isolated_anon:0
[ 7981.823950] active_file:80 inactive_file:110 isolated_file:0
[ 7981.823950] unevictable:1 dirty:0 writeback:132
[ 7981.823950] slab_reclaimable:571 slab_unreclaimable:4207
[ 7981.823950] mapped:220 shmem:38 pagetables:211
[ 7981.823950] sec_pagetables:0 bounce:0
[ 7981.823950] kernel_misc_reclaimable:0
[ 7981.823950] free:2695 free_pcp:96 free_cma:0
[ 7981.823983] Node 1 active_anon:4690944kB inactive_anon:1959872kB active_file:5120kB inactive_file:7040kB unevictable:64kB isolated(anon):0kB isolated(file):0kB mapped:14080kB dirty:0kB writeback:8448kB shmem:2432kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB kernel_stack:7904kB pagetables:13504kB sec_pagetables:0kB all_unreclaimable? no
[ 7981.824013] Node 1 Normal free:172480kB boost:0kB min:180224kB low:225280kB high:270336kB reserved_highatomic:0KB active_anon:4690944kB inactive_anon:1965120kB active_file:0kB inactive_file:11392kB unevictable:64kB writepending:256kB present:8388608kB managed:7751680kB mlocked:64kB bounce:0kB free_pcp:6144kB local_pcp:0kB free_cma:0kB
[ 7981.824044] lowmem_reserve[]: 0 0 0
[ 7981.824056] Node 1 Normal: 346*64kB (UE) 266*128kB (UME) 154*256kB (UE) 94*512kB (UE) 33*1024kB (U) 2*2048kB (UM) 0*4096kB 0*8192kB 0*16384kB = 181632kB
[ 7981.824106] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=16384kB
[ 7981.824118] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=16777216kB
[ 7981.824128] 606 total pagecache pages
[ 7981.824135] 478 pages in swap cache
[ 7981.824141] Free swap = 0kB
[ 7981.824147] Total swap = 4194240kB
[ 7981.824154] 131072 pages RAM
[ 7981.824160] 0 pages HighMem/MovableOnly
[ 7981.824166] 9952 pages reserved
[ 7981.824172] 0 pages cma reserved
[ 7981.824177] 0 pages hwpoisoned
[ 7981.824183] Tasks state (memory values in pages):
[ 7981.824189] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
[ 7981.824200] [ 588] 0 588 1501 72 61440 0 -250 systemd-journal
[ 7981.824213] [ 602] 0 602 669 128 55296 0 -1000 systemd-udevd
[ 7981.824227] [ 810] 32 810 293 64 51200 0 0 rpcbind
[ 7981.824240] [ 811] 0 811 354 64 51200 0 -1000 auditd
[ 7981.824251] [ 840] 81 840 222 96 51200 0 -900 dbus-broker-lau
[ 7981.824264] [ 841] 81 841 110 32 51200 0 -900 dbus-broker
[ 7981.824277] [ 842] 0 842 4282 160 63488 0 0 NetworkManager
[ 7981.824290] [ 845] 0 845 1354 64 51200 0 0 irqbalance
[ 7981.824302] [ 846] 2 846 4968 96 63488 0 0 rngd
[ 7981.824313] [ 849] 0 849 451 128 53248 0 0 systemd-logind
[ 7981.824325] [ 850] 0 850 119 0 49152 0 0 rtas_errd
[ 7981.824337] [ 857] 997 857 1389 64 53248 0 0 chronyd
[ 7981.824348] [ 864] 0 864 482 128 51200 0 100 systemd
[ 7981.824359] [ 868] 0 868 575 131 55296 32 100 (sd-pam)
[ 7981.824371] [ 884] 0 884 348 64 51200 0 -1000 sshd
[ 7981.824381] [ 893] 0 893 962 64 57344 0 0 gssproxy
[ 7981.824393] [ 894] 0 894 1306 32 53248 0 0 rhsmcertd
[ 7981.824405] [ 916] 0 916 63 32 49152 0 0 agetty
[ 7981.824416] [ 918] 0 918 113 32 51200 0 0 agetty
[ 7981.824427] [ 941] 0 941 4643 84 75776 0 0 rsyslogd
[ 7981.824439] [ 1163] 0 1163 180 64 49152 0 0 crond
[ 7981.824451] [ 1165] 0 1165 3741 64 59392 64 -1000 restraintd
[ 7981.824464] [ 1523] 0 1523 56 0 49152 0 0 life
[ 7981.824476] [ 1548] 0 1548 56 0 49152 0 0 life
[ 7981.824487] [ 1573] 0 1573 56 0 49152 0 0 life
[ 7981.824499] [ 1598] 0 1598 56 0 49152 0 0 life
[ 7981.824510] [ 1623] 0 1623 56 0 49152 0 0 life
[ 7981.824523] [ 1648] 0 1648 56 0 49152 0 0 life
[ 7981.824535] [ 1673] 0 1673 56 0 49152 0 0 life
[ 7981.824546] [ 1698] 0 1698 56 0 49152 0 0 life
[ 7981.824556] [ 1724] 0 1724 56 0 51200 0 0 life
[ 7981.824567] [ 1749] 0 1749 56 0 49152 0 0 life
[ 7981.824578] [ 1774] 0 1774 56 0 49152 0 0 life
[ 7981.824589] [ 1799] 0 1799 56 0 49152 0 0 life
[ 7981.824600] [ 1824] 0 1824 56 0 49152 0 0 life
[ 7981.824611] [ 1849] 0 1849 56 0 49152 0 0 life
[ 7981.824621] [ 1874] 0 1874 56 0 49152 0 0 life
[ 7981.824632] [ 1899] 0 1899 56 0 49152 0 0 life
[ 7981.824643] [ 1924] 0 1924 56 0 49152 0 0 life
[ 7981.824654] [ 1949] 0 1949 56 0 49152 0 0 life
[ 7981.824665] [ 1974] 0 1974 56 0 49152 0 0 life
[ 7981.824676] [ 1999] 0 1999 56 0 49152 0 0 life
[ 7981.824688] [ 2024] 0 2024 56 0 49152 0 0 life
[ 7981.824699] [ 2049] 0 2049 56 0 49152 0 0 life
[ 7981.824711] [ 2074] 0 2074 56 0 49152 0 0 life
[ 7981.824723] [ 2099] 0 2099 56 0 49152 0 0 life
[ 7981.824734] [ 2124] 0 2124 56 0 49152 0 0 life
[ 7981.824745] [ 2149] 0 2149 56 0 49152 0 0 life
[ 7981.824756] [ 2174] 0 2174 56 0 51200 0 0 life
[ 7981.824767] [ 2199] 0 2199 56 0 49152 0 0 life
[ 7981.824778] [ 2224] 0 2224 56 0 51200 0 0 life
[ 7981.824789] [ 2249] 0 2249 56 0 49152 0 0 life
[ 7981.824799] [ 2274] 0 2274 56 0 49152 0 0 life
[ 7981.824810] [ 2299] 0 2299 56 0 49152 0 0 life
[ 7981.824822] [ 2324] 0 2324 56 0 49152 0 0 life
[ 7981.824834] [ 2349] 0 2349 56 0 49152 0 0 life
[ 7981.824846] [ 2374] 0 2374 56 0 49152 0 0 life
[ 7981.824857] [ 2399] 0 2399 56 0 51200 0 0 life
[ 7981.824870] [ 2424] 0 2424 56 0 49152 0 0 life
[ 7981.824882] [ 2449] 0 2449 56 0 51200 0 0 life
[ 7981.824894] [ 2474] 0 2474 56 0 51200 0 0 life
[ 7981.824905] [ 2499] 0 2499 56 0 49152 0 0 life
[ 7981.824917] [ 194831] 0 194831 148 64 49152 0 -1000 10_bash_login
[ 7981.824929] [ 194858] 0 194858 120 32 51200 0 0 make
[ 7981.824941] [ 194873] 0 194873 148 64 49152 0 0 sh
[ 7981.824953] [ 194874] 0 194874 218 64 49152 32 0 sh
[ 7981.824965] [ 238061] 0 238061 429 128 51200 0 0 systemd-hostnam
[ 7981.824979] [ 238400] 0 238400 148 32 49152 0 0 sh
[ 7981.824990] [ 238402] 0 238402 113 32 49152 0 0 sleep
[ 7981.825002] [ 238430] 0 238430 460 96 51200 0 -1000 stress-ng
[ 7981.825013] [ 238543] 0 238543 462 0 51200 0 -1000 stress-ng-clone
[ 7981.825025] [ 238544] 0 238544 462 0 51200 0 -1000 stress-ng-clone
[ 7981.825036] [ 238545] 0 238545 462 0 51200 0 -1000 stress-ng-clone
[ 7981.825048] [ 238546] 0 238546 462 0 51200 0 -1000 stress-ng-clone
[ 7981.825060] [ 238547] 0 238547 462 0 51200 0 -1000 stress-ng-clone
[ 7981.825072] [ 238548] 0 238548 462 0 51200 0 -1000 stress-ng-clone
[ 7981.825083] [ 238549] 0 238549 462 0 51200 0 -1000 stress-ng-clone
[ 7981.825095] [ 238550] 0 238550 33230 14048 245760 10208 1000 stress-ng-clone
[ 7981.825108] [ 238551] 0 238551 33230 15552 243712 8224 1000 stress-ng-clone
[ 7981.825120] [ 238552] 0 238552 33230 14272 235520 8608 1000 stress-ng-clone
[ 7981.825134] [ 238553] 0 238553 33230 15360 256000 10016 1000 stress-ng-clone
[ 7981.825146] [ 238554] 0 238554 33230 14336 235520 8416 1000 stress-ng-clone
[ 7981.825158] [ 238555] 0 238555 33230 13824 243712 9984 1000 stress-ng-clone
[ 7981.825170] [ 238556] 0 238556 33230 14944 243712 8768 1000 stress-ng-clone
[ 7981.825181] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=system.slice,mems_allowed=1,global_oom,task_memcg=/system.slice/restraintd.service,task=stress-ng-clone,pid=238553,uid=0
[ 7981.825224] Out of memory: Killed process 238553 (stress-ng-clone) total-vm:2126720kB, anon-rss:983040kB, file-rss:0kB, shmem-rss:0kB, UID:0 pgtables:250kB oom_score_adj:1000
...
[ 8073.086959] cgroup: fork rejected by pids controller in /system.slice/restraintd.service
Test logs on DataWarehouse
Please include a link to the test execution on DataWarehouse, e.g. https://datawarehouse.cki-project.org/kcidb/tests/1234567.
DataWarehouse issue
If the problem is already tracked on DataWarehouse, please include a link to the DataWarehouse issue, e.g. https://datawarehouse.cki-project.org/issue/12345.
Additional details
Please include any additional information you have about the issue here.
In case opening the links above result in a 404 page on DataWarehouse, please make sure you are correctly logged into DataWarehouse via Red Hat SSO.
Edited by Dominika Veselá