Linux dedicated server crashes

[m4t]

Hello

I self host a little home dedicated server ( Ryzen5 2400G, 16Go DDR4 dual channel, SSD ) on Archlinux.
Randomly, the server crash even with one or two players that just mining and not doing evil things.

I read another forum post that have the same behavior :

The only server management mod I have is CPM, but looking at the Gimli post, he has no CPM.

I the log files, the stack trace has three kind of exception but does not help at my side to understand what happen
 

2020-08-04T04:30:19 36886.745 INF Time: 614.23m FPS: 37.58 Heap: 2858.0MB Max: 3303.7MB Chunks: 1915 CGO: 67 Ply: 4 Zom: 1 Ent: 12 (278) Items: 0 CO: 4 RSS: 4768.3MB
2020-08-04T04:30:27 36895.355 WRN [EAC] Log: [EAC Server]  [Warning] [04:30:27][Linux][EAC Server] [Warn][Cerberus] [Backend] [Think] Reconnection not allowed yet, reconnection interval is 120 seconds.
2020-08-04T04:30:49 36916.775 INF Time: 614.73m FPS: 40.01 Heap: 2795.8MB Max: 3303.7MB Chunks: 1915 CGO: 49 Ply: 4 Zom: 1 Ent: 11 (278) Items: 0 CO: 4 RSS: 4814.7MB
2020-08-04T04:31:19 36946.803 INF Time: 615.23m FPS: 38.20 Heap: 2836.8MB Max: 3303.7MB Chunks: 1915 CGO: 51 Ply: 4 Zom: 0 Ent: 10 (276) Items: 0 CO: 4 RSS: 4818.7MB
2020-08-04T04:31:49 36976.839 INF Time: 615.73m FPS: 36.58 Heap: 2881.9MB Max: 3303.7MB Chunks: 1915 CGO: 51 Ply: 4 Zom: 0 Ent: 10 (276) Items: 0 CO: 4 RSS: 4846.3MB
Obtained 14 stack frames.
#0  0x007ff2887c9355 in (Unknown)
#1  0x007ff2887b2853 in (Unknown)
#2  0x007ff285e3a73e in (Unknown)
#3  0x007ff285e3a7ab in (Unknown)
#4  0x007ff285e3d6ab in (Unknown)
#5  0x007ff285e3d914 in (Unknown)
#6  0x007ff285e3dd82 in (Unknown)
#7  0x007ff285e3ebb4 in (Unknown)
#8  0x007ff285e41a2c in (Unknown)
#9  0x007ff285e41c94 in (Unknown)
#10 0x007ff285e14d92 in (Unknown)
#11 0x007ff285dcaf39 in (Unknown)
#12 0x007ff285dcafa0 in (Unknown)
#13 0x00000041dc55ff in (wrapper managed-to-native) object:__icall_wrapper_ves_icall_array_new_specific (intptr,int)

( complete log file : https://gist.github.com/m4tm4t/d5667dedcdcf5540e23fe404d59b5fbe )

2020-08-02T23:11:36 17782.177 INF Time: 295.86m FPS: 38.13 Heap: 3222.9MB Max: 3791.1MB Chunks: 4333 CGO: 212 Ply: 7 Zom: 14 Ent: 35 (286) Items: 2 CO: 13 RSS: 5149.9MB
2020-08-02T23:11:37 17783.222 INF Entity zombieSteve 94937 killed by Eliaz 41597
2020-08-02T23:11:37 17783.222 INF [CSMM_Patrons]entityKilled: Eliaz (76561198350754370) killed zombie zombieSteve
2020-08-02T23:11:40 17786.231 INF Entity zombieNurse 94935 killed
2020-08-02T23:11:54 17799.516 INF [DECO] written 0
2020-08-02T23:11:59 17804.964 WRN [EAC] Log: [EAC Server]  [Warning] [23:11:59][Linux][EAC Server] [Warn][Cerberus] [Backend] [Think] Reconnection not allowed yet, reconnection interval is 120 seconds.
2020-08-02T23:12:06 17812.222 INF Time: 296.36m FPS: 36.53 Heap: 3219.1MB Max: 3791.1MB Chunks: 4333 CGO: 203 Ply: 7 Zom: 14 Ent: 34 (304) Items: 8 CO: 14 RSS: 5133.5MB
Calling Animator.GotoState on Synchronize layer
 
(Filename: ./Modules/Animation/Director/AnimatorControllerPlayable.cpp Line: 1370)

Calling Animator.GotoState on Synchronize layer
 
(Filename: ./Modules/Animation/Director/AnimatorControllerPlayable.cpp Line: 1370)

Obtained 23 stack frames.
#0  0x007fd03a045355 in (Unknown)
#1  0x007fd03a02e853 in (Unknown)
#2  0x007fd0376b673e in (Unknown)
#3  0x007fd0376b67ab in (Unknown)
#4  0x007fd0376b96ab in (Unknown)
#5  0x007fd0376b9a78 in (Unknown)
#6  0x007fd0376bbd27 in (Unknown)
#7  0x007fd0376bd2d1 in (Unknown)
#8  0x0000004243e306 in (wrapper managed-to-native) System.GC:InternalCollect (int)
#9  0x00000041fe7cb0 in GameManager:Update ()
#10 0x007fd0374d9389 in (Unknown)
#11 0x007fd037645167 in (Unknown)
#12 0x007fd037646014 in (Unknown)
#13 0x00561c3a666ea4 in (Unknown)
#14 0x00561c3a662fd1 in (Unknown)
#15 0x00561c3a6422cf in (Unknown)
#16 0x00561c3a3d95da in (Unknown)
#17 0x00561c3a5438ea in (Unknown)
#18 0x00561c3a5439a8 in (Unknown)
#19 0x00561c3a546ef0 in (Unknown)
#20 0x00561c39e2ec49 in (Unknown)
#21 0x007fd03a030002 in (Unknown)
#22 0x00561c39e3e363 in (Unknown)

( complete log file : https://gist.github.com/m4tm4t/766e023406c320d8b62d8bec4a101420 )
 

2020-08-02T17:29:53 33271.388 INF Time: 554.16m FPS: 36.67 Heap: 2824.2MB Max: 3203.2MB Chunks: 3238 CGO: 85 Ply: 4 Zom: 10 Ent: 20 (201) Items: 0 CO: 9 RSS: 4692.6MB
2020-08-02T17:30:11 33290.057 WRN [EAC] Log: [EAC Server]  [Warning] [17:30:11][Linux][EAC Server] [Warn][Cerberus] [Backend] [Think] Reconnection not allowed yet, reconnection interval is 120 seconds.
2020-08-02T17:30:23 33301.389 INF Time: 554.66m FPS: 38.37 Heap: 2845.6MB Max: 3203.2MB Chunks: 3238 CGO: 91 Ply: 4 Zom: 10 Ent: 20 (201) Items: 0 CO: 9 RSS: 4690.7MB
2020-08-02T17:30:53 33331.426 INF Time: 555.16m FPS: 37.68 Heap: 2825.7MB Max: 3203.2MB Chunks: 3238 CGO: 94 Ply: 4 Zom: 10 Ent: 20 (194) Items: 0 CO: 11 RSS: 4689.2MB
Obtained 13 stack frames.
#0  0x007ff2f175b355 in gsignal
#1  0x007ff2f1744853 in abort
#2  0x007ff2eedcc73e in GC_unmap
#3  0x007ff2eedcc7ab in GC_unmap_old
#4  0x007ff2eedcf6ab in GC_finish_collection
#5  0x007ff2eedcf914 in GC_collect_a_little_inner
#6  0x007ff2eedd09e6 in GC_alloc_large
#7  0x007ff2eedd3aba in GC_generic_malloc
#8  0x007ff2eedd3c94 in GC_malloc_kind_global
#9  0x007ff2eeda6ddf in mono_gc_register_root
#10 0x007ff2eed5cf39 in mono_object_new_fast
#11 0x007ff2eed5cfa0 in mono_array_new_specific
#12 0x0000004098a5ff in (wrapper managed-to-native) object:__icall_wrapper_ves_icall_array_new_specific (intptr,int)

( complete log file : https://gist.github.com/m4tm4t/132ea5f9a1d1f333d05f5a8191ea40be )

Thank you for reading

[m4t]

Here some graphs of the system to show resources usage when the crash of the first log file I posted above happened at 4:30AM
18PM is a automated reboot
 

[meganoth]

Lots of mods installed, one of them could be the source. Create another instance of the game without mods and play that for a while to eliminate any doubt the crashes come from the mods.

 

If on the other hand the mod-less instance runs fine you will need to find the mod-combo that crashes the game.

 

 

[Beelzybub]

Try increasing the size of your swapfile. Mine was 2GB (default for Ubuntu) and after I increased it to 8GB the crashes stopped.

For your setup I'd set it to 16GB.

 

You have old A18 mods in use, for example Stallionsdens Stack Size Increaser. He recommends using Claymore's stack size

increaser instead. And your Wireless Power Box mod is very likely not compatible with A19.

 

Try reducing your MaxAllowedViewDistance from 12 to 8 or so. I doubt anyone will notice and it reduces memory and cpu use

on the server.

 

Reduce your MaxSpawnedAnimals and MaxSpawnedZombies. There's reports of bugging out when using numbers higher

than the defaults. (50 and 64).