Hi,
we’re coming from 7.2 with SG, which worked fine, and have tried for a few days to deploy 7.6 with SG without success.
We’re using Kibana 7.6 and ES 7.6 with their respective SG versions in slightly modified Dockfile.
Increasing memory like this does not help:
ENV NODE_OPTIONS=“–max-old-space-size=8192”
We also checked in the container to make sure the env variable was set, and it indeed was.
The VM has 8 vCPU and 16GB RAM, so that should be more than enough.
If needed I can share the whole setup privately, but it is really very barebone ES + Kibana + SG with minimal settings related to certificates and such.
Any help is very much appreciated!
kibana | {"type":"log","@timestamp":"2020-04-24T11:38:01Z","tags":["info","optimize"],"pid":6,"message":"Optimizing and caching bundles for core, graph, monitoring, space_selector, ml, dashboardViewer, apm, maps, canvas, infra, siem, uptime, lens, searchguard-login, searchguard-customerror, searchguard-configuration, searchguard-multitenancy, searchguard-accountinfo, searchguard-signals, kibana, stateSessionStorageRedirect, status_page and timelion. This may take a few minutes"}
kibana | FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory
kibana | 1: 0x8fa090 node::Abort() [/usr/share/kibana/bin/../node/bin/node]
kibana | 2: 0x8fa0dc [/usr/share/kibana/bin/../node/bin/node]
kibana |
kibana | <--- Last few GCs --->
kibana |
kibana | [6:0x2b1e110] 73743 ms: Scavenge 1344.6 (1422.1) -> 1343.8 (1422.6) MB, 2.1 / 0.0 ms (average mu = 0.205, current mu = 0.152) allocation failure
kibana | [6:0x2b1e110] 73750 ms: Scavenge 1344.7 (1422.6) -> 1343.9 (1423.1) MB, 2.2 / 0.0 ms (average mu = 0.205, current mu = 0.152) allocation failure
kibana | [6:0x2b1e110] 73756 ms: Scavenge 1344.8 (1423.1) -> 1344.0 (1423.6) MB, 2.4 / 0.0 ms (average mu = 0.205, current mu = 0.152) allocation failure
kibana |
kibana |
kibana | <--- JS stacktrace --->
kibana |
kibana | ==== JS stack trace =========================================
kibana |
kibana | 0: ExitFrame [pc: 0x18a842c5be1d]
kibana | Security context: 0x34a12719e6e9 <JSObject>
kibana | 1: 0x37e2a5f07a31 <Symbol: Symbol.split>(aka [Symbol.split]) [0x34a127189641](this=0x1376f3c15471 <JSRegExp <String[5]: \r?\n>>,0x1376f3c153c9 <String[17]: _defineProperties>,0x37e2a5f026f1 <undefined>)
kibana | 2: split [0x34a1271906c9](this=0x1376f3c153c9 <String[17]: _defineProperties>,0x1376f3c15471 <JSRegExp <String[5]: \r?\n>>)
kibana | 3: w(aka w) [0x7499b8...
kibana |
kibana | 3: 0xb0052e v8::Utils::ReportOOMFailure(v8::internal::Isolate*, char const*, bool) [/usr/share/kibana/bin/../node/bin/node]
kibana | 4: 0xb00764 v8::internal::V8::FatalProcessOutOfMemory(v8::internal::Isolate*, char const*, bool) [/usr/share/kibana/bin/../node/bin/node]
kibana | 5: 0xef4c72 [/usr/share/kibana/bin/../node/bin/node]
kibana | 6: 0xef4d78 v8::internal::Heap::CheckIneffectiveMarkCompact(unsigned long, double) [/usr/share/kibana/bin/../node/bin/node]
kibana | 7: 0xf00e52 v8::internal::Heap::PerformGarbageCollection(v8::internal::GarbageCollector, v8::GCCallbackFlags) [/usr/share/kibana/bin/../node/bin/node]
kibana | 8: 0xf01784 v8::internal::Heap::CollectGarbage(v8::internal::AllocationSpace, v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [/usr/share/kibana/bin/../node/bin/node]
kibana | 9: 0xf043f1 v8::internal::Heap::AllocateRawWithRetryOrFail(int, v8::internal::AllocationSpace, v8::internal::AllocationAlignment) [/usr/share/kibana/bin/../node/bin/node]
kibana | 10: 0xecd4e6 v8::internal::Factory::AllocateRawArray(int, v8::internal::PretenureFlag) [/usr/share/kibana/bin/../node/bin/node]
kibana | 11: 0xecdd6a v8::internal::Factory::NewFixedArrayWithFiller(v8::internal::Heap::RootListIndex, int, v8::internal::Object*, v8::internal::PretenureFlag) [/usr/share/kibana/bin/../node/bin/node]
kibana | 12: 0xece2f7 v8::internal::Factory::NewFixedArrayWithHoles(int, v8::internal::PretenureFlag) [/usr/share/kibana/bin/../node/bin/node]
kibana | 13: 0x11a78ab v8::internal::Runtime_RegExpSplit(int, v8::internal::Object**, v8::internal::Isolate*) [/usr/share/kibana/bin/../node/bin/node]
kibana | 14: 0x18a842c5be1d