Starting Elasticsearch 6.4.2 Changing ownership of /data folder [2018-10-24T17:31:55,838][INFO ][o.e.n.Node ] [es-master-5858d4896f-6wxvd] initializing ... [2018-10-24T17:31:56,513][INFO ][o.e.e.NodeEnvironment ] [es-master-5858d4896f-6wxvd] using [1] data paths, mounts [[/data (/dev/sda1)]], net usable_space [90.3gb], net total_space [94.2gb], types [ext4] [2018-10-24T17:31:56,518][INFO ][o.e.e.NodeEnvironment ] [es-master-5858d4896f-6wxvd] heap size [247.6mb], compressed ordinary object pointers [true] [2018-10-24T17:31:56,520][INFO ][o.e.n.Node ] [es-master-5858d4896f-6wxvd] node name [es-master-5858d4896f-6wxvd], node ID [qZdbB5uIQJOa9aLUfOJ85Q] [2018-10-24T17:31:56,521][INFO ][o.e.n.Node ] [es-master-5858d4896f-6wxvd] version[6.4.2], pid[1], build[default/tar/04711c2/2018-09-26T13:34:09.098244Z], OS[Linux/4.14.56+/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/1.8.0_171/25.171-b11] [2018-10-24T17:31:56,521][INFO ][o.e.n.Node ] [es-master-5858d4896f-6wxvd] JVM arguments [-XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+DisableExplicitGC, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -Djdk.io.permissionsUseCanonicalPath=true, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j.skipJansi=true, -XX:+HeapDumpOnOutOfMemoryError, -Xms256m, -Xmx256m, -Des.path.home=/elasticsearch, -Des.path.conf=/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=tar] [2018-10-24T17:32:13,436][INFO ][c.f.s.SearchGuardPlugin ] ES Config path is /elasticsearch/config [2018-10-24T17:32:13,934][INFO ][c.f.s.s.DefaultSearchGuardKeyStore] OpenSSL not available (this is not an error, we simply fallback to built-in JDK SSL) because of java.lang.ClassNotFoundException: io.netty.internal.tcnative.SSL [2018-10-24T17:32:14,028][INFO ][c.f.s.s.DefaultSearchGuardKeyStore] Config directory is /elasticsearch/config/, from there the key- and truststore files are resolved relatively [2018-10-24T17:32:15,023][INFO ][c.f.s.s.DefaultSearchGuardKeyStore] TLS Transport Client Provider : JDK [2018-10-24T17:32:15,024][INFO ][c.f.s.s.DefaultSearchGuardKeyStore] TLS Transport Server Provider : JDK [2018-10-24T17:32:15,024][INFO ][c.f.s.s.DefaultSearchGuardKeyStore] TLS HTTP Provider : JDK [2018-10-24T17:32:15,025][INFO ][c.f.s.s.DefaultSearchGuardKeyStore] Enabled TLS protocols for transport layer : [TLSv1.1, TLSv1.2] [2018-10-24T17:32:15,028][INFO ][c.f.s.s.DefaultSearchGuardKeyStore] Enabled TLS protocols for HTTP layer : [TLSv1.1, TLSv1.2] [2018-10-24T17:32:17,615][INFO ][c.f.s.SearchGuardPlugin ] Clustername: streaming-utilization-qual [2018-10-24T17:32:18,055][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [aggs-matrix-stats] [2018-10-24T17:32:18,065][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [analysis-common] [2018-10-24T17:32:18,065][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [ingest-common] [2018-10-24T17:32:18,065][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [lang-expression] [2018-10-24T17:32:18,065][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [lang-mustache] [2018-10-24T17:32:18,065][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [lang-painless] [2018-10-24T17:32:18,066][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [mapper-extras] [2018-10-24T17:32:18,066][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [parent-join] [2018-10-24T17:32:18,066][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [percolator] [2018-10-24T17:32:18,069][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [rank-eval] [2018-10-24T17:32:18,070][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [reindex] [2018-10-24T17:32:18,116][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [repository-url] [2018-10-24T17:32:18,117][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [transport-netty4] [2018-10-24T17:32:18,117][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [tribe] [2018-10-24T17:32:18,117][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [x-pack-core] [2018-10-24T17:32:18,117][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [x-pack-deprecation] [2018-10-24T17:32:18,117][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [x-pack-graph] [2018-10-24T17:32:18,118][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [x-pack-logstash] [2018-10-24T17:32:18,118][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [x-pack-monitoring] [2018-10-24T17:32:18,118][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [x-pack-rollup] [2018-10-24T17:32:18,118][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [x-pack-security] [2018-10-24T17:32:18,118][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [x-pack-sql] [2018-10-24T17:32:18,118][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [x-pack-upgrade] [2018-10-24T17:32:18,118][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded module [x-pack-watcher] [2018-10-24T17:32:18,119][INFO ][o.e.p.PluginsService ] [es-master-5858d4896f-6wxvd] loaded plugin [search-guard-6] [2018-10-24T17:32:37,635][WARN ][o.e.d.s.ScriptModule ] Script: returning default values for missing document values is deprecated. Set system property '-Des.scripting.exception_for_missing_value=true' to make behaviour compatible with future major versions. [2018-10-24T17:32:42,313][WARN ][o.e.d.c.s.Settings ] [http.enabled] setting was deprecated in Elasticsearch and will be removed in a future release! See the breaking changes documentation for the next major version. [2018-10-24T17:32:56,141][INFO ][c.f.s.a.i.AuditLogImpl ] Configured categories on rest layer to ignore: [AUTHENTICATED, GRANTED_PRIVILEGES] [2018-10-24T17:32:56,214][INFO ][c.f.s.a.i.AuditLogImpl ] Configured categories on transport layer to ignore: [AUTHENTICATED, GRANTED_PRIVILEGES] [2018-10-24T17:32:56,214][INFO ][c.f.s.a.i.AuditLogImpl ] Configured Users to ignore: [kibanaserver] [2018-10-24T17:32:56,215][INFO ][c.f.s.a.i.AuditLogImpl ] Configured Users to ignore for read compliance events: [kibanaserver] [2018-10-24T17:32:56,215][INFO ][c.f.s.a.i.AuditLogImpl ] Configured Users to ignore for write compliance events: [kibanaserver] [2018-10-24T17:32:56,235][INFO ][c.f.s.a.i.AuditLogImpl ] Message routing enabled: true [2018-10-24T17:32:56,315][WARN ][c.f.s.c.ComplianceConfig ] If you plan to use field masking pls configure searchguard.compliance.salt to be a random string of 16 chars length identical on all nodes [2018-10-24T17:32:56,320][INFO ][c.f.s.c.ComplianceConfig ] PII configuration [auditLogPattern=org.joda.time.format.DateTimeFormatter@7a7f9d45, auditLogIndex=null]: {} [2018-10-24T17:32:59,821][INFO ][o.e.d.DiscoveryModule ] [es-master-5858d4896f-6wxvd] using discovery type [zen] [2018-10-24T17:33:05,339][INFO ][o.e.n.Node ] [es-master-5858d4896f-6wxvd] initialized [2018-10-24T17:33:05,340][INFO ][o.e.n.Node ] [es-master-5858d4896f-6wxvd] starting ... [2018-10-24T17:33:06,629][INFO ][o.e.t.TransportService ] [es-master-5858d4896f-6wxvd] publish_address {10.16.4.14:9300}, bound_addresses {10.16.4.14:9300} [2018-10-24T17:33:06,816][INFO ][o.e.b.BootstrapChecks ] [es-master-5858d4896f-6wxvd] bound or publishing to a non-loopback address, enforcing bootstrap checks [2018-10-24T17:33:07,019][INFO ][c.f.s.c.IndexBaseConfigurationRepository] Check if searchguard index exists ... [2018-10-24T17:33:08,615][INFO ][o.e.m.j.JvmGcMonitorService] [es-master-5858d4896f-6wxvd] [gc][3] overhead, spent [299ms] collecting in the last [1s] [2018-10-24T17:33:13,741][INFO ][o.e.c.s.ClusterApplierService] [es-master-5858d4896f-6wxvd] detected_master {es-master-5858d4896f-6mdws}{g3RBbFECRAOOnJSFrop56A}{Y4eM8EM9ROGz56TLJA3U7w}{10.16.3.18}{10.16.3.18:9300}{xpack.installed=true}, added {{es-master-5858d4896f-6mdws}{g3RBbFECRAOOnJSFrop56A}{Y4eM8EM9ROGz56TLJA3U7w}{10.16.3.18}{10.16.3.18:9300}{xpack.installed=true},}, reason: apply cluster state (from master [master {es-master-5858d4896f-6mdws}{g3RBbFECRAOOnJSFrop56A}{Y4eM8EM9ROGz56TLJA3U7w}{10.16.3.18}{10.16.3.18:9300}{xpack.installed=true} committed version [1]]) [2018-10-24T17:33:13,827][INFO ][o.e.n.Node ] [es-master-5858d4896f-6wxvd] started [2018-10-24T17:33:15,075][INFO ][c.f.s.c.IndexBaseConfigurationRepository] searchguard index does not exist yet, so we create a default config [2018-10-24T17:33:15,080][INFO ][c.f.s.c.IndexBaseConfigurationRepository] Will create searchguard index so we can apply default config [2018-10-24T17:33:17,621][INFO ][o.e.x.m.e.l.LocalExporter] waiting for elected master node [{es-master-5858d4896f-6mdws}{g3RBbFECRAOOnJSFrop56A}{Y4eM8EM9ROGz56TLJA3U7w}{10.16.3.18}{10.16.3.18:9300}{xpack.installed=true}] to setup local exporter [default_local] (does it have x-pack installed?) [2018-10-24T17:33:17,821][INFO ][o.e.x.m.e.l.LocalExporter] waiting for elected master node [{es-master-5858d4896f-6mdws}{g3RBbFECRAOOnJSFrop56A}{Y4eM8EM9ROGz56TLJA3U7w}{10.16.3.18}{10.16.3.18:9300}{xpack.installed=true}] to setup local exporter [default_local] (does it have x-pack installed?) [2018-10-24T17:33:18,021][INFO ][o.e.x.m.e.l.LocalExporter] waiting for elected master node [{es-master-5858d4896f-6mdws}{g3RBbFECRAOOnJSFrop56A}{Y4eM8EM9ROGz56TLJA3U7w}{10.16.3.18}{10.16.3.18:9300}{xpack.installed=true}] to setup local exporter [default_local] (does it have x-pack installed?) [2018-10-24T17:33:18,316][INFO ][o.e.x.m.e.l.LocalExporter] waiting for elected master node [{es-master-5858d4896f-6mdws}{g3RBbFECRAOOnJSFrop56A}{Y4eM8EM9ROGz56TLJA3U7w}{10.16.3.18}{10.16.3.18:9300}{xpack.installed=true}] to setup local exporter [default_local] (does it have x-pack installed?) [2018-10-24T17:33:18,538][INFO ][o.e.x.m.e.l.LocalExporter] waiting for elected master node [{es-master-5858d4896f-6mdws}{g3RBbFECRAOOnJSFrop56A}{Y4eM8EM9ROGz56TLJA3U7w}{10.16.3.18}{10.16.3.18:9300}{xpack.installed=true}] to setup local exporter [default_local] (does it have x-pack installed?) [2018-10-24T17:33:18,788][INFO ][o.e.x.m.e.l.LocalExporter] waiting for elected master node [{es-master-5858d4896f-6mdws}{g3RBbFECRAOOnJSFrop56A}{Y4eM8EM9ROGz56TLJA3U7w}{10.16.3.18}{10.16.3.18:9300}{xpack.installed=true}] to setup local exporter [default_local] (does it have x-pack installed?) [2018-10-24T17:33:19,226][INFO ][o.e.x.m.e.l.LocalExporter] waiting for elected master node [{es-master-5858d4896f-6mdws}{g3RBbFECRAOOnJSFrop56A}{Y4eM8EM9ROGz56TLJA3U7w}{10.16.3.18}{10.16.3.18:9300}{xpack.installed=true}] to setup local exporter [default_local] (does it have x-pack installed?) [2018-10-24T17:33:19,422][INFO ][o.e.x.m.e.l.LocalExporter] waiting for elected master node [{es-master-5858d4896f-6mdws}{g3RBbFECRAOOnJSFrop56A}{Y4eM8EM9ROGz56TLJA3U7w}{10.16.3.18}{10.16.3.18:9300}{xpack.installed=true}] to setup local exporter [default_local] (does it have x-pack installed?) [2018-10-24T17:33:20,013][INFO ][o.e.x.m.e.l.LocalExporter] waiting for elected master node [{es-master-5858d4896f-6mdws}{g3RBbFECRAOOnJSFrop56A}{Y4eM8EM9ROGz56TLJA3U7w}{10.16.3.18}{10.16.3.18:9300}{xpack.installed=true}] to setup local exporter [default_local] (does it have x-pack installed?) [2018-10-24T17:33:20,913][INFO ][o.e.l.LicenseService ] [es-master-5858d4896f-6wxvd] license [bdb8590f-bb71-4a32-b531-5b3eb6a1fe46] mode [basic] - valid [2018-10-24T17:33:20,923][INFO ][o.e.x.m.e.l.LocalExporter] waiting for elected master node [{es-master-5858d4896f-6mdws}{g3RBbFECRAOOnJSFrop56A}{Y4eM8EM9ROGz56TLJA3U7w}{10.16.3.18}{10.16.3.18:9300}{xpack.installed=true}] to setup local exporter [default_local] (does it have x-pack installed?) [2018-10-24T17:33:21,829][INFO ][o.e.x.m.e.l.LocalExporter] waiting for elected master node [{es-master-5858d4896f-6mdws}{g3RBbFECRAOOnJSFrop56A}{Y4eM8EM9ROGz56TLJA3U7w}{10.16.3.18}{10.16.3.18:9300}{xpack.installed=true}] to setup local exporter [default_local] (does it have x-pack installed?) [2018-10-24T17:33:38,618][INFO ][o.e.c.s.ClusterApplierService] [es-master-5858d4896f-6wxvd] added {{es-client-7d46689dff-wnbpj}{JuQ6Yu2oTES8q943-HZlbw}{hpNd88yuSeupDQA_VQhm1A}{10.16.7.17}{10.16.7.17:9300}{xpack.installed=true},}, reason: apply cluster state (from master [master {es-master-5858d4896f-6mdws}{g3RBbFECRAOOnJSFrop56A}{Y4eM8EM9ROGz56TLJA3U7w}{10.16.3.18}{10.16.3.18:9300}{xpack.installed=true} committed version [15]]) [2018-10-24T17:33:45,660][INFO ][o.e.c.s.ClusterApplierService] [es-master-5858d4896f-6wxvd] added {{es-data-0}{fGgREP6cS3yylPDDG-7NNQ}{8_ZsHfppRXWJWTTy6zHDnw}{10.16.2.15}{10.16.2.15:9300}{xpack.installed=true},}, reason: apply cluster state (from master [master {es-master-5858d4896f-6mdws}{g3RBbFECRAOOnJSFrop56A}{Y4eM8EM9ROGz56TLJA3U7w}{10.16.3.18}{10.16.3.18:9300}{xpack.installed=true} committed version [16]]) [2018-10-24T17:33:48,404][INFO ][c.f.s.s.ConfigHelper ] Will update 'config' with /elasticsearch/plugins/search-guard-6/sgconfig/sg_config.yml [2018-10-24T17:33:49,179][INFO ][c.f.s.s.ConfigHelper ] Will update 'roles' with /elasticsearch/plugins/search-guard-6/sgconfig/sg_roles.yml [2018-10-24T17:33:49,499][INFO ][c.f.s.s.ConfigHelper ] Will update 'rolesmapping' with /elasticsearch/plugins/search-guard-6/sgconfig/sg_roles_mapping.yml [2018-10-24T17:33:49,713][INFO ][c.f.s.s.ConfigHelper ] Will update 'internalusers' with /elasticsearch/plugins/search-guard-6/sgconfig/sg_internal_users.yml [2018-10-24T17:33:50,015][INFO ][c.f.s.s.ConfigHelper ] Will update 'actiongroups' with /elasticsearch/plugins/search-guard-6/sgconfig/sg_action_groups.yml [2018-10-24T17:33:50,313][INFO ][c.f.s.c.IndexBaseConfigurationRepository] Default config applied [2018-10-24T17:33:50,841][INFO ][c.f.s.c.ComplianceConfig ] Compliance features are enabled [2018-10-24T17:33:50,848][INFO ][c.f.s.c.IndexBaseConfigurationRepository] Search Guard License Info: SearchGuardLicense [uid=00000000-0000-0000-0000-000000000000, type=TRIAL, features=[COMPLIANCE], issueDate=2018-10-24, expiryDate=2018-12-24, issuedTo=The world, issuer=floragunn GmbH, startDate=2018-10-24, majorVersion=6, clusterName=*, allowedNodeCount=2147483647, msgs=[], expiresInDays=60, isExpired=false, valid=true, action=, prodUsage=Yes, one cluster with all commercial features and unlimited nodes per cluster., clusterService=org.elasticsearch.cluster.service.ClusterService@7ddc152, getMsgs()=[], getExpiresInDays()=60, isExpired()=false, isValid()=true, getAction()=, getProdUsage()=Yes, one cluster with all commercial features and unlimited nodes per cluster.] [2018-10-24T17:33:50,849][INFO ][c.f.s.c.IndexBaseConfigurationRepository] Search Guard License Type: TRIAL, valid [2018-10-24T17:33:50,849][INFO ][c.f.s.c.IndexBaseConfigurationRepository] Node 'es-master-5858d4896f-6wxvd' initialized [2018-10-24T17:34:18,816][INFO ][o.e.c.s.ClusterApplierService] [es-master-5858d4896f-6wxvd] added {{es-data-1}{w80EMEo2Swac2gin8Np7aw}{0YE7vVAVQT-3AP5AAiLHXw}{10.16.1.16}{10.16.1.16:9300}{xpack.installed=true},}, reason: apply cluster state (from master [master {es-master-5858d4896f-6mdws}{g3RBbFECRAOOnJSFrop56A}{Y4eM8EM9ROGz56TLJA3U7w}{10.16.3.18}{10.16.3.18:9300}{xpack.installed=true} committed version [24]]) [2018-10-24T17:37:24,319][INFO ][c.f.s.c.ComplianceConfig ] Compliance features are enabled [2018-10-24T17:37:24,321][INFO ][c.f.s.c.IndexBaseConfigurationRepository] Search Guard License Info: SearchGuardLicense [uid=00000000-0000-0000-0000-000000000000, type=TRIAL, features=[COMPLIANCE], issueDate=2018-10-24, expiryDate=2018-12-24, issuedTo=The world, issuer=floragunn GmbH, startDate=2018-10-24, majorVersion=6, clusterName=*, allowedNodeCount=2147483647, msgs=[], expiresInDays=60, isExpired=false, valid=true, action=, prodUsage=Yes, one cluster with all commercial features and unlimited nodes per cluster., clusterService=org.elasticsearch.cluster.service.ClusterService@7ddc152, getMsgs()=[], getExpiresInDays()=60, isExpired()=false, isValid()=true, getAction()=, getProdUsage()=Yes, one cluster with all commercial features and unlimited nodes per cluster.] [2018-10-24T17:37:24,325][INFO ][c.f.s.c.IndexBaseConfigurationRepository] Search Guard License Type: TRIAL, valid