Skip to content

Import logs in Elasticsearch

Jose Javier Merchante requested to merge jjmerchante/deployment:logs-elastic-v into master

DESCRIPTION

  • This MR import logs from syslog-ng to Elasticsearch.

  • To test this, you can browse Cauldron to generate some logs and query Elasticsearch. With the default configuration:

    docker exec elastic_service curl -k https://admin:test-password@localhost:9200/nginx-syslog/_search | json_pp

  • From Kibana you can access that index only from admin. You will need to create an index pattern in order to see data.

ISSUES RELATED

VERSIONS

DB_IMAGE_NAME: "cauldronio/database:0.1.1"
WEB_IMAGE_NAME: "cauldronio/webserver:0.2.8"
WORKER_IMAGE_NAME: "cauldronio/worker:0.1.12"
ODFE_CONFIG_IMAGE_NAME: "cauldronio/odfe-config:0.1.11"
ELASTIC_IMAGE_NAME: "amazon/opendistro-for-elasticsearch:1.6.0"
KIBANA_IMAGE_NAME: "amazon/opendistro-for-elasticsearch-kibana:1.6.0"
SYSLOG_IMAGE_NAME: "cauldronio/syslog-ng:0.3"
MATOMO_IMAGE_NAME: "matomo:3"
  • I created syslog-ng:0.3 for this MR

REPOSITORIES CHANGED

  • Deployment: -
  • Web: master
  • Worker: master
Edited by Jose Javier Merchante

Merge request reports