Skip to content

[se-5392] Setup OpenSearch and Fluent-Bit dashboards

Keith Grootboom requested to merge keith/se_5392_setup_opensearch_dashboards into main

Description

This PR sets up OpenSearch and Fluent-Bit integration for Grove.

By default all logs generated by Kubernetes containers will be forwarded to Fluent-Bit and can be viewed from the OpenSearch dashboard.

For now, the OpenSearch dashboard isn't exposed to the internet due to the complexity of achieving it. This will be tackled in a different ticket (SE-5432).

Supporting information

Testing instructions

  • Run the terraform scripts.
  • Forward the port for the OpenSearch dashboard: ./kubectl --namespace monitoring port-forward --address 0.0.0.0 deployments/opensearch-dashboard-opensearch-dashboards 8001:5601
  • You can then access the dashboards from http://localhost:8001 and login with admin:admin
  • Visit http://localhost:8001/app/discover and add an Index Pattern for fluent-bit.
  • The logs will start streaming in (you might need to navigate back to the Discover page to see them).

Screenshot_2022-04-13_at_13-17-05_Discover_-_OpenSearch_Dashboards

Edited by Keith Grootboom

Merge request reports