ElasticSearch Logstash Kibana

Requirements Overview

Collectd

• Collectd – The system statistics collection daemon.
• collectd gathers statistics about the system it is running on and stores this information.
• Those statistics can then be used to find current performance bottlenecks (i.e. performance analysis) and predict future system load (i.e. capacity planning)

Elastic{Search}

• Elasticsearch is a search server based on Lucene.
• It provides a distributed, multitenant-capable full-text search engine with a RESTful web interface and schema-free JSON documents.

Logstash

• Logstash is a tool for managing events and logs.
• You can use it to collect logs, parse them, and store them for later use (like, for searching).
• If you store them in Elasticsearch, you can view and analyze them with Kibana.

Kibana

• Kibana is an open source data visualization plugin for Elasticsearch.
• It provides visualization capabilities on top of the content indexed on an Elasticsearch cluster.
• Users can create bar, line and scatter plots, or pie charts and maps on top of large volumes of data.

Install Software

1. Install Collectd
2. Install ElasticSearch
3. Install Logstash
4. Install Kibana

Configure Software

1. Configure Collectd
2. Configure ElasticSearch
3. Configure Logstash
4. Configure Kibana

Monitor System with Collectd/ELK Stack

1. Monitor System with Collectd/ELK Stack

Import Squid3 Logs on ELK Stack

1. Import Squid3 Logs on ELK Stack

Import Fail2Ban Logs on ELK Stack

1. Import Fail2Ban Logs on ELK Stack

Import NGINX/WordPress/EasyEngine Logs on ELK Stack

1. Import NGINX/WordPress/EasyEngine Logs on ELK Stack

Newsletter

Get updated when I create new content.
Unsubscribe whenever. Never any spam.