ELK
ELK Stack: Real-time machine data analysis tool
Logstash:To combine multiple data sources and parse unstructured or semi-structured to structured data.
Elasticsearch: A search engine which index the data to provide simple, powerful and flexible search functionality.
Kibana: Front-end customizable visualization tool provides real-time analysis of search results.
Logstash
Logs will be input from a file
Log format being defined in Grok. Apart from
standard log format like apache logs, user can write
his own definition of log formats
Output can be sent to elasticsearch and other
multiple interfaces.
An Example of Logstash
Unstructured logs getting parsed into searchable fields.
ELK Search results
Kibana Dashboard