What is Elasticsearch?
Elasticsearch is a search platform that ensures reliable and secure search along with data visualization and analysis. Written in Java and built on Apache Lucene, it has simple REST API, is scalable, fast, resilient, and agile. Elasticsearch is the prime component of Elastic Stack, commonly known as ELK Stack, which has Elasticsearch, Logstash, and Kibana with Beats, a lightweight shipping agent that sends data to Elasticsearch. Elasticsearch provides a unified view of data - metric data, APM data, log data, etc. that will be saved as JSON Document.
Logstash/Beats
- An open-source, server-side data processing pipeline aggregates and processes data from different machines and sends it to Elasticsearch
- FileBeat can monitor log files, parse them and import into Elasticsearch in near real-time
Note: HCL Commerce V9.1 will use NiFi to ship data into elasticsearch
Kibana
- Web UI tool for searching and data visualization, providing real-time graphs, charts, and maps and assisting with log analysis
- Also included is Canvas an advanced application that allows users to create custom dynamic infographics based on their data