A professional-grade centralized logging and monitoring system built using the ELK Stack (Elasticsearch, Logstash, Kibana). This project demonstrates an automated infrastructure for aggregating, analyzing, and visualizing logs from multiple application servers in real-time.

The infrastructure is orchestrated using Docker Swarm across distributed EC2 instances, with automated resource provisioning via CloudFormation. It features a robust data pipeline where Filebeat shippers forward logs to a centralized Logstash ingestion service, which then processes and indexes the data into Elasticsearch for powerful searching and Kibana dashboarding.

Infrastructure Components

• • Elasticsearch: Distributed search and analytics engine for log data
• • Logstash: Data processing pipeline for ingesting logs from multiple sources
• • Kibana: Visualization platform for creating real-time dashboards
• • Filebeat: Lightweight shipper for forwarding logs from edge servers
• • Docker Swarm & CloudFormation: Scalable orchestration and automated IaC

• Sourcehttps://github.com/thoai112/elkstack
• PlatformAWS (EC2), Docker Swarm, Linux
• StackELK Stack, CloudFormation, Docker, Shell Scripting