Centralized monitoring

we inspire + we innovate + we enable

The primary objective of this project is to continuously monitor international datahub instances across regions such as the UAE, United States, and China through a centralized monitoring system. This is achieved using Prometheus for metrics collection and Grafana for visualization and alerting. In addition, the project involves comprehensive log aggregation and analysis of system and application components, including Docker containers and systemd services, to ensure reliability, performance optimization, and proactive issue detection across all deployed environments.

THE CHALLENGE

  • Monitoring various datahubs has been challenging due to each datahub being monitored separately.
  • Building a centralised monitoring tool for streamlining the process of monitoring various databubs is difficult.
  • After centralized monitoring, visualization is another challenge, which complicates the oversight of datahubs.

THE SOLUTION

  • Created a centralized monitoring server based on Prometheus and Grafana which connects US, UAE, China, EU datahubs​.
  • Grafana dashboards which provides real-time health of the datahubs​.

THE VALUE

  • Able to do real-time checks and alerts on datahubs​.
  • Centralized configuring and monitoring of various datahubs.
  • Software being completely under the control of company and no outside dependency (platform, security, data, applications).

ARCHITECTURE

This project monitors international datahub instances using Prometheus and Grafana, and analyze system and application logs for evaluation.

LET'S GET IN TOUCH

Praneeth Subudhi


Community Lead, Custom Solutions Development
praneeth.subudhi[at]lpdg.io

"Business needs evolve, software engineering follows. Great software is iterative, fast, scalable, and customized. At LPDG, that’s exactly what we deliver."

Linkedin