We chose this name as we beleive it reflects the essence of our capstone project with ArkXJobInTech and DXC.
NiFiPulse is a lightweight on-prem monitoring and alerting solution for Apache NiFi clusters.
It continuously tracks system and pipeline health: CPU, RAM, disk usage, file I/O, NiFi pipeline metrics, and more, then triggers alerts when thresholds are exceeded.
- 📊 Metrics Collection – Gather CPU, RAM, file system, and NiFi flow stats. nifi_flows
- 🧩 NiFi Integration – Connects directly with NiFi APIs to pull processor and queue metrics.
⚠️ Alerting Engine – Send email, Slack, or webhook alerts based on user-defined thresholds. Alerting- 🧠 Custom Dashboards – Visualize health trends and performance over time. grafana
- 🛠️ On-Prem Ready – Designed for environments without external cloud dependencies. Docker
- 🔐 Secure Configuration – Credentials and endpoints are managed via
.envfiles.
Nifi Registery config
-docker exec -it nifi /bin/bash + ls -l /opt/nifi/nifi-current/data/outgoing to list simulated data files from NiFi.
- docker set-up for Nifi and Prometheus
- Prometheus job configuration file
- Grafana dashboards configuration
- Grafana datasource configuration
- run
git clone https://github.com/DXC-DP-Monitoring/NiFiPulse.giton your local machine, on your preferred folder.
- run
git branchto make sure you are on main , if not rungit checkout main - run
git pull origin main, this will fetche updates from the remote repo (origin) and merges them into your localmainbranch - To keep the history linear:
git fetch origin+git rebase origin\main(no merge)
This project is licensed under the Apache License 2.0. See the LICENSE file for the full license text.
Copyright (c) 2025 Amina BOUHAMRA, Fadwa EL AMRAOUI, Nawar TOUMI, Soukaina BOUCETTA