Malcolm is a powerful, easily deployable network traffic analysis tool suite for full packet capture artifacts (PCAP files), Zeek logs and Suricata alerts.

Malcolm is a powerful, easily deployable network traffic analysis tool suite for full packet capture artifacts (PCAP files), Zeek logs and Suricata alerts.

This repository contains a microservice-based Sample App demonstrating observability capabilities in the Amazon OpenSearch Service.

Malcolm is a powerful, easily deployable network traffic analysis tool suite for full packet capture artifacts (PCAP files), Zeek logs and Suricata alerts.

A comprehensive, production-ready logging pipeline using Docker Compose, integrating syslog-ng, Filebeat, Logstash, OpenSearch, and OpenSearch Dashboards.

OpenSearch AgentOps: OpenTelemetry-native agent observability

Scan and index directories or neofinder-exports in OpenSearch

A comprehensive, production-ready logging pipeline using Docker Compose, integrating syslog-ng, Filebeat, Logstash, OpenSearch, and OpenSearch Dashboards.

TuneInsights is a streaming data pipeline that uses Apache Kafka to collect and process data from Spotify API. The project aims to provide real-time insights and analytics on Spotify Playback data using Opensearch Dashboard to help users analyze and understand trends, patterns, and user behavior on Spotify platform.

This project involves extracting and uploading a large dataset of incident reports from the City of New York's open data portal to an Elasticsearch instance (AWS) for further analysis and visualization using OpenSearch Dashboards

End-to-end data pipeline: PostgreSQL CDC (Debezium) → Kafka → Flink SQL → OpenSearch (search) + Redis (features). Local Docker stack, sample data, and verification scripts.

🍔 Build a production-grade data pipeline for food delivery, enabling real-time insights and features through PostgreSQL, Kafka, and Flink.

The project includes instructions on how to set up and configure the pipeline, as well as sample code and configuration files that can be used as a starting point. It also includes a sample dashboard built on OpenSearch Dashboard that showcases the potential of the pipeline for data analysis and visualization.

This is the project for my Distributed Systems' university course. It focuses on the visualization of a large number of geolocalized tweets.