Skip to content

grid-stream-org/batcher

Repository files navigation

Batcher - Micro-batching Data Processing Service

The micro-batching data-processing Go service responsible for buffering incoming data from a MQTT broker, normalizing it, and writing to a destination.

🧭 Table of Contents

👥 Team

Team Member Role Title Description
Matthew Collett Technical Lead/Developer Focus on architecture design and solving complex problems, with a focus on the micro-batching process.
Cooper Dickson Project Manager/Developer Ensure that the scope and timeline are feasible and overview project status, focus on UI and real-time transmission.
Eric Cuenat Scrum Master/Developer In charge of agile methods for the team such as organizing meetings, removing blockers, and team communication, focus on UI and web socket interaction.
Sam Keays Product Owner/Developer Manager of product backlog and updating board to reflect scope changes and requirements, focus on database operations and schema design.

⛑️ Contributing

For guidlines and instructions on contributing, please refer to CONTRIBUTING.md

🚀 Local Run

Prerequisites

  • Ensure you have go installed

Steps

  1. First, start by cloning this repository to your local machine
git clone https://github.com/grid-stream-org/batcher.git
  1. Navigate to the project directory
cd batcher
  1. Populate configs/config.json with valid config to run the batcher
  2. Install the project dependencies
make download
  1. Run the batcher
make run

About

Repository for the micro-batching data processing service

Resources

License

Contributing

Stars

Watchers

Forks

Packages

No packages published

Contributors 3

  •  
  •  
  •