Skip to content

HydrAIDE - The Adaptive, Intelligent Data Engine, built in Go. Production-ready and optimized for real-time, large-scale data operations.

License

Notifications You must be signed in to change notification settings

chrxmvtik/hydraide

Β 
Β 

Repository files navigation

HydrAIDE – Adaptive Intelligent Data Engine

HydrAIDE - The Adaptive, Intelligent Data Engine

License Version Status Speed Go Join Discord

🧠 What is HydrAIDE?

HydrAIDE is a real-time data engine that unifies multiple critical layers into one.

With HydrAIDE, you no longer need to run a separate database, cache, pub/sub system, or worry about cleaning up stale data.
It’s a purpose-built engine that replaces traditional architecture with clean, reactive, and developer-native logic.


βš™οΈ What HydrAIDE Does – In One Stack

Feature Description
πŸ—‚οΈ Database Engine A NoSQL-like, structure-first data store β€” no schemas, no query language. Just save your Go structs.
πŸ”„ Built-in Reactivity Native real-time subscriptions on every write/update/delete. Like Redis Pub/Sub, but smarter.
πŸ“‘ Subscriber Logic Built-in event-awareness for all data. Like Firebase listeners β€” but deterministic and controlled.
🧠 Memory-Efficient Swamps live in memory only when accessed. Instant hydration, automatic disposal when idle.
✍️ No More Queries No SELECT, no WHERE. Your struct is the query.
πŸ›°οΈ Pure gRPC Control Fully gRPC-native. Works with or without SDKs. Ideal for CLI tools, edge services, and IoT nodes.
🧹 Zero Garbage No daemons. No cron jobs. No cleanup scripts. Swamps manage themselves via lifecycle logic.
🌐 Effortless Scaling Deterministic folder-based distribution. No orchestrators. Just spawn instances where needed.
πŸ”’ Concurrency-Safe Per-object locking with deadlock-free critical sections. Easy and safe for business rules.
πŸ’΅ Cost-Efficient Minimal RAM usage. No cache layers. Fewer components = fewer servers.
πŸ” Search Optimized Great for search engines and ML pipelines β€” but not limited to them. Perfect for dashboards and reactive apps.
🀯 Less Infra Headache No need to combine Redis + Kafka + Mongo + scheduler. HydrAIDE is the backend stack itself.

πŸ’‘ Proven in the Real World

HydrAIDE already powers platforms like Trendizz.com, indexing millions of websites and billions of structured relationships, with real-time search across hundreds of millions of words in under 1 seconds, without preloading.

In production for over 2 years.
Replaces Redis, MongoDB, Kafka, cron jobs, and their glue code.


πŸš€ Demo Applications

Explore ready-to-run demo applications built in Go to better understand the HydrAIDE Go SDK and its unique data modeling approach.

All demo apps are located in the example-applications/go folder.

More demos coming soon: reactive dashboards, pub-sub listeners, real-time config editors...

πŸ“¦ Available Demos

  • Queue – A simple task queue system that manages scheduled jobs with future expireAt timestamps.

πŸ‘‰ View Queue Demo Application

These examples are a great starting point to learn how to:

  • Structure your HydrAIDE-powered services
  • Use profile and catalog models
  • Handle real-time, reactive data flows efficiently

βœ… Primary SDK: Go

HydrAIDE is written in Go β€” and hydraidego is the official SDK powering production at scale.

  • Supports everything: save/read, locking, subscriptions, TTLs, indexes – all native
  • Zero boilerplate: just write structs, and it just works
  • Fast, typed, reactive – built to feel like part of Go itself

🧠 Designed for real-time systems.
πŸ”₯ Used in live infrastructure today.
πŸ“š Comes with full docs, examples, and patterns.


πŸ€– ChatGPT Support: Learn & Build with HydrAIDE Faster

The HydrAIDE documentation is purposefully structured to make it fully compatible with LLM-based assistants like ChatGPT β€” so you can focus on building instead of spending hours reading.

⚠️ HydrAIDE was not created using ChatGPT or any LLM. It is the result of years of real-world engineering experience. However, we believe in leveraging AI tools wherever they can accelerate your work β€” especially when learning new architectures or building production-grade systems.

βœ… Turn ChatGPT into your personal HydrAIDE expert

To do that, simply create a ChatGPT project, and upload the following files:

File Type Path
Installation Guide how-to-install-hydraide.md
LLM-Friendly Q&A Set hydraide-questions-answers-for-llm.md
Go SDK Documentation go-sdk.md
Go Example Models All .go files from models
Go SDK Core Logic hydraidego.go

Once uploaded, ChatGPT will be able to:

  • answer any question about HydrAIDE’s architecture or APIs,
  • help you write HydrAIDE-style Go code interactively,
  • explain example models, functions, and patterns,
  • and guide you through debugging, architecture design, or optimization steps.

πŸ’‘ The documentation is written to be semantically consumable by AI, which means ChatGPT will understand not just APIs, but the design philosophy, naming logic, and intent behind each HydrAIDE feature.

A prebuilt ChatGPT is also available for the HydrAIDE Knowledge Engine. You can use it via the ChatGPT store or directly through this link: https://chatgpt.com/g/g-688779751c988191b975beaf7f68801d-hydraide-knowledge-engine Feel free to ask it anything! If it can’t answer your question, open an issue, or build your own custom GPT project with enhanced responses, as we described above.


πŸ“š Start Here: The HydrAIDE Documentation

To truly understand HydrAIDE, start with its core philosophy and architecture:

πŸ‘‰ Thinking in HydrAIDE – The Philosophy of Reactive Data
Learn how HydrAIDE redefines structure, access, and system design from the ground up.

Then continue the 9-step journey:

Step Section Description
1️⃣ πŸ“ Naming Convention Learn how data structure begins with naming. Not schemas.
2️⃣ 🌿 Swamp Pattern Configure persistence, memory, and lifespan directly from code.
3️⃣ πŸ’Ž Treasures Understand the smallest, most powerful unit of data.
4️⃣ 🧩 Indexing Discover ephemeral, in-memory indexing that feels like magic.
5️⃣ πŸ”„ Subscriptions Build reactive systems natively with HydrAIDE’s event engine.
6️⃣ πŸ” Locking Achieve true concurrency without fear.
7️⃣ 🧹 Clean System Never think about cleanup again, because HydrAIDE already did.
8️⃣ 🧬 Migration Struct Evolution Without Fear
9️⃣ 🌐 Distributed Architecture Scale horizontally without orchestration pain.
πŸ”Ÿ πŸš€ Install & Update Deploy HydrAIDE in minutes, not days.

πŸš€ Quick Start – Install & Update HydrAIDE

HydrAIDE runs in a single Docker container. No database setup, No daemons, No surprises.

To get started:

  1. Generate a valid TLS certificate (required for secure gRPC).
  2. Create three folders for your data, certs, and settings.
  3. Use the provided docker-compose.yml file and run:
docker-compose up -d

πŸ‘‰ Full Installation Guide β†’


πŸ’» SDKs - Native Integration in Your Language

HydrAIDE communicates over gRPC, and all SDKs share a common .proto contract, ensuring cross-language consistency.


πŸ› οΈ Community SDKs - Looking for Contributors!

We're building native SDKs for more languages, and we're looking for contributors, early adopters, and curious minds to help shape them.

If you'd like to help bring HydrAIDE to your ecosystem, open an issue or PR, or just come chat with us on Discord!

πŸ’» Language SDK Name Status Goal
🐍 Python hydraidepy 🐣 In development ML-ready struct integration & event flows
🟑 Node.js hydraidejs πŸ§ͺ In planning Event-friendly reactive API
πŸ¦€ Rust hydraiders 🧠 In design Zero-cost memory-safe abstractions
β˜• Java hydraidejv 🧠 In design Enterprise-grade, service-oriented usage
🎯 C# / .NET hydraidecs 🧠 In design Async/await-friendly service layer
🧠 C++ hydraidecpp 🧠 In design High-performance native integration
πŸŒ€ Kotlin hydraidekt 🧠 In design Android & backend client SDK
🍎 Swift hydraidesw 🧠 In design Index-aware mobile app logic for iOS/macOS

✨ Want to build with us?
Contribute on GitHub or join the HydrAIDE Discord.


πŸ“Š Comparisons - HydrAIDE vs Other Systems

Want to see how HydrAIDE compares to the most popular databases and engines?
We’re building a full series of deep comparisons, mindset-first, not config-first.

πŸ” Comparison πŸ“„ Status Link
HydrAIDE vs MongoDB βœ… Complete Read HydrAIDE vs MongoDB Comparison
HydrAIDE vs Redis βœ… Complete Read HydrAIDE vs Redis Comparison
HydrAIDE vs PostgreSQL πŸ”œ In progress coming soon
HydrAIDE vs MySQL πŸ”œ In progress coming soon
HydrAIDE vs SQLite πŸ”œ In progress coming soon
HydrAIDE vs Elasticsearch πŸ”œ In progress coming soon
HydrAIDE vs Firebase / Firestore πŸ”œ In progress coming soon
HydrAIDE vs DynamoDB πŸ”œ In progress coming soon
HydrAIDE vs Cassandra πŸ”œ In progress coming soon
HydrAIDE vs InfluxDB πŸ”œ In progress coming soon
HydrAIDE vs ClickHouse πŸ”œ In progress coming soon
HydrAIDE vs Neo4j πŸ”œ In progress coming soon
HydrAIDE vs TimescaleDB πŸ”œ In progress coming soon
HydrAIDE vs Apache Kafka πŸ”œ In progress coming soon (stream vs native pub-sub)

πŸ™Œ Want to Contribute?

Start by reading the Contributor Introduction, it explains why HydrAIDE exists, what kind of people we’re looking for, and how you can join. Then check out our Contribution Guide, it walks you through the practical steps.

Once you're ready, open your first issue or pull request. We’ll be waiting! πŸš€


πŸ“© Contact & Enterprise

HydrAIDE is used in production at Trendizz.com. Interested in enterprise licensing, SDK development, or embedding HydrAIDE in your own platform?

πŸ“§ Peter Gebri – peter.gebri@trendizz.com (Founder of HydrAIDE & Trendizz) 🌐 Website – https://HydrAIDE.io Currently in progress and directly linked to GitHub.

Join the movement. Build different.

About

HydrAIDE - The Adaptive, Intelligent Data Engine, built in Go. Production-ready and optimized for real-time, large-scale data operations.

Resources

License

Contributing

Security policy

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Go 92.2%
  • Python 6.8%
  • Other 1.0%