# OSO - The Kafka experts

> OSO is a UK-based software consultancy specialising in Apache Kafka, real-time data streaming, and cloud infrastructure. We help enterprises design, deploy, and operate production Kafka platforms — from migration and architecture through to 24/7 managed support.

> OSO works with organisations including Formula 1 racing teams, Lloyds Banking Group, the UK Department for Education, Cambridge University Press, and Scania. Our services span Kafka architecture design, managed Kafka operations, Confluent and AWS MSK deployments, Kubernetes-based infrastructure, and open-source developer tooling. We are Confluent partners and AWS Advanced Consulting Partners.


## Pages

- [Fully Managed Apache Kafka Service | Enterprise Ready](https://oso.sh/fully-managed-kafka/) → [Markdown](https://oso.sh/wp-content/uploads/llms_md/page-1.md): Deploy enterprise-grade Apache Kafka on your infrastructure with full management. Eliminate operational complexity while maintaining complete control. 24/7 expert support included.
- [Download Kafka-as-a-service White Paper](https://oso.sh/download-kafka-as-a-service-white-paper/)
- [Contact the OSO team](https://oso.sh/book-a-call/)
- [Migration from Apache Kafka to Amazon MSK](https://oso.sh/technologies/apache-kafka-migration-to-amazon-msk/): Explore how OSO helps companies migrate their streaming data processing from Apache Kafka to Amazon MSK, to reduce TCO and manage clusters more efficiently.
- [All flavours of Apache Kafka Support](https://oso.sh/kafka-support/) → [Markdown](https://oso.sh/wp-content/uploads/llms_md/page-4.md): Enterprise Kafka support from the experts of Apache Kafka - Scale, optimise and secure your data platform with OSO
- [What is Apache Kafka?](https://oso.sh/technologies/kafka/) → [Markdown](https://oso.sh/wp-content/uploads/llms_md/page-3.md): Learn about Apache Kafka - a distributed streaming platform that enables companies to build scalable, fault-tolerant, and real-time data pipelines
- [The Kafka Report](https://oso.sh/newsletter/)
- [Kafka Services](https://oso.sh/kafka-services/) → [Markdown](https://oso.sh/wp-content/uploads/llms_md/page-2.md): Maximise the Value of Streaming Technologies with Our World-Leading Kafka Expert Consultants and Specialised Kafka Services
- [Confluent and OSO](https://oso.sh/technologies/confluent/): We deliver Confluent advisory and implementation services to accelerate your data platform
- [Technologies](https://oso.sh/technologies/)
- [Pedigree #2](https://oso.sh/solutions/pedigree/)
- [Dev tools](https://oso.sh/dev-tools/)
- [Solutions](https://oso.sh/solutions/): We understand different industries have different requirements when it comes to real-time data.  Different industries have different requirements when it comes to real-time data.  We build sector specific solutions that meet your specific challenges.
- [Tableau Deployment Library #2](https://oso.sh/solutions/tableau-deployment-library/)
- [About](https://oso.sh/who-we-are/): OSO help teams for building event driven applications on Kafka to enable real-time access.
- [Blog](https://oso.sh/blog/)
- [Home](https://oso.sh/) → [Markdown](https://oso.sh/wp-content/uploads/llms_md/page.md): Oso has Kafka Experts help teams build event driven applications and provides Kafka services. Enable real-time access to your data.


## Case Studies

- [How OSO helped Colliers design a real-time, event-driven CRM-to-ERP integration architecture across EMEA](https://oso.sh/case-studies/how-oso-helped-colliers-design-a-real-time-event-driven-crm-to-erp-integration-architecture-across-emea/): OSO provided Kafka architecture design, expert consultancy, and a comprehensive enterprise backup to support Colliers' most complex EMEA integration challenge.
- [OSO helps Formula 1 racing team introduce Kafka architecture for 2026](https://oso.sh/case-studies/oso-helps-formula-1-racing-team-introduce-kafka-architecture-for-2026/): Our client, a leading Formula One racing team, scaled their deployment of Apache Kafka to analyse race data and enable split-second strategic decisions.
- [Discover how enterprise event streaming accelerated STC Kuwait's digital transformation](https://oso.sh/case-studies/stc-kuwait-enterprise-event-streaming/): Explore how STC Kuwait integrated its billing and advanced analytics systems with real-time Kafka enterprise event streaming platform Confluent 6.0.
- [Explore how a Kafka health check helped Tungsten Automation manage Kafka at scale](https://oso.sh/case-studies/explore-how-kafka-health-check-helped-tungsten/): Discover how Tungsten Automation successfully managed Apache Kafka at scale with the help of a Kafka health check.
- [Discover how Kafka in app design helped Memrise launch a new feature and gamify the user experience](https://oso.sh/case-studies/how-kafka-in-app-design-helped-memrise-gamify/): With 24/7 Kafka in app design support, Memrise incorporated an agile, more resilient data architecture into its legacy system. Learn the details.
- [Find out how Kafka architecture in manufacturing transformed Scania Group's battery assembly factory in Sweden](https://oso.sh/case-studies/kafka-architecture-in-manufacturing/): Explore how Kafka architecture in manufacturing transformed Scania Group's factory systems at its new battery operations plant in Södertälje, Sweden.
- [Explore how Lloyds Banking Group designed a secure and scalable environment with Kafka 24/7 support](https://oso.sh/case-studies/how-we-helped-lloyds-banking-group-deploy-kafka-on-prem/): Production-grade Kafka platform build that helped Lloyds launch new banking products and enhance its customer experience
- [Learn how OSO’s Kafka support helped Cambridge University Press migrate to a modern digital learning system](https://oso.sh/case-studies/cambridge-university-kafka-support/): A real-time data pipeline powered by Apache Kafka and submission service helped Cambridge University Press synchronise its data between content...
- [Analyse how Kafka for building management helped Kugu migrate its legacy resources to AWS ](https://oso.sh/case-studies/kugu-kafka-for-building-management/): Kafka For Building Management. Discover how Kugu leveraged Kafka to automate its legacy resource migration to AWS. Kafka for Real Estate
- [Investigate why a Kafka proof of concept helped Dufry prove the merits of its new data architecture](https://oso.sh/case-studies/dufry-apache-kafka-proof-of-concept-poc/): An Apache Kafka proof of concept helped Dufry's Head of Data, Chief Revenue Officer, and Chief Technical Officer perform better.
- [Discover how designing the right Apache Kafka Architecture helped the Department for Education become a data-synchronous organisation](https://oso.sh/case-studies/department-for-education-kafka-architecture/): After carefully analysing its options, the DfE selected a Kafka architecture to improve its digital infrastructure and generate new value from its data
- [Explore how Apache Kafka best practices helped Marlow Navigation pursue digital transformation](https://oso.sh/case-studies/apache-kafka-best-practices-marlow/): One of OSO's Apache Kafka Best Practices. See How OSO helped Marlow's undergoing digital transformation
- [Explore how Terraform-based GitOps helped Drivvn automate Kafka](https://oso.sh/case-studies/automate-kafka-with-terraform-based-gitops/): Automating Kafka deployment with Terraform-based GitOps helped Drivvn's developers minimise errors and monitor their new technology.
- [Learn how Kafka support helped Drivvn migrate from batch to real time streaming data](https://oso.sh/case-studies/drivvn-batch-to-real-time-streaming-with-kafka/): With Kafka support, Drivvn migrated from batch to real time streaming data and adopted real-time data streaming to enhance its platform. Discover how they did it.
- [Uncover how secure deployment helped Detected’s clients avoid the $200 billion fraud problem in B2B digital commerce](https://oso.sh/case-studies/highly-secure-deployment-detected-oso/): The OSO team took a prototype and turned it into a productionised, highly secure deployment in just 10 weeks in Detected!
- [Explore how AWS support helped 33N successfully enable real-time data visualisation at the NHS](https://oso.sh/case-studies/how-33n-enabled-nhs-real-time-data-visualisation/): With careful iteration and implementation, we provided 33N with a tool that will make it easier for real-time data visualisation
- [Investigate how support services helped VAS Group complete its AWS migration journey](https://oso.sh/case-studies/vas-group-achieved-growth-with-aws-migration/): OSO helped VAS group achieve growth with AWS with AWS migration. See how VAS migrated their applications to AWS.
- [Discover how support services helped M1 Finance launch a production-ready Tableau server solution in just 12 days](https://oso.sh/case-studies/how-oso-helped-m1-to-launch-a-production-ready-tableau-server-solution-in-12-days/): M1 Finance was growing quickly and storing a lot of various datasets inside of AWS. The team wanted a tool...


## 30

- [How to Cut Your Snowflake Bill by Up to 55% with a single Open Source CLI tool](https://oso.sh/blog/open-source-snowflake-cost-optimization-tool/): chukei is an open-source Snowflake cost optimization tool that cuts your bill by up to 55% in the query path — with a signed report you can verify.
- [An Automated Tool for End-to-End MSK ZooKeeper-to-KRaft Migration](https://oso.sh/blog/automated-msk-zookeeper-to-kraft-migration/): How to automates MSK ZooKeeper-to-KRaft migration end-to-end: 11-state machine, offset map, seven-step cutover, signed evidence bundle.
- [How to Back Up Your Kafka Schema Registry (And Why Your Current Approach Probably Won't Restore)](https://oso.sh/blog/how-to-backup-kafka-schema-registry/): Step-by-step guide to backing up Apache Kafka Schema Registry - including schema IDs, references, and the wire format gotcha that breaks most restores.
- [How to Build a Well-Architected Kafka Backup Strategy: Six Pillars for Protecting Your Streaming Data](https://oso.sh/blog/kafka-backup-well-architected-framework-six-pillars/): Learn how to build a well-architected Kafka backup strategy using six pillars, ten design principles, and reference architectures for disaster recovery and PITR.
- [Why One Kafka Connector Should Replace 200: How AI Is Finally Fixing the Integration Sprawl Problem](https://oso.sh/blog/ai-kafka-connector-reduce-connect-sprawl/): One connector instead of 200. OSO's kafka-connect-ai uses AI to replace Kafka Connect sprawl with five protocol adapters. Here's why the model needed to change.
- [How to Eliminate the 5 Hidden Cost Traps in Your Kafka-to-Iceberg Pipeline](https://oso.sh/blog/how-to-reduce-kafka-to-iceberg-pipeline-costs/): Learn how to eliminate the five hidden cost traps in Kafka-to-Iceberg pipelines. Reduce cloud spend by removing connectors, duplicate data, and over-provisioned compute.
- [How to Build a Real-Time Context Engine for AI Agents Using Event Driven Architectures](https://oso.sh/blog/how-to-build-real-time-context-engine-ai-agents-apache-kafka/): Learn how to build a real-time context engine for AI agents using Apache Kafka. Architecture, governance, MCP integration, and practical implementation guide.
- [What Every Engineer Who Uses Apache Kafka Needs to Know for 2026](https://oso.sh/blog/what-every-kafka-engineer-needs-to-know-2026/): The Kafka ecosystem is shifting dramatically in 2026. OSO engineers break down what's changing, what it means for your architecture, and how to prepare.
- [Kafka Protocol Internals: How Partition Remapping Proxies Transform Messages Without Breaking Clients](https://oso.sh/blog/kafka-protocol-internals-partition-remapping-proxy/): Learn how Kafka's binary protocol enables partition remapping proxies to cut managed Kafka costs by 90% whilst remaining completely transparent to applications.
- [How to Back Up Your Kafka Cluster: A Guide to Point-in-Time Recovery](https://oso.sh/blog/how-to-back-up-kafka-cluster-point-in-time-recovery/): Learn how to back up your Kafka cluster properly with point-in-time recovery and consumer offset restoration. Discover why replication alone isn't enough.
- [Current 2025: Watching Confluent Prepare for Sale in Real Time](https://oso.sh/blog/current-summit-new-orleans-2025-review/): Current Summit New Orleans 2025: A critical look at the biggest Kafka conference. What worked, what didn't, and where data streaming is heading.
- [Why You Don't Need Apache Flink for Agentic AI (And Why Akka Is the Simpler Choice)](https://oso.sh/blog/flink-vs-akka-agentic-ai-comparison/): Apache Flink is overkill for AI agents. Learn why Akka's purpose-built framework delivers simpler, more maintainable agentic systems in production.
- [Building Multi-Region Orchestration with Apache Kafka: A Pull-Based Architecture](https://oso.sh/blog/kafka-multi-region-orchestration-architecture-pull-based-workflows/): Discover how to build scalable multi-region orchestration using Apache Kafka's pull-based architecture. Real-world patterns from production systems.
- [From Block to Object Storage: Engineering a Cost-Efficient Data Streaming Platform at Massive Scale](https://oso.sh/blog/kafka-object-storage-cost-optimization-disaggregated-architecture/): Learn how disaggregated architectures using object storage cut Kafka costs by 71%. Real-world strategies for migrating from EBS to S3 at scale.
- [Solving the Hidden Consistency Crisis in Apache Kafka CDC Pipelines: Why Your Multi-Table Transactions Are Breaking Your Data](https://oso.sh/blog/apache-kafka-cdc-transaction-consistency-debezium-guide/): Learn how transaction-aware Change Data Capture solves consistency problems in Kafka pipelines when database transactions span multiple tables.
- [How to Unify Multi-Platform Kafka Operations: A Complete Guide to Hybrid Deployment Success](https://oso.sh/blog/how-to-manage-hybrid-kafka-deployments-guide/): Learn how to unify multi-platform Kafka operations with proven strategies for hybrid deployments, monitoring consolidation, and seamless application management.
- [How to Use Kafka Streams Processor API for Complex Enterprise Applications](https://oso.sh/blog/how-to-use-kafka-streams-processor-api-for-complex-enterprise-applications/): Master Kafka Streams Processor API for enterprise applications. Learn when to move beyond DSL for complex state management and advanced streaming use cases.
- [Building a Unified Schema Registry: How to Eliminate Cross-System Compatibility Failures in Enterprise Data Architectures](https://oso.sh/blog/unified-schema-registry-cross-system-compatibility-enterprise/): Learn how unified schema registry architecture eliminates cross-system compatibility failures in enterprise data ecosystems with early validation and seamless schema evolution.
- [KIP-714 Client Metrics: How Apache Kafka Finally Solved Its Biggest Monitoring Challenge](https://oso.sh/blog/kip-714-kafka-client-metrics-centralized-monitoring-solution/): Learn how KIP-714 transforms Kafka monitoring with centralized client telemetry. Discover how to eliminate monitoring complexity and catch misconfigurations automatically.
- [Complete Guide to Building Self-Service Kafka Operations: Eliminating Manual Bottlenecks at Enterprise Scale](https://oso.sh/blog/complete-guide-self-service-kafka-operations-enterprise/): Learn how to eliminate 5-day Kafka delays with self-service automation. Complete guide to GitOps workflows, governance, and enterprise scaling.
- [7 Must-Have CLI Tools Every Apache Kafka Engineer Should Know in 2025](https://oso.sh/blog/7-must-have-cli-tools-every-apache-kafka-engineer-should-know-in-2025/): Discover 7 essential Apache Kafka CLI tools that transform operations in 2025. From kcat to topicctl, master the command-line tools every Kafka engineer needs.
- [Apache Kafka's KRaft Protocol: How to Eliminate Zookeeper and Boost Performance by 8x](https://oso.sh/blog/apache-kafkas-kraft-protocol-how-to-eliminate-zookeeper-and-boost-performance-by-8x/): Discover how Apache Kafka's KRaft protocol eliminates Zookeeper dependencies and delivers 8x performance improvements. Complete guide to KRaft architecture, migration, and real-world benefits.
- [How to Build High-Performance Kafka Streams Applications That Scale Beyond Partition Limits](https://oso.sh/blog/how-to-build-high-performance-kafka-streams-applications-that-scale-beyond-partition-limits/): Build high-performance Kafka Streams apps that scale beyond partition limits using async processing. Learn techniques that delivered 6x performance gains in production.
- [Productionise Kafka Streams State Stores: How Unbundled Architecture Transforms Kafka Streams Operations](https://oso.sh/blog/productionise-kafka-streams-state-stores-how-unbundled-architecture-transforms-kafka-streams-operations/): In the Kafka Streams ecosystem, we’ve all experienced the fundamental paradox that haunts stateful applications: the framework promises elasticity, fault...
- [How to auto scale Apache Kafka with Tiered Storage in Production](https://oso.sh/blog/how-to-auto-scale-apache-kafka-with-tiered-storage-in-production/)
- [How Kafka Consumer 4.0's New Rebalance Protocol Eliminates the Two-Phase Bottleneck](https://oso.sh/blog/kafka-consumer-4-0-new-rebalance-protocol/): Kafka Consumer 4.0 transforms rebalancing with incremental server-side processing. No more slow member bottlenecks or two-phase synchronisation delays.
- [Building Bulletproof Disaster Recovery for Apache Kafka: A Field-Tested Architecture](https://oso.sh/blog/building-bulletproof-disaster-recovery-for-apache-kafka-a-field-tested-architecture/): Master Apache Kafka disaster recovery with proven strategies from OSO engineers handling 300M+ daily transactions. Learn MirrorMaker setup, active-active patterns, and failover procedures with code examples.
- [How to run Apache Kafka across multiple Kubernetes clusters](https://oso.sh/blog/how-to-run-apache-kafka-across-multiple-kubernetes-clusters/): The Definitive Guide to Running Kafka Across Multiple Kubernetes Clusters using Strimzi for Automation, Dynamic Scaling and Failover
- [Kafka queues in Apache Kafka 4.0 via Share Groups](https://oso.sh/blog/kafka-queues-in-apache-kafka-4-0-via-share-groups/): The consequences of this design become apparent when we examine scalability. If your topic has five partitions, you can have...
- [Apache Kafka outbox pattern](https://oso.sh/blog/apache-kafka-outbox-pattern/): Implementing the outbox pattern, you need a reliable mechanism to move messages from your outbox table to Kafka.
- [Guide to ZooKeeper to KRaft migration](https://oso.sh/blog/guide-to-zookeeper-to-kraft-migration/): Successful KRaft migration begins with thorough preparation. Read these 5 steps to migrate successfully.
- [How to scale Apache Kafka in your organisation](https://oso.sh/blog/how-to-scale-apache-kafka-in-your-organisation/): How do you build capabilities across dozens of teams without creating bottlenecks or sacrificing quality
- [Multi-message types in Kafka topics: Lessons from a real-world pipeline](https://oso.sh/blog/multi-message-types-in-kafka-topics/): By challenging the standard pattern and designing a solution tailored to our domain, we created a more flexible, maintainable, and developer-friendly system.
- [How to design Kafka events and event streams](https://oso.sh/blog/how-to-design-kafka-events-and-event-streams/): Events are records of significant moments in a system and are essential to decentralised computing and modular service architectures. Effective...
- [How to secure your Apache Kafka cluster](https://oso.sh/blog/how-to-secure-your-apache-kafka-cluster/): Apache Kafka offers several methods for authenticating Kafka clients to brokers. This guide aims to showcase these methods, provide guidance...
- [Kafka Consumer Configuration Cheatsheet](https://oso.sh/blog/kafka-consumer-configuring-cheatsheet/): Configuring Apache Kafka consumers is confusing! This table helps us the remember what each parameter means.
- [Apache Kafka - Glossary](https://oso.sh/blog/apache-kafka-glossary/): Kafka terminology can be confusing! Here is everything you need to know on one page!
- [The Future of Streaming Data](https://oso.sh/blog/the-future-of-streaming-data/): As we kick off January, it’s time to share OSO’s annual trends and predictions for data streaming technology. Here are our top three predictions for 2025.
- [Apache Kafka 2024 Review](https://oso.sh/blog/apache-kafka-2024-review/): This year, OSO invested in growing the London community. We hosted nine meetups, brought together 470 new members passionate about technology and innovation, produced 19 articles and blog posts, shared insights through three podcasts, and developed 35 code repositories.
- [Confluent Certified Developer for Apache Kafka :: Study Guide](https://oso.sh/blog/confluent-certified-developer-for-apache-kafka-study-guide/): This guide will help developers understand the essential principles of Apache Kafka, and will prepare them for the CCDAK exam.
- [Serverless Tiered Storage in Apache Kafka](https://oso.sh/blog/serverless-tiered-storage-in-apache-kafka/): Apache Kafka now leverages cloud object storage to provide cost-effective and scalable storage for Kafka data.

#
# Detailed Content


## Pages

> Deploy enterprise-grade Apache Kafka on your infrastructure with full management. Eliminate operational complexity while maintaining complete control. 24/7 expert support included.

- Published: 2025-08-20
- Modified: 2026-02-26
- URL: https://oso.sh/fully-managed-kafka/

- Published: 2023-06-22
- Modified: 2023-06-22
- URL: https://oso.sh/download-kafka-as-a-service-white-paper/

> Explore how OSO helps companies migrate their streaming data processing from Apache Kafka to Amazon MSK, to reduce TCO and manage clusters more efficiently.

- Published: 2023-06-02
- Modified: 2026-02-26
- URL: https://oso.sh/technologies/apache-kafka-migration-to-amazon-msk/

> Enterprise Kafka support from the experts of Apache Kafka - Scale, optimise and secure your data platform with OSO

- Published: 2023-05-23
- Modified: 2026-02-26
- URL: https://oso.sh/kafka-support/

> Learn about Apache Kafka - a distributed streaming platform that enables companies to build scalable, fault-tolerant, and real-time data pipelines

- Published: 2023-03-23
- Modified: 2026-02-26
- URL: https://oso.sh/technologies/kafka/

> Maximise the Value of Streaming Technologies with Our World-Leading Kafka Expert Consultants and Specialised Kafka Services

- Published: 2023-01-19
- Modified: 2026-02-26
- URL: https://oso.sh/kafka-services/

> We deliver Confluent advisory and implementation services to accelerate your data platform

- Published: 2022-03-09
- Modified: 2026-02-26
- URL: https://oso.sh/technologies/confluent/

- Published: 2022-03-09
- Modified: 2026-02-26
- URL: https://oso.sh/technologies/

- Published: 2021-09-16
- Modified: 2021-09-16
- URL: https://oso.sh/solutions/pedigree/

- Published: 2021-09-15
- Modified: 2024-05-18
- URL: https://oso.sh/dev-tools/

> We understand different industries have different requirements when it comes to real-time data. Different industries have different requirements when it comes to real-time data. We build sector specific solutions that meet your specific challenges.

- Published: 2021-09-15
- Modified: 2026-02-26
- URL: https://oso.sh/solutions/

- Published: 2021-09-15
- Modified: 2021-09-15
- URL: https://oso.sh/solutions/tableau-deployment-library/

> OSO help teams for building event driven applications on Kafka to enable real-time access.

- Published: 2021-09-15
- Modified: 2026-02-26
- URL: https://oso.sh/who-we-are/

> Oso has Kafka Experts help teams build event driven applications and provides Kafka services. Enable real-time access to your data.

- Published: 2021-08-26
- Modified: 2026-04-08
- URL: https://oso.sh/



## Case Studies

- Published: 2026-02-18
- Modified: 2026-02-26
- URL: https://oso.sh/case-studies/how-oso-helped-colliers-design-a-real-time-event-driven-crm-to-erp-integration-architecture-across-emea/
OSO provided Kafka architecture design, expert consultancy, and a comprehensive enterprise backup to support Colliers' most complex EMEA integration challenge.


> Our client, a leading Formula One racing team, scaled their deployment of Apache Kafka to analyse race data and enable split-second strategic decisions.

- Published: 2025-02-10
- Modified: 2026-02-26
- URL: https://oso.sh/case-studies/oso-helps-formula-1-racing-team-introduce-kafka-architecture-for-2026/
In a sport where every millisecond counts, OSO helped our F1 client scale Kafka architecture to stream competitive data from their cars on the racetrack.


> Explore how Kafka architecture in manufacturing transformed Scania Group's factory systems at its new battery operations plant in Södertälje, Sweden.

- Published: 2024-06-30
- Modified: 2024-07-10
- URL: https://oso.sh/case-studies/kafka-architecture-in-manufacturing/
Explore how Kafka architecture in manufacturing transformed Scania Group's factory systems at its new battery operations plant in Södertälje, Sweden.


> Production-grade Kafka platform build that helped Lloyds launch new banking products and enhance its customer experience

- Published: 2023-11-14
- Modified: 2026-02-26
- URL: https://oso.sh/case-studies/how-we-helped-lloyds-banking-group-deploy-kafka-on-prem/
When Lloyds Banking Group needed to set up an on-premise Kafka cluster, Kafka Support helped the bank fill its gaps in expertise and build a platform aligned with its high standards for security, availability, and service.


- Published: 2023-08-30
- Modified: 2026-02-26
- URL: https://oso.sh/case-studies/cambridge-university-kafka-support/
A real-time data pipeline powered by Apache Kafka and submission service helped Cambridge University Press synchronise its data between content management systems and offer a smoother user experience to students.


> An Apache Kafka proof of concept helped Dufry's Head of Data, Chief Revenue Officer, and Chief Technical Officer perform better.

- Published: 2023-05-25
- Modified: 2024-07-10
- URL: https://oso.sh/case-studies/dufry-apache-kafka-proof-of-concept-poc/
A Kafka proof of concept helped Dufry’s Head of Data, Chief Revenue Officer, and Chief Technical Officer perform their due diligence on the adoption of a Kafka architecture.


> After carefully analysing its options, the DfE selected a Kafka architecture to improve its digital infrastructure and generate new value from its data

- Published: 2023-03-16
- Modified: 2026-02-26
- URL: https://oso.sh/case-studies/department-for-education-kafka-architecture/
After carefully analysing its options, the DfE selected a Kafka architecture to improve its digital infrastructure and generate new value from its data


> One of OSO's Apache Kafka Best Practices. See How OSO helped Marlow's undergoing digital transformation

- Published: 2023-02-07
- Modified: 2024-07-10
- URL: https://oso.sh/case-studies/apache-kafka-best-practices-marlow/
How OSO assessed Kafka best practices with a Kafka Health Check




## 30

> chukei is an open-source Snowflake cost optimization tool that cuts your bill by up to 55% in the query path — with a signed report you can verify.

- Published: 2026-06-19
- Modified: 2026-06-19
- URL: https://oso.sh/blog/open-source-snowflake-cost-optimization-tool/

> How to automates MSK ZooKeeper-to-KRaft migration end-to-end: 11-state machine, offset map, seven-step cutover, signed evidence bundle.

- Published: 2026-05-07
- Modified: 2026-05-08
- URL: https://oso.sh/blog/automated-msk-zookeeper-to-kraft-migration/

> Step-by-step guide to backing up Apache Kafka Schema Registry - including schema IDs, references, and the wire format gotcha that breaks most restores.

- Published: 2026-04-07
- Modified: 2026-04-07
- URL: https://oso.sh/blog/how-to-backup-kafka-schema-registry/

> Learn how to build a well-architected Kafka backup strategy using six pillars, ten design principles, and reference architectures for disaster recovery and PITR.

- Published: 2026-03-27
- Modified: 2026-03-27
- URL: https://oso.sh/blog/kafka-backup-well-architected-framework-six-pillars/

> One connector instead of 200. OSO's kafka-connect-ai uses AI to replace Kafka Connect sprawl with five protocol adapters. Here's why the model needed to change.

- Published: 2026-03-20
- Modified: 2026-03-20
- URL: https://oso.sh/blog/ai-kafka-connector-reduce-connect-sprawl/

> Learn how to eliminate the five hidden cost traps in Kafka-to-Iceberg pipelines. Reduce cloud spend by removing connectors, duplicate data, and over-provisioned compute.

- Published: 2026-02-26
- Modified: 2026-02-26
- URL: https://oso.sh/blog/how-to-reduce-kafka-to-iceberg-pipeline-costs/
Learn how to eliminate the five hidden cost traps in Kafka-to-Iceberg pipelines. Reduce cloud spend by removing connectors, duplicate data, and over-provisioned compute.


> Learn how to build a real-time context engine for AI agents using Apache Kafka. Architecture, governance, MCP integration, and practical implementation guide.

- Published: 2026-02-09
- Modified: 2026-02-09
- URL: https://oso.sh/blog/how-to-build-real-time-context-engine-ai-agents-apache-kafka/

> The Kafka ecosystem is shifting dramatically in 2026. OSO engineers break down what's changing, what it means for your architecture, and how to prepare.

- Published: 2026-01-09
- Modified: 2026-01-09
- URL: https://oso.sh/blog/what-every-kafka-engineer-needs-to-know-2026/

> Learn how Kafka's binary protocol enables partition remapping proxies to cut managed Kafka costs by 90% whilst remaining completely transparent to applications.

- Published: 2025-12-19
- Modified: 2025-12-19
- URL: https://oso.sh/blog/kafka-protocol-internals-partition-remapping-proxy/

> Learn how to back up your Kafka cluster properly with point-in-time recovery and consumer offset restoration. Discover why replication alone isn't enough.

- Published: 2025-12-09
- Modified: 2025-12-12
- URL: https://oso.sh/blog/how-to-back-up-kafka-cluster-point-in-time-recovery/

> Current Summit New Orleans 2025: A critical look at the biggest Kafka conference. What worked, what didn't, and where data streaming is heading.

- Published: 2025-11-13
- Modified: 2025-11-13
- URL: https://oso.sh/blog/current-summit-new-orleans-2025-review/

> Apache Flink is overkill for AI agents. Learn why Akka's purpose-built framework delivers simpler, more maintainable agentic systems in production.

- Published: 2025-10-18
- Modified: 2025-10-20
- URL: https://oso.sh/blog/flink-vs-akka-agentic-ai-comparison/

> Discover how to build scalable multi-region orchestration using Apache Kafka's pull-based architecture. Real-world patterns from production systems.

- Published: 2025-10-16
- Modified: 2025-10-24
- URL: https://oso.sh/blog/kafka-multi-region-orchestration-architecture-pull-based-workflows/

> Learn how disaggregated architectures using object storage cut Kafka costs by 71%. Real-world strategies for migrating from EBS to S3 at scale.

- Published: 2025-10-03
- Modified: 2025-10-03
- URL: https://oso.sh/blog/kafka-object-storage-cost-optimization-disaggregated-architecture/

> Learn how transaction-aware Change Data Capture solves consistency problems in Kafka pipelines when database transactions span multiple tables.

- Published: 2025-09-24
- Modified: 2025-09-24
- URL: https://oso.sh/blog/apache-kafka-cdc-transaction-consistency-debezium-guide/

> Learn how to unify multi-platform Kafka operations with proven strategies for hybrid deployments, monitoring consolidation, and seamless application management.

- Published: 2025-09-10
- Modified: 2025-10-15
- URL: https://oso.sh/blog/how-to-manage-hybrid-kafka-deployments-guide/

> Master Kafka Streams Processor API for enterprise applications. Learn when to move beyond DSL for complex state management and advanced streaming use cases.

- Published: 2025-09-03
- Modified: 2025-10-15
- URL: https://oso.sh/blog/how-to-use-kafka-streams-processor-api-for-complex-enterprise-applications/

> Learn how unified schema registry architecture eliminates cross-system compatibility failures in enterprise data ecosystems with early validation and seamless schema evolution.

- Published: 2025-09-01
- Modified: 2025-09-01
- URL: https://oso.sh/blog/unified-schema-registry-cross-system-compatibility-enterprise/

> Learn how KIP-714 transforms Kafka monitoring with centralized client telemetry. Discover how to eliminate monitoring complexity and catch misconfigurations automatically.

- Published: 2025-08-28
- Modified: 2025-08-28
- URL: https://oso.sh/blog/kip-714-kafka-client-metrics-centralized-monitoring-solution/

> Learn how to eliminate 5-day Kafka delays with self-service automation. Complete guide to GitOps workflows, governance, and enterprise scaling.

- Published: 2025-08-21
- Modified: 2025-08-21
- URL: https://oso.sh/blog/complete-guide-self-service-kafka-operations-enterprise/

> Discover 7 essential Apache Kafka CLI tools that transform operations in 2025. From kcat to topicctl, master the command-line tools every Kafka engineer needs.

- Published: 2025-08-07
- Modified: 2025-08-07
- URL: https://oso.sh/blog/7-must-have-cli-tools-every-apache-kafka-engineer-should-know-in-2025/

> Discover how Apache Kafka's KRaft protocol eliminates Zookeeper dependencies and delivers 8x performance improvements. Complete guide to KRaft architecture, migration, and real-world benefits.

- Published: 2025-07-29
- Modified: 2025-07-29
- URL: https://oso.sh/blog/apache-kafkas-kraft-protocol-how-to-eliminate-zookeeper-and-boost-performance-by-8x/

> Build high-performance Kafka Streams apps that scale beyond partition limits using async processing. Learn techniques that delivered 6x performance gains in production.

- Published: 2025-07-19
- Modified: 2025-07-19
- URL: https://oso.sh/blog/how-to-build-high-performance-kafka-streams-applications-that-scale-beyond-partition-limits/

- Published: 2025-07-06
- Modified: 2025-07-06
- URL: https://oso.sh/blog/productionise-kafka-streams-state-stores-how-unbundled-architecture-transforms-kafka-streams-operations/

> Kafka Consumer 4.0 transforms rebalancing with incremental server-side processing. No more slow member bottlenecks or two-phase synchronisation delays.

- Published: 2025-06-13
- Modified: 2025-06-21
- URL: https://oso.sh/blog/kafka-consumer-4-0-new-rebalance-protocol/

> Master Apache Kafka disaster recovery with proven strategies from OSO engineers handling 300M+ daily transactions. Learn MirrorMaker setup, active-active patterns, and failover procedures with code examples.

- Published: 2025-05-14
- Modified: 2025-06-13
- URL: https://oso.sh/blog/building-bulletproof-disaster-recovery-for-apache-kafka-a-field-tested-architecture/

- Published: 2025-04-30
- Modified: 2025-04-30
- URL: https://oso.sh/blog/kafka-queues-in-apache-kafka-4-0-via-share-groups/

> Implementing the outbox pattern, you need a reliable mechanism to move messages from your outbox table to Kafka.

- Published: 2025-04-29
- Modified: 2025-04-29
- URL: https://oso.sh/blog/apache-kafka-outbox-pattern/

> Successful KRaft migration begins with thorough preparation. Read these 5 steps to migrate successfully.

- Published: 2025-04-27
- Modified: 2025-04-28
- URL: https://oso.sh/blog/guide-to-zookeeper-to-kraft-migration/

> By challenging the standard pattern and designing a solution tailored to our domain, we created a more flexible, maintainable, and developer-friendly system.

- Published: 2025-04-25
- Modified: 2025-04-25
- URL: https://oso.sh/blog/multi-message-types-in-kafka-topics/

- Published: 2025-01-21
- Modified: 2025-04-25
- URL: https://oso.sh/blog/how-to-design-kafka-events-and-event-streams/

- Published: 2025-01-17
- Modified: 2025-04-25
- URL: https://oso.sh/blog/how-to-secure-your-apache-kafka-cluster/
Apache Kafka offers several methods for authenticating Kafka clients to brokers. This guide aims to showcase these methods, provide guidance on enabling and configuring authentication options, and assist in determining the most suitable approach for your specific use case.


> Configuring Apache Kafka consumers is confusing! This table helps us the remember what each parameter means.

- Published: 2025-01-16
- Modified: 2025-01-16
- URL: https://oso.sh/blog/kafka-consumer-configuring-cheatsheet/

> Kafka terminology can be confusing! Here is everything you need to know on one page!

- Published: 2025-01-16
- Modified: 2025-01-16
- URL: https://oso.sh/blog/apache-kafka-glossary/

> As we kick off January, it’s time to share OSO’s annual trends and predictions for data streaming technology. Here are our top three predictions for 2025.

- Published: 2025-01-02
- Modified: 2025-01-05
- URL: https://oso.sh/blog/the-future-of-streaming-data/

> This year, OSO invested in growing the London community. We hosted nine meetups, brought together 470 new members passionate about technology and innovation, produced 19 articles and blog posts, shared insights through three podcasts, and developed 35 code repositories.

- Published: 2024-12-18
- Modified: 2024-12-28
- URL: https://oso.sh/blog/apache-kafka-2024-review/

> This guide will help developers understand the essential principles of Apache Kafka, and will prepare them for the CCDAK exam.

- Published: 2024-11-12
- Modified: 2024-11-15
- URL: https://oso.sh/blog/confluent-certified-developer-for-apache-kafka-study-guide/

> Apache Kafka now leverages cloud object storage to provide cost-effective and scalable storage for Kafka data.

- Published: 2024-11-04
- Modified: 2024-11-04
- URL: https://oso.sh/blog/serverless-tiered-storage-in-apache-kafka/

> How to build streaming architecture using Kafka to feed model training

- Published: 2024-10-31
- Modified: 2024-10-31
- URL: https://oso.sh/blog/machine-learning-with-apache-kafka/

> A Kafka cluster is a group of broker nodes working together to provide, scalability, availability, and fault tolerance.

- Published: 2024-10-24
- Modified: 2024-10-24
- URL: https://oso.sh/blog/what-are-the-key-concepts-of-apache-kafka/

> Learn which configuration values to chance on the Producer API to achieve high performance on your Apache Kafka producers

- Published: 2024-06-27
- Modified: 2024-06-28
- URL: https://oso.sh/blog/kafka-producer-best-practices/


> For enquiries, visit https://oso.sh/contact/ or email enquiries@oso.sh