A collection of examples to demonstrate how to interact with Redpanda from various clients and languages. Redpanda is Kafka API compatible. Any client that works with Kafka will work, but we have tested the ones listed here.
There are a growing number of client examples. Submit any new and/or interesting examples with a pull request!
Client | Description |
---|---|
Go | Produce and Consume using franz-go and sarama |
Javascript | Produce events, upload schemas to registry |
Python | Produce and Consume events, and use the schema registry |
The Ebooks folder contains a Java app built with Quarkus, which is a popular Java framework that uses Redpanda to power its Kafka dev service (see this article for more details). The Ebooks app implements a consumer which validates payments.
The spark app shows how to read and write to Redpanda with Spark streaming. A producer writes stock activity, then a streaming app reads this data from a topic and sends it into a Spark SQL DataFrame. Spark then modifies the events before writing to another topic. A consumer app then reads these modified events. More details here.
The wasm app shows how to create a JavaScript-based module that compiles to WebAssembly, and uses an Avro schema to serialize JSON events. More details here.
Below is a sample of some of our partner integrations.
Deephaven is an open-core query engine for building apps and analytics with real-time streams and batch data.
The demo follows closely the one defined for Materialize. We want to showcase how you can accomplish the same workflow in Deephaven, with Deephaven's query engine and Redpanda's streaming capabilities.
Need to monitor your local machine in real time? This example publishes your docker stats
to Redpanda. Written in Python, this is an out-of-the box solution to see when your Docker containers over-use their resources. See full example here: deephaven-examples/redpanda-docker-stats.
Want to monitor updating stock market data? Or see how to publish multiple topics to Redpanda? This example creates tables to see stocks from dxFeed. See full example here: deephaven-examples/redpanda-dxfeed-financial-data.