bakdata

No more MessageSizeTooLargeException with
in : We developed a SerDe that transparently stores large messages on Amazon S3. No changes to your existing processing logic required.

Processing Large Messages with Kafka Streams Kafka Streams is a DSL that allows easy processing of stream data stored in Apache Kafka. It abstracts from the low-level producer and…

Building and querying customer profiles in real-time with

Implementing a Queryable User Profile Store using Kafka Streams In this blog post, we introduce how Kafka Streams can be used to process real time data and expose queryable user profiles.

Using the Cloud for data warehousing and BI is easy! Learn how we build and deploy data pipelines and data warehouses with Google Cloud Platform.

Data Warehousing Made Easy with Google BigQuery and Apache Airflow In this blog post, we share how we take on BI, ELT, and DWH projects using BigQuery and Apache Airflow on Google Cloud Platform (GCP).

Mocking schema registry in tests, the easy way

Transparent Schema Registry for Kafka Streams – bakdata – Medium Painlessly test Kafka Streams with Avro

Processing your data with ? Now it's easier than ever to test your topologies!

Fluent Kafka Streams Tests – bakdata – Medium A Java test DSL for Kafka Streams

Going cloud native? You can now run on

Running R on AWS Lambda – bakdata – Medium R is still one of the most popular programming languages for data scientists. However, it is fairly hard to integrate R with modern micro…

Query your topic interactively - just like a key-value store. Lightweight via a REST API.

Queryable Kafka Topics with Kafka Streams – bakdata – Medium In today’s data processing architectures, Apache Kafka is often used at the ingress stage. Usually, this step is used to enrich and filter…

Getting started with ? Read more about our first insights on our new blog.

First Insights into Using Amazon Neptune – bakdata – Medium In many real-world use cases that we as bakdata see at our customer’s sites, relevant information is hidden in the connections between…

- after lunch Alexander Albrecht will talk about how we use , and for Engineering (Saal Baden)