Kafka Summit London 2019 Session Videos
Let us cut to the chase: Kafka Summit London session videos are available! If you were there, you know what a great time it was, and you know that you had to make sometimes-agonizing decisions about...
View Article17 Ways to Mess Up Self-Managed Schema Registry
Part 1 of this blog series by Gwen Shapira explained the benefits of schemas, contracts between services, and compatibility checking for schema evolution. In particular, using Confluent Schema Registry...
View ArticleDeploying Kafka Streams and KSQL with Gradle – Part 2: Managing KSQL...
In part 1, we discussed an event streaming architecture that we implemented for a customer using Apache Kafka®, KSQL from Confluent, and Kafka Streams. Now in part 2, we’ll discuss the challenges we...
View ArticleSpring for Apache Kafka Deep Dive – Part 3: Apache Kafka and Spring Cloud...
Following part 1 and part 2 of the Spring for Apache Kafka Deep Dive blog series, here in part 3 we will discuss another project from the Spring team: Spring Cloud Data Flow, which focuses on enabling...
View ArticleReliable, Fast Access to On-Chain Data Insights
At TokenAnalyst, we are building the core infrastructure to integrate, clean, and analyze blockchain data. Data on a blockchain is also known as on-chain data. We offer both historical and low-latency...
View ArticleSpring for Apache Kafka Deep Dive – Part 4: Continuous Delivery of Event...
For event streaming application developers, it is important to continuously update the streaming pipeline based on the need for changes in the individual applications in the pipeline. It is also...
View ArticleHow to Connect KSQL to Confluent Cloud using Kubernetes with Helm
Confluent Cloud, a fully managed event cloud-native streaming service that extends the value of Apache Kafka®, is simple, resilient, secure, and performant, allowing you to focus on what is...
View ArticleStreaming Data from the Universe with Apache Kafka
You might think that data collection in astronomy consists of a lone astronomer pointing a telescope at a single object in a static sky. While that may be true in some cases (I collected the data for...
View ArticleBuilding a Scalable Search Architecture
Software projects of all sizes and complexities have a common challenge: building a scalable solution for search. Who has never seen an application use RDBMS SQL statements to run searches? You might...
View ArticleWhat’s New in Apache Kafka 2.3
It’s official: Apache Kafka® 2.3 has been released! Here is a selection of some of the most interesting and important features we added in the new release. Core Kafka KIP-351 and KIP-427: Improved...
View ArticleMicroservices, Apache Kafka, and Domain-Driven Design
Microservices have a symbiotic relationship with domain-driven design (DDD)—a design approach where the business domain is carefully modeled in software and evolved over time, independently of the...
View ArticleDesigning the .NET API for Apache Kafka
Confluent’s clients for Apache Kafka® recently passed a major milestone—the release of version 1.0. This has been a long time in the making. Magnus Edenhill first started developing librdkafka about...
View ArticleKafka Listeners – Explained
This question comes up on Stack Overflow and such places a lot, so here’s something to try and help. tl;dr: You need to set advertised.listeners (or KAFKA_ADVERTISED_LISTENERS if you’re using Docker...
View ArticleKSQL in Football: FIFA Women’s World Cup Data Analysis
One of the football (as per European terminology) highlights of the summer is the FIFA Women’s World Cup. France, Brazil, and the USA are the favourites, and this year Italy is present at the event for...
View ArticleDeploying Kafka Streams and KSQL with Gradle – Part 3: KSQL User-Defined...
Building off part 1 where we discussed an event streaming architecture that we implemented for a customer using Apache Kafka, KSQL, and Kafka Streams, and part 2 where we discussed how Gradle helped us...
View ArticleKSQL Training for Hands-On Learning
I’ve been using KSQL from Confluent since its first developer preview in 2017. Reading, writing, and transforming data in Apache Kafka® using KSQL is an effective way to rapidly deliver event streaming...
View ArticleBust the Burglars – Machine Learning with TensorFlow and Apache Kafka
Have you ever realized that, according to the latest FBI report, more than 80% of all crimes are property crimes, such as burglaries? And that the FBI clearance figures indicate that only 13% of all...
View ArticleGetting started with the MongoDB Connector for Apache Kafka and MongoDB
Together, MongoDB and Apache Kafka® make up the heart of many modern data architectures today. Integrating Kafka with external systems like MongoDB is best done though the use of Kafka Connect. This...
View ArticleWhy I Can’t Wait for Kafka Summit San Francisco
The Kafka Summit Program Committee recently published the schedule for the San Francisco event, and there’s quite a bit to look forward to. For starters, it is a two-day event, which means we get to...
View ArticleFault Tolerance in Distributed Systems: Tracing with Apache Kafka and Jaeger
Using Jaeger tracing, I’ve been able to answer an important question that nearly every Apache Kafka® project that I’ve worked on posed: how is data flowing through my distributed system? Quick...
View Article