Getting Started with Rust and Apache Kafka
I’ve written an event sourcing bank simulation in Clojure (a lisp build for Java virtual machines or JVMs) called open-bank-mark, which you are welcome to read about in my previous blog post explaining...
View Article4 Steps to Creating Apache Kafka Connectors with the Kafka Connect API
If you’ve worked with the Apache Kafka® and Confluent ecosystem before, chances are you’ve used a Kafka Connect connector to stream data into Kafka or stream data out of it. While there is an...
View Article🚂 On Track with Apache Kafka – Building a Streaming ETL Solution with Rail Data
Trains are an excellent source of streaming data—their movements around the network are an unbounded series of events. Using this data, Apache Kafka® and Confluent Platform can provide the foundations...
View ArticleInternet of Things (IoT) and Event Streaming at Scale with Apache Kafka and MQTT
The Internet of Things (IoT) is getting more and more traction as valuable use cases come to light. A key challenge, however, is integrating devices and machines to process the data in real time and at...
View ArticleKafka Summit San Francisco 2019 Session Videos
Last week, the Kafka Summit hosted nearly 2,000 people from 40 different countries and 595 companies—the largest Summit yet. By the numbers, we got to enjoy four keynote speakers, 56 sessions, 75...
View ArticleBuilding a Real-Time, Event-Driven Stock Platform at Euronext
As the head of global customer marketing at Confluent, I tell people I have the best job. As we provide a complete event streaming platform that is radically changing how companies handle data, I get...
View ArticleHow to Run Apache Kafka with Spring Boot on Pivotal Application Service (PAS)
This tutorial describes how to set up a sample Spring Boot application in Pivotal Application Service (PAS), which consumes and produces events to an Apache Kafka® cluster running in Pivotal Container...
View ArticleHow to Deploy Confluent Platform on Pivotal Container Service (PKS) with...
This tutorial describes how to set up an Apache Kafka® cluster on Enterprise Pivotal Container Service (Enterprise PKS) using Confluent Operator, which allows you to deploy and run Confluent Platform...
View ArticleWhy Scrapinghub’s AutoExtract Chose Confluent Cloud for Their Apache Kafka Needs
We recently launched a new artificial intelligence (AI) data extraction API called Scrapinghub AutoExtract, which turns article and product pages into structured data. At Scrapinghub, we specialize in...
View ArticleKafka Summit San Francisco 2019: Day 2 Recap
If you looked at the Kafka Summits I’ve been a part of as a sequence of immutable events (and they are, unless you know something about time I don’t), it would look like this: New York City 2017, San...
View ArticleKafka Summit San Francisco 2019: Day 1 Recap
Day 1 of the event, summarized for your convenience. They say you never forget your first Kafka Summit. Mine was in New York City in 2017, and it had, what, 300 people? Today we welcomed nearly 2,000...
View ArticleFree Apache Kafka as a Service with Confluent Cloud
Go from zero to production on Apache Kafka® without talking to sales reps or building infrastructure Apache Kafka is the standard for event-driven applications. But it’s not without its challenges, and...
View ArticleSchema Validation with Confluent 5.4-preview
Robust data governance support through Schema Validation on write is now supported in Confluent Platform 5.4-preview. This gives operators a centralized location to enforce data format correctness...
View ArticleReal-Time Analytics and Monitoring Dashboards with Apache Kafka and Rockset
In the early days, many companies simply used Apache Kafka® for data ingestion into Hadoop or another data lake. However, Apache Kafka is more than just messaging. The significant difference today is...
View ArticleEvery Company is Becoming a Software Company
In 2011, Marc Andressen wrote an article called Why Software is Eating the World. The central idea is that any process that can be moved into software, will be. This has become a kind of shorthand for...
View ArticleIncremental Cooperative Rebalancing in Apache Kafka: Why Stop the World When...
There is a coming and a going / A parting and often no—meeting again. —Franz Kafka, 1897 Load balancing and scheduling are at the heart of every distributed system, and Apache Kafka® is no different....
View ArticleHow to Make the Most of Kafka Summit San Francisco 2019
Kafka Summit San Francisco is just one week away. Conferences can be busy affairs, so here are some tips on getting the most out of your time there. Plan Go and check out the schedule. Spend a bit of...
View ArticleThe Rise of Managed Services for Apache Kafka
As a distributed system for collecting, storing, and processing data at scale, Apache Kafka® comes with its own deployment complexities. Luckily for on-premises scenarios, a myriad of deployment...
View ArticleReflections on Event Streaming as Confluent Turns Five – Part 2
When people ask me the very top-level question “why do people use Kafka,” I usually lead with the story in my last post, where I talked about how Apache Kafka® is helping us deliver on the promises the...
View ArticleBuilt-In Multi-Region Replication with Confluent Platform 5.4-preview
Running a single Apache Kafka® cluster across multiple datacenters (DCs) is a common, yet somewhat taboo architecture. This architecture, referred to as a stretch cluster, provides several operational...
View Article