Confluent Launches Q3 ʼ21 Release, Making It Easier Than Ever to Set Data in Motion

Confluent, Inc., the platform to set data in motion, today announced the Confluent Q3 ʼ21 Release. This is Confluent’s first quarterly release, and it features developments that help organisations reliably share data between different environments, seamlessly integrate with business-critical applications, and cost-effectively store data needed for next-generation, digital customer experiences and data-driven backend operations.

With the rise of digital native companies, everyone expects real-time, in-the-moment experiences—from the way businesses operate behind the scenes to the way people complete everyday tasks like banking and grocery shopping. But too often, the data needed to fuel applications for this new paradigm cannot keep up. Existing data architectures were designed for data at rest, so they simply aren’t equipped for continuous, real-time flows of data.

“At the incredible pace of innovation happening in every industry, ubiquitous access to data in real time is now more crucial than ever,” said Ganesh Srinivasan, Chief Product and Engineering Officer, Confluent. “The Confluent Q3 ʼ21 Release helps companies harness data as it’s generated across more business applications and cloud environments at global scale to build a reliable, central nervous system for data in motion.”

 

Introducing the Confluent Q3 ʼ21 Release

With every quarterly release, Confluent will announce new capabilities for data in motion and Apache Kafka^® that reflect the investments it’s making to deliver a platform that is cloud-native, complete, and available everywhere. The Confluent Q3 ʼ21 release aims to help organisations break data silos, reliably share data between different environments, and simplify how organisations use data to react, respond, and adapt in real time.

 

Everywhere: Cluster Linking adds new data mirroring experience for near-real-time disaster recovery

“In order to meet new architectural requirements and reduce costs, we needed a solution for migrating data and existing workloads to a new Kafka cluster,” said Zen Yui, Data Engineering Manager, Namely. “We completed this migration quickly and easily using Confluent’s Cluster Linking. With perfectly mirrored topic data/metadata replication, offset preservation, and support for non-Java consumers, the migration was even more simple than we expected.”

Most organisations today are global and have architectures that span across continents and multiple cloud environments. Ensuring data flows consistently across these diverse environments in a way that’s secure and reliable is increasingly difficult. It typically requires additional, advanced replication tools that increase architectural complexity, are notoriously hard to manage, and often delay application development.

To help overcome this challenge, Cluster Linking is now generally available, providing a simple, fully managed solution for connecting Kafka clusters and replicating events across regions and clouds. This makes it easy to establish a single source of truth for real-time data that can be used for global data sharing, disaster recovery, and easy workload migrations. As part of this release, Confluent added additional capabilities for near-real-time disaster recovery. With Cluster Linking’s new data mirroring experience, a single Confluent Cloud CLI or API command lets you failover to perfectly mirrored Kafka topics on a separate region or different cloud provider altogether. This is an important capability for keeping business-critical applications running in the event of outages with a public cloud provider or regional service disruption.

 

Complete: ksqlDB pull queries simplify stream processing architectures, making it easier to build applications powered by data in motion

“Our customers expect instant updates on their order status and what’s in stock, which makes processing inventory data in real time a must-have for our business,” said Chirag Dadia, Director of Engineering, Nuuly. “ksqlDB pull queries enable us to do point-in-time lookups to harness data that is critical for real-time analytics across our inventory management system. Now, we can pinpoint exactly where each article of clothing is in the customer experience.”

For organisations to get the full benefit of data in motion, they need a complete set of capabilities to build applications quickly, reliably, and securely. Confluent drastically simplified the process of building data in motion applications with ksqlDB, the only database purpose-built for stream processing applications. It first launched with push queries, which deliver continuous streams of updates in real time, like the location of a rideshare or a retailer’s current inventory. However, many applications still need to pull static, historical information like purchase history and contact information. As a part of the Q3 ʼ21 Release, ksqlDB pull queries are now generally available in Confluent Cloud. Together with push queries, ksqlDB enables a broad class of end-to-end stream processing workloads without the need to work across multiple systems to build streaming applications. Organisations now have a single, easy-to-use solution for building innovative customer experiences powered by data in motion.

 

Complete: New fully managed connectors for Salesforce and Azure help deliver real-time business intelligence and richer customer experiences

Confluent has expanded its library of fully managed Kafka connectors that seamlessly integrate business-critical applications and data systems across an entire organisation. These new connectors help modernise and future-proof data infrastructure, giving organisations the flexibility to share data broadly and build everywhere across any environment. The Salesforce Platform Events Source connector enables organisations to unlock valuable customer data and share it with downstream data warehouses and applications to improve business intelligence and analytics and enrich customer experiences. The fully managed Azure Cosmos DB Sink connector helps companies migrate to a modern, cloud-native database to enable high performance and automatic scaling, unlocking real-time use cases like IoT, retail services, and online gaming at massive scale.

 

Cloud-native: Infinite Storage, now available for Google Cloud customers, retains real-time and historical data without limits

To avoid the costly operational overhead of managing data in motion at massive scale, Confluent re-architected Kafka to work seamlessly in the cloud with cloud-native traits developers expect, including elasticity, high availability, and cost-effectiveness. Infinite Storage is now generally available for Google Cloud, after initially launching for AWS. Organisations can now retain all the real-time and historical data they need without the hassle of pre-provisioning additional infrastructure or running the risk of paying for any unused storage. With real-time, data-driven applications based on a limitless supply of both current and historical information in the same place, businesses are able to build more engaging customer experiences and augment software-driven backend operations to take faster, more informed action.

 

Get started now

For a deep dive into the Confluent Q3 ʼ21 Release, register for a four-part webinar series that provides quick tutorials on how to get started with all the latest capabilities. More detail on each feature can also be found on the Confluent blog.