Confluent Reimagines Data Pipelines for the Streaming Era with Stream Designer

Confluent | October 06, 2022 | Read time : 03:50 min

Confluent Reimagines Data Pipelines
Confluent, Inc. (NASDAQ: CFLT), the data streaming pioneer,  announced Stream Designer, a visual interface that enables developers to build and deploy streaming data pipelines in minutes. This point-and-click visual builder is a major advancement toward democratizing data streams so they are accessible to developers beyond specialized Apache Kafka experts. With more teams able to rapidly build and iterate on streaming pipelines, organizations can quickly connect more data throughout their business for agile development and better, faster, in-the-moment decision making.We are in the middle of a major technological shift, where data streaming is making real time the new normal, enabling new business models, better customer experiences, and more efficient operations, said Jay Kreps, Cofounder and CEO, Confluent. With Stream Designer we want to democratize this movement towards data streaming and make real time the default for all data flow in an organization.

In the streaming era, data streaming is the default mode of data operations for successful modern businesses. The streaming technologies that were once at the edges have become core to critical business functions. This shift is fueled by the growing demand to deliver data instantaneously and scalably across a full range of customer experiences and business operations. Traditional batch processing can no longer keep pace with the growing number of use cases that depend on sub-millisecond updates across an ever-expansive set of data sources.

Organizations are seeking ways to accelerate their data streaming initiatives as more of their business is operating in real time. Kafka is the de facto standard for data streaming, as it enables over 80% of Fortune 100 companies to reliably handle large volumes and varieties of data in real time. However, building streaming data pipelines on open-source Kafka requires large teams of highly specialized engineering talent and time-consuming development spread across multiple tools. This puts pervasive data streaming out of reach for many organizations and leaves existing legacy pipelines clogged with stale and outdated data.

“A rising number of organizations are realizing streaming data is imperative to achieving innovation and maintaining a healthy business, Businesses need to add more streaming use cases, but the lack of developer talent and increasing technical debt stand in the way. Visual interfaces, like Stream Designer, are key advancements to overcoming these challenges and make it easier to develop data pipelines for existing teams and the next generation of developers.”

-Amy Machado, Research Manager, Streaming Data Pipeline, IDC

Stream Designer: The First Visual Interface for Rapidly Building Streaming Data Pipelines Natively on Kafka

Data streaming is quickly becoming the central nervous system of our infrastructure as it powers real-time customer experiences across our 12 countries of operations,” said Enes Hoxha, Enterprise Architect, Raiffeisen Bank International. “Stream Designer’s low-code, visual interface will enable more developers, across our entire organization, to leverage data in motion. With a unified, end-to-end view of our streaming data pipelines, it will improve our developer productivity by making real-time applications, pipeline development, and troubleshooting much easier.

Stream Designer provides developers a flexible point-and-click canvas to build pipelines in minutes and describe data flows and business logic easily within the Confluent Cloud UI. It takes a developer-centric approach, where users with different skills and needs can seamlessly switch between the UI, a code editor, and command-line interface to declaratively build data flow logic at top speed. It brings developer-oriented practices to pipelines, making it easier for developers new to Kafka to scale data streaming projects faster.

With Stream Designer, organizations can:

  • Boost developer productivity: Instead of spending days or months managing individual components on open source Kafka, developers can build pipelines with the complete Kafka ecosystem accessible in one visual interface. They can build, iterate and test before deploying into production in a modular fashion, keeping with popular agile development methodologies. There’s no longer a need to work across multiple discrete components, like Kafka Streams and Kafka Connect, that each require their own boilerplate code.
  • Unlock a unified end-to-end view: After building a pipeline, the next challenge is maintaining and updating it over its lifecycle as business requirements change and tech stacks evolve. Stream Designer provides a unified, end-to-end view to easily observe, edit, and manage pipelines and keep them up to date.
  • Accelerate development of real-time applications: Pipelines built on Stream Designer can be exported as SQL source code for sharing with other teams, deploying to another environment, or fitting into existing CI/CD workflows. Stream Designer allows multiple users to edit and work on the same pipeline live, enabling seamless collaboration and knowledge transfer.

Connect with Confluent at Current to learn more!
See Stream Designer in action at Current. Today, October 4 at 10:00 am CT, Confluent CEO and Cofounder Jay Kreps takes the stage to talk about the data streaming category in the keynote “Welcome to the Streaming Era.” And, on October 5 at 10:00 am CT tune into the mainstage for a deep dive into the product. Register now to see it virtually. Live demos will be given for in-person attendees at the Confluent booth.

About Confluent
Confluent is the data streaming platform that is pioneering a fundamentally new category of data infrastructure that sets data in motion. Confluent’s cloud-native offering is the foundational platform for data in motion—designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organization. With Confluent, organizations can meet the new business imperative of delivering rich, digital front-end customer experiences and transitioning to sophisticated, real-time, software-driven backend operations. To learn more, please visit


The ThinkVison P49w-30 Monitor is a great companion for multitasking on tasks ranging from data crunching to chasing stock market numbers. Its In-Plane Switching black panel technology delivers deep blacks and vivid, vibrant colors, while the wide viewing angles ensure that the screen is clearly visible from every angle.


The ThinkVison P49w-30 Monitor is a great companion for multitasking on tasks ranging from data crunching to chasing stock market numbers. Its In-Plane Switching black panel technology delivers deep blacks and vivid, vibrant colors, while the wide viewing angles ensure that the screen is clearly visible from every angle.

Related News


SportsGrid Network launches on Xiaomi Mi TV + in España

SportsGrid | November 23, 2022

SportsGrid, the world's first and only 24-hour streaming FAST channel serving the massive sports wagering audience, announced the launch of the video network on the Xiaomi Mi TV + in España. SportsGrid is available today on the Xiaomi Mi TV platform joining the wide selection of free channels across many programming genres including movies, TV shows, sports, news, comedy and more. The SportsGrid Network viewer experience amplifies the emergence of new levels of fan engagement among Men 18-34 with the convergence between live event coverage and real-time sports wagering. With users consuming more and more streaming video content every year, we believe it is important to let users experience quality content in new ways. We're happy to work with SportsGrid to connect Xiaomi users to watch the live sports wagering coverage of major sports events. We look forward to the launch of the SportsGrid Network to provide the real time scores, data, and intelligence to benefit our users. said Hanson Han, Director of Business Development, Xiaomi International. "As we approach the FIFA 2022 World Cup, SportsGrid is extremely pleased to be covering the live global event with the real-time odds, moneylines, and gaming data for our connected worldwide viewers. SportsGrid has developed strategic global content alliance relationships with the Sporting News, Legal Sports Report, the Parleh (Canada), and Sportradar to augment the network's worldwide coverage. The SportsGrid strategic content alliance is a collaborative initiative bringing together the strategy, reporting, and editorial resources of each participating media organization." -Charles Theiss, SportsGrid Chief Media Officer. Amagi, the leader in media SaaS for broadcast and connected TV, has supported SportsGrid's rapid international growth with their next-generation media technology solutions accelerating the worldwide distribution and monetization of the network. About Xiaomi Corporation Xiaomi Corporation was founded in April 2010 and listed on the Main Board of the Hong Kong Stock Exchange on July 9, 2018 (1810.HK). Xiaomi is a consumer electronics and smart manufacturing company with smartphones and smart hardware connected by an IoT platform at its core. Embracing our vision of "Make friends with users and be the coolest company in the users' hearts", Xiaomi continuously pursues innovations, high-quality user experience and operational efficiency. The company relentlessly builds amazing products with honest prices to let everyone in the world enjoy a better life through innovative technology. Xiaomi is one of the world's leading smartphone companies. The company's market share in terms of smartphone shipments ranked no. 3 globally in 2021. The company has also established the world's leading consumer AIoT (AI+IoT) platform, more than 400 million smart devices connected to its platform as of September 30, 2021, excluding smartphones and laptops. Xiaomi products are present in more than 100 countries and regions around the world. In August 2021, the company made the Fortune Global 500 list for the third time, ranking 338th, up 84 places compared to 2020. For more information about Xiaomi as a company, please visit About SportsGrid, Inc. SportsGrid, Inc. is the multimedia technology platform providing innovative digital solutions for the convergence of sports content, gaming, and mobile technology. The SportsGrid multimedia destinations include SportsGrid Streaming Video Network, SportsGrid Radio,, DailyRoto, and SportsGrid Studios. With the seismic shift towards multiscreen IP, cloud, and data-driven distribution of sports content, SportsGrid launched an innovative video content management and distribution initiative in 2020. The video distribution platform syndicates the exclusive SportsGrid short-form programming to premium publishers to grow and engage their digital sports gaming audiences. SportsGrid, Inc. is the content source and destination to serve the massive sports gaming audience with unrivaled best-of-breed programming, technology, data, and gaming analysis.

Read More


PRG Invests in Led Innovations for Live Entertainment Enhancement

PRG | February 08, 2023

On February 07, 2023, Production Resource Group (PRG), an entertainment company, announced its investment in two new LED products from InfiLED, LED Gear Titan-X and Deep Black Series, enhancing live entertainment events. It purchased 8,000 panels of DB Series LED products with a 2.3-pixel pitch, designed for events such as product launches, exhibitions, and corporate meetings with high-resolution panels. In addition, it will produce contrast effects with the ultra-black masking material and black LEDs, edge protectors, and fast-locking mechanisms. As PRG has purchased all panels from the same manufacturer, its clients experience consistency in its products. The newly purchased 840 new Titan-X outdoor touring panels are lightweight, 1200mm x 1200mm large, have 70% transparency, with a slot for loudspeakers behind LED walls, no audio degradation, and unobstructed screen views. In addition, its X-frame structure increases stability and wind resistance, making it perfect for outdoor festivals and events. Vice President of PRG Gear, Todd Spencer, said, "Technical advances in LED and stability in the sub-3mm resolution market have allowed us to respond to client demand, and we are confident that these products will be very popular with our Gear clients." He added, "Coming on the heels of our recent lighting fixture purchases, PRG's significant investment in this state-of-the-art technology reinforces our position as a premium provider in the markets we serve." (Source – Cision PR Newswire) PRG's CEO of Music, Randy Hutson, said, "Investing in this new technology allows us to further solidify PRG as a lead provider, meet the rigorous standards of our client's logistical and artistic needs and deliver an enhanced experience for their audiences." (Source – Cision PR Newswire) About PRG PRG, an entertainment and event services and solutions company, provides services to creators, producers, designers, performers, and business leaders from every form of the entertainment sector, combining technology with creativity and experience. It has employed the best engineers, artisans, and experts from theatre, broadcast, TV, film, corporate events, concerts, staging, and hotels. Headquartered in New Windsor, New York, it has 62 offices worldwide with over 170 patents and 70 trademarks, providing services like broadcasting, automation, scenic, digital services, virtual production, labor, camera, audio, video, lighting, and rigging.

Read More


MediaKind’s Mediaroom Play Powers Next-Generation Streaming Experiences to More Viewers Across Canada

MediaKind | November 29, 2022

MediaKind announces that Mediaroom Play is powering more TV services to viewers across Canada, marking a new era in media entertainment experiences. Mediaroom Play combines the quality of experience brought by the Mediaroom IPTV platform with the wealth of applications offered by Android TV. The deployment enables TV providers to bring live TV, on-demand shows and movies, Cloud PVR, apps, voice remote, and powerful search, all in one place. With Google Play Store integration, providers can also offer access to over 7,000 apps including some of the favorite streaming content applications, positioning themselves as leading aggregators of media services in Canada. Most recently, MediaKind worked with Bell Canada on the latest evolution of its Fibe TV service. Mediaroom Play represents MediaKind’s substantial investment in Mediaroom, the IPTV platform highly rated for the quality of its user experience. Mediaroom offers next-generation services through the integration with MediaKind’s Video Storage and Processing Platform (VSPP) Cloud PVR, Google’s Android TV, Google Play, Google Assistant voice control, and Universal Search. It increases the IPTV service value by giving access to 7000+ applications while maintaining the reliability and usability that made its reputation. Developed on the Android-TV operating system, the pre-integrated product provides a tested, robust, and market-ready solution to rapidly launch new STBs powered by Android TV. The integration also opens new monetization routes for operators, with revenue share opportunities on the Google Play Store and through Google Ads, as well as additional monetization options based on content and app curation. This considerably expands the consumer benefits and lifetime value for Mediaroom customers. “As one of our longest-standing Mediaroom customers, we’re delighted to see Bell integrate Mediaroom Play with its pioneering Fibe TV service, and position itself as Canada’s leading content aggregator. With Mediaroom Play, Fibe TV’s customers can experience the next evolution of TV and entertainment, whereby live TV and on-demand movies and shows are accessible through apps, voice control, and powerful search functions.” -Steve Payne, President and Chief Revenue Officer, MediaKind About MediaKind MediaKind is a global change leader in media technology and services. Its mission is to deliver transformation by building a continuously better media universe alongside its customers and partners. Drawing on a pioneering industry heritage and fueled by innovation, MediaKind embraces and champions new standards, methodologies, and next-generation, immersive live and on-demand media experiences worldwide. Its end-to-end media solutions portfolio includes Emmy award-winning video compression for contribution and direct-to-consumer video service distribution, advertising and content personalization, high-efficiency cloud DVR, and TV and video delivery platforms. For more information, please visit:

Read More