SESSION ABSTRACTS

18:30 Building An Efficient Streaming Data Pipeline with Apache Pulsar and Apache Cassandra

Event Streaming is one of the most important software technologies in the current computing era as it enables systems to process huge volumes of data in blazingly high speed and in real-time. It is indeed the "glue" that can connect data to flow through disparate systems and pipelines that are typical in cloud environments. Leveraging on the Pub/Sub pattern for the message flow, and designed with the cloud in mind, Apache Pulsar has emerged as a powerful distributed messaging and event streaming platform in the recent years. With its flexible and decoupled messaging style, it can integrate and work well with many other modern-day libraries and frameworks.

In this session, we will build a modern, efficient streaming data pipeline using Apache Pulsar and Apache Cassandra. Apache Pulsar will handle the data ingest. The external data that comes in will be used for further processing by Pulsar Functions that will in turn reference the tables in Cassandra as the data lookup sources. The results of the transformed data will then be egressed and sent to an Astra DB sink. We will also examine to see how we can further optimize the entire processing pipeline. .

Interval Drinks and Food Courtesy of Sparta Global

. 19:45: Event Messaging and Streaming with Apache Pulsar

The world is moving at an unprecedented pace and much of it has been powered by the innovations in software and systems. While event handling, messaging, and processing are not necessarily brand new concepts, the recent emergence in hardware such as virtualizations, multi-core processors, and so on, are in fact pushing the envelope in software design and development, elevating it to higher levels of capabilities never seen before. In the case of streaming which very often leverages on the underlying messaging mechanism(s) to bring distributed messaging to higher forms of purposes, such as IoT/IIoT applications, AI/ML data pipelines, or even eCommerce recommendations, event streaming platform has indeed become the “glue” in enabling data to flow through disparate systems in the pipeline and in a very dynamic fashion.

This talk on event streaming is meant for anyone interested in learning about it, and understanding how it fits into the modern software development design and architecture, as well as seeing some of the challenges it faces especially in the Cloud Native environment. We’ll then take a look at an open source platform - Apache Pulsar, which is poised to become the de facto new generation of distributed messaging and streaming platform that will bring joy to developers, and enable systems and applications to be highly responsive with its true real-time capabilities.

Here's Something About Mary!

Mary is a Java Champion and a passionate Streaming Developer Advocate at DataStax, a leading data management company that champions Open Source software and specializes in Big Data, DB-as-a-service, Streaming, and Cloud-Native systems. She spent 3.5 years previously as a very effective advocate at IBM, focusing on Java, Jakarta EE, OpenJ9, Open Source, Cloud, and Distributed Systems. She transitioned from Unix/C to Java around 2000 and has never looked back since then. She is an active tech community builder outside of her day job, and currently the President of the Chicago Java Users Group (CJUG).

Find Mary on Twitter: @mgrygles

About the West Midlands Java User Group

The West Midlands Java User Group, aka WM-JUG, is among the most respected communities in the United Kingdom. Since 2014, we have been bringing Java Champions, Java One Rock Stars, and Duke Award winners to the city for the benefit of our local group of Java software professionals.

Aside from our website WM-JUG.org, we can also be found on Twitter

The West Midland Java User Group - Partner Messages

Thanks to the following partners whose support enables us to host fabulous events for the educational benefits of our members.

Sparta Global

Sparta Global is an award-winning provider of quality and diverse emerging technology talent. A Hire-Train-Deploy organisation, Sparta Global hires individuals with the attitude, aptitude, and potential to be future technology leaders, trains them in in-demand areas (including development, engineering, data and business analysis) and assigns them to work with clients with digital skills gap.

https://linktr.ee/spartaglobal

If your company is interested in supporting our group, please reach out to us at team@wm-jug.org