Data Stream Processing Night - New York

Nov 09, 03:00 PM PST
  • New York (Wix playground, 100 Gansevoort St, New York, NY 10014) AICamp
  • 116 RSVP

This is in-person only event in New York City.


Data streaming platforms provide the tools needed to bring together real-time streams of data. It enables data intelligent, real-time applications and systems, and empowers teams to act on data instantly.

We will host a series of meetup events to showcase some of the cutting edge developments that are happening in data stream processing in the open sourced tools and industry. We will invite the PMCs of Apache Beam, Airflow, Spark, Flink, Kafka, etc.. and teams who use these tools to share practical experiences, best practices in building data stream processing pipelines. The community of real-time technology leaders and developers will come together to share best practices and use cases as well as explore the vision and future of data streaming.

Agenda (EST):
* 6:00pm~6:30pm: Checkin and Food/drink
* 6:30pm~8:00pm: Tech talks
* 8:00pm: Networking and closing

Tech Talk 1: Lessons from reimplementing a streaming source 3 times.
Abstract: I am the author of Pub/Sub Lite I/O, and have had to implement a streaming source at various points in the maturity of the beam model. I will discuss issues I ran into, how they can be solved, and what my takeaways are for beam development.
Speaker: Daniel Collins, Google

Tech Talk 2: Scaling with Data Streams with Apache Kafka
A high level overview of how open source technologies such as Apache Kafka were used to build Wix highly scalable platform for millions of developers. Learn more about Wix Engineering open source contributions in the stream processing ecosystem.

100 Gansevoort St, New York, NY 10014

Lucky draw
We will raffle winners for the prize during the event. To enter the lucky draw, please complete one of the two steps (or both):
- Twitter the event with hashtag #datastreamnyc and tag @aicampai . for example:

#datastreamnyc a series of in-person meetups by @aicampai and @ApacheBeam to share practical experiences, best practices in building data stream processing pipelines. Free to join:
- Commend the post on linkedin: LinkedIn Post

Daniel Collins

Software engineer from Google. Lead developer on the Pub/Sub Lite project.
The event ended.
Watch Recording
*Recordings hosted on Youtube, click the link will open the Youtube page.
Contact Organizer