Architectures of DataOps


Jan 18, 05:00PM PDT(01:00AM GMT).
  • Free 74 Attendees
Description
Speaker
This event is hosted by SF Big Analytics Group. https://www.meetup.com/SF-Big-Analytics

There are many new data technologies in 2021: more hot data engines such as ClickHouse, Iceberg, Delta Lake; more data pipeline tools: Apache DolphinScheduler, Apache SeaTunnel, more datamining libs: Ray, Orange and Hugging Face etc.

Today I would like to share some architectures using these new open-source projects in China Internet Companies like Tencent, Alibaba, VIP etc. and the challenges they experienced when using these new open-source projects facing millions of data requirement everyday. How to settle down the problem with new tools and let data developers, data scientist to finish the job themselves easily.

Wei Guo

Apache Software Foundation Member, ASF IPMC Member, Apache DolphinScheduler PMC, Founder of ClickHouse China Community, Apache SeaTunnel(incubating) Mentor. Former CTO of Analysys, Lenovo Big Data Senior Director, and worked at CICC, IBM,Terdata
The event ended.
Watch Recording
*Recordings hosted on Youtube, click the link will open the Youtube page.