AI Meetup (Virtual): Open Source Library for GenAI and LLMs


Oct 10, 09:00 AM PDT
  • Virtual DataStax
  • 289 RSVP
Description
Speaker

Welcome to the weekly AI/ML/Data virtual seminars. Join us for deep dive tech talks on AI/ML/Data, networking with speakers & peer developers from all over the world.

Tech Talk: Boost LLMs with Retrieval Augmented Generation
Speaker: Mary Grygleski @DataStax
Abstract: Large pre-trained language foundation models (LLMs), such as ChatGPT, that are pre-trained offline have been shown to store factual knowledge in their parameters, and achieve state-of-the-art results when fine-tuned on downstream natural language processing (NLP) tasks. However, their ability to access and precisely manipulate knowledge, especially with up-to-date knowledge, is still limited, and hence on knowledge-intensive tasks, their performance lags behind task-specific architectures.
To overcome such limitations, Retrieval Augmentation Generation (RAG) is a technique that can be utilized to retrieve data from outside a foundation model, and as such, it can be used for augmenting the prompts by injecting the relevant retrieved data into the context. RAG has proven to be more cost-effective and efficient than pre-training or fine-tuning foundation models, and can help to reduce hallucinations in LLMs.
In this talk, we will take a look at how utilizing an event-driven streaming approach, by using the open source library, LangStream, can quickly integrate your existing data in motion into generative AI applications such as with prompt engineering and the RAG pattern.

Community on Slack
- Event chat: chat and connect with speakers and attendees
- Sharing blogs, events, job openings, projects collaborations
Join Slack (search and join the #virtualevents channel)

Mary Grygleski

Mary is a Java Champion and a passionate Developer Advocate at DataStax, a leading data management company that champions Open Source software and specializes in Real-Time AI, Big Data, DB-as-a-Service, Streaming, and Cloud-Native systems. With over 25 years of hands-on experience in the software engineering and technical architecture areas, she began venturing into developer advocacy in 2018 at IBM, and has never looked back since then. She enjoys reaching out to developers and helping them succeed in their work.
The event ended.
Watch Recording
*Recordings hosted on Youtube, click the link will open the Youtube page.
Contact Organizer