NLP: How to Pre-train Your Transformer


Apr 18, 10:00 AM PDT
  • Virtual AICamp
  • 253 RSVPs
Description

In this session, Leandro will discuss the new OReilly book "Natural Language Processing with Transformers” he co-authored and highlight some of the techniques and challenges that arise when training these models from scratch.

A focus of this session will be on the creation of CodeParrot - a large GPT-2 model that is trained on (almost) all of the Python source code on GitHub!

Lucky draw prizes


We will raffle 5 winners for the book during the event. To enter the lucky draw, please complete one of the two steps:
- Twitter the event with hashtag #nlpaicamp and tag @aicampai . for example:

#nlpaicamp online AI/ML tech talk series by @aicampai: Leandro (ML engineering from Hugging Face) is discussing NLP with transformers. Free RSVP: https://www.aicamp.ai
OR
- Commend or reshare the post on linkedin: LinkedIn Post

* print copy for winners in US and e-book for winners outside US.

Contact Organizer