AI Seminar (Virtual): Confidential Containers for GPU Compute


Jun 27, 09:00 AM PDT
  • Virtual () SF Big Analytics
  • 78 RSVP
Description
Speaker

This virtual AI seminar is hosted by SF Big Analytics.

Tech Talk: Confidential Containers for GPU Compute: Lift-and-Shift Strategy for AI
Speaker: Zvonko Kaiser (NVIDIA)
Abstract: We explore transitioning from traditional to secure, isolated environments crucial for sensitive data processing. Our choice of Kata for confidential container enablement ensures security while maintaining container flexibility. Alongside this, a virtualization reference architecture supports advanced scenarios like GPUdirect RDMA. A key aspect of our strategy is the lift-and-shift approach, allowing seamless migration of existing AI/ML workloads to these confidential environments. This integration combines LLMs with GPU-accelerated computing - leveraging Kubernetes for effective orchestration and balancing computational power and data privacy.

Community on Slack/Discord
- Event chat: chat and connect with speakers and attendees
- Sharing blogs, events, job openings, projects collaborations
Join Slack (search and join the #virtualevents channel) | Join Discord

Zvonko Kaiser (NVIDIA)

Zvonko is a Principal Systems Engineer at NVIDIA, working on the Cloud Native Technologies team. Focusing right now on all things related to confidential computing, especially in the context of accelerators.
The event ended.
Watch Recording
*Recordings hosted on Youtube, click the link will open the Youtube page.
Contact Organizer