This virtual AI seminar is hosted by SF Big Analytics.
Tech Talk: Confidential Containers for GPU Compute: Lift-and-Shift Strategy for AI
Speaker: Zvonko Kaiser (NVIDIA)
Abstract: We explore transitioning from traditional to secure, isolated environments crucial for sensitive data processing. Our choice of Kata for confidential container enablement ensures security while maintaining container flexibility. Alongside this, a virtualization reference architecture supports advanced scenarios like GPUdirect RDMA. A key aspect of our strategy is the lift-and-shift approach, allowing seamless migration of existing AI/ML workloads to these confidential environments. This integration combines LLMs with GPU-accelerated computing - leveraging Kubernetes for effective orchestration and balancing computational power and data privacy.
Community on Slack/Discord
- Event chat: chat and connect with speakers and attendees
- Sharing blogs, events, job openings, projects collaborations
Join Slack (search and join the #virtualevents channel) | Join Discord