Cursusaanbod
Preparing Machine Learning Models for Deployment
- Packaging models with Docker
- Exporting models from TensorFlow and PyTorch
- Versioning and storage considerations
Model Serving on Kubernetes
- Overview of inference servers
- Deploying TensorFlow Serving and TorchServe
- Setting up model endpoints
Inference Optimization Techniques
- Batching strategies
- Concurrent request handling
- Latency and throughput tuning
Autoscaling ML Workloads
- Horizontal Pod Autoscaler (HPA)
- Vertical Pod Autoscaler (VPA)
- Kubernetes Event-Driven Autoscaling (KEDA)
GPU Provisioning and Resource Management
- Configuring GPU nodes
- NVIDIA device plugin overview
- Resource requests and limits for ML workloads
Model Rollout and Release Strategies
- Blue/green deployments
- Canary rollout patterns
- A/B testing for model evaluation
Monitoring and Observability for ML in Production
- Metrics for inference workloads
- Logging and tracing practices
- Dashboards and alerting
Security and Reliability Considerations
- Securing model endpoints
- Network policies and access control
- Ensuring high availability
Summary and Next Steps
Vereisten
- An understanding of containerized application workflows
- Experience with Python-based machine learning models
- Familiarity with Kubernetes fundamentals
Audience
- ML engineers
- DevOps engineers
- Platform engineering teams
Getuigenissen (5)
Hij had geduld en begreep dat we achterop raken
Albertina - REGNOLOGY ROMANIA S.R.L.
Cursus - Deploying Kubernetes Applications with Helm
Automatisch vertaald
Hoe Interactief Reda de informatie zou uitleggen en ons zou laten deelnemen. Hij zou ook interessante feiten noemen onderweg en al zijn kennis delen. Reda heeft uitstekende communicatieve vaardigheden, waardoor online training echt effectief is.
Janine - BMW SA
Cursus - Kubernetes Advanced
Automatisch vertaald
De opleiding was meer praktisch
Siphokazi Biyana - Vodacom SA
Cursus - Kubernetes on AWS
Automatisch vertaald
Leren over Kubernetes.
Felix Bautista - SGS GULF LIMITED ROHQ
Cursus - Kubernetes on Azure (AKS)
Automatisch vertaald
Het bood een goede basis voor Docker en Kubernetes.
Stephen Dowdeswell - Global Knowledge Networks UK
Cursus - Docker (introducing Kubernetes)
Automatisch vertaald