Kubernetes Deployment (Helm/Kind)¶
1. Running on Kubernetes (Kind / Helm)¶
For a production-like deployment with scalability:
- Create a Kubernetes cluster (Kind example):
kind create cluster --name bbc-news-etl
- Deploy Helm charts:
helm install bbc-news-etl ./helm/bbc-news-etl
- Check pods and services:
kubectl get pods
kubectl get svc
- Access Grafana (for monitoring):
kubectl port-forward svc/grafana 3000:3000
2. Next Steps¶
- Explore architecture/overview.md for system design.
- Dive into components/ for detailed ETL workflow.
- Check configuration/ for environment variables and setup.