Framework for ML, AI and data science projects
- Python-centric pipelines
- Experiment tracking
- Easy to transition from local to cloud
- Flexible deployment options (on-prem, AWS Batch, K8s, …)
Configuration
https://netflixtechblog.com/introducing-configurable-metaflow-d2fb8e9ba1c6
- Config object
- Pluggable parsers
Large experiments and hyper-parameter sweeps
https://www.youtube.com/channel/UC5h8Ji6Lm1RyAZopnCpDq7Q
Optimizations
https://outerbounds.com/blog/metaflow-fast-data/