Airflow for data replication use case is understood
There is a possibility to replicate data with airflow. Airflow can:
- move the data around,
- have some notion of replication policy (e.g. at least 3 copies are available at any time),
- perform periodic checks if the policy is fulfilled or not (and react accordingly)
- inform the users about the state (new replicas)
- keep track of replicas in data catalog (list of urls)