Airflow with S3 sensors may be helpful here as well, you can as well incorporate Spark or kafka in the same pipeline
1 Like
Airflow with S3 sensors may be helpful here as well, you can as well incorporate Spark or kafka in the same pipeline