Wicklow Final Projectpresent

Wicklow Demo Video
Seamless, Scalable, and Smart – The Future of Data Automation.
A project to design a pipeline for automated and reliable extraction, transformation and loading of data from a write optimized database to a read optimized one.
The Team
Martin Foord
Svetlana Gljadelkina
Val Demotchkine
Samuel Moore
Sharon Schmalbach
Hugues Herve Tchoumkeu
Technologies

We used: Python, Terraform, AWS Services, AWS Wrangler, Pytest, Github /Actions, Trello
Challenges Faced
Some of the challenges in using these tools included limitations of black for pep8 during CI/CD, uploading pandas as a layer, integration testing with terraform, overlap of work.