Basaltpresent
Team Stian 👊
> An end-to-end cloud-based data pipeline.
> Extracts data at regular intervals from client PostgreSQL database.
> Transforms data into three interlinked star schemas using Python.
> Stores the data in a file-based data lake hosted on AWS.
> Loads the data into the clients online analytics processing database.
The Team
Joe Donlan
Chris Johnston
Iuliia Kostina
Santhy Tamang
Technologies
![Technologies section image](https://images.prismic.io/northcoders/65fbeb0b-cf08-4752-827f-4648d60df122_Basalt.png?auto=compress%2Cformat&fit=max&q=60&w=800)
We used: AWS, Python, Terraform, GitHub Actions, Git.
They were appropriate for the project.
Challenges Faced
We were short by one team member