Project Team 3: Team Onyx Project
present

Team ONYX Demo Video

Team ONYX Demo Video

We're Onyx-ly the Best

Building a hybrid data lakehouse for a fictitious company - onyx-ly it works

The Team

  • Team member imagePreview: Team member image

    Shuhaan Miah

  • Team member imagePreview: Team member image

    Arif Syed

  • Team member imagePreview: Team member image

    Ayub Mensah

  • Team member imagePreview: Team member image

    Ewan Ritchie

  • Team member imagePreview: Team member image

    Hasan Malik

  • Team member imagePreview: Team member image

    Saif Uddin

Technologies

Python, Terraform, AWS, Tableau, pandas, pytest, postgresPreview: Python, Terraform, AWS, Tableau, pandas, pytest, postgres

We used: Python, Terraform, GitHub Actions, Makefile, AWS, Tableau, pdoc, pandas, sqlAlchemy, pg8000, pytest, boto, moto, postgres

To make an ETL pipeline that is automated as possible with analysis.

Challenges Faced

Mocking databases, using sqlAlchemy and integration testing