About
Web developer adept with product data. Competent in Python for data engineering, analysis, reporting and workflow automation to drive growth for an international manufacturing company. Seeking to use data engineering skills to improve corporate performance and grow professionally.
Professional Experience
- Wrote 70+ Python scripts, including a data migration script that reduced time overall from 24 hours/week to 2 hours/week, saving our team roughly 200 hours and the outsourcing of an expensive user testing process.
- Spearheaded the automation of data migration in 25 different spoken languages for hundreds of different products to a new web platform and verified data accuracy by comparing old/new sites using a web scraper and the Google translate API
-
Projects
- Architected a Sparkify ETL process and Database schema to insert JSON logs into an easily accessible Postgres database for analytics querying
- Created a Spotify ETL process to save recently played tracks from the Spotify API, wrote unit tests to ensure data accuracy and then appended data into an SQLite database
- Set up an ETL pipeline with an Airflow DAG to join 2 datasets in an AWS stack to then be used by analysts.
- Technologies used include Pythnon, Redshift, EMR, S3, and Hadoop.
- Created and deployed a dashboard using Plotly that displays 4 years worth of information on the death of bee colonies
- Data pulled from the US Department of Agriculture