Data Engineer

Avansa IT Solutions

1. In a recent project, I designed and implemented robust data ingestion pipelines using Azure Databricks, integrating multiple data sources seamlessly. This involved configuring Azure storage integration and building ELT pipelines using Databricks Jobs and Workflows for efficient data processing. I orchestrated these applications using Azure Data Factory pipelines, ensuring smooth data orchestration and management across the platform. Additionally, I developed PySpark applications deployed on Databricks clusters, adhering to software development best practices for maintaining high code quality. Throughout the project, I leveraged Azure Synapse Analytics for workspace creation, utilized Synapse Studio for data exploration, and implemented serverless SQL queries to optimize data workflows and enhance performance.

Southeast Missouri University

Applied Computer Science