AWS Data Engineer

Horizon Media

1. • Extensively worked on Data processing, migration, ingestion, and analytics using AWS cloud services like EC2, S3, EMR, Athena, Lambda, Glue, Redshift, and DynamoDB. • Experience in writing AWS Lambda functions using Python and connecting them to Glue jobs using Boto3 client for ETL pipelines. • Hand on handling skill in pipeline building and ETL tools like Athena, Kinesis, Glue, DynamoDB, Redshift. • Created ETL pipelines to ingest Data from HDFS to S3 and analyzed Big Data using HDFS in AWS EMR clusters. • Developed Spark applications using PySpark for batch processing jobs from S3 to Amazon RDS. • Extract transfer data to various databases like AWS Redshift, Teradata through S3, EC2, and EMR instances using Python and Spark.

Christian Brothers University

MSCIS