Photo of Harpreet Singh

Harpreet Singh

ETL Developer (Extraction, Transformation, Loading)

Bareilly, Uttar Pradesh, India
1
Followers
0
Following
Careers
Data Engineer
Amazon Web Services
Full time contract05/2018 - 02/2023
  1. - Have experience in working on building and designing complex data pipelines and Serverless applications using AWS
  2. - Highly skilled in cost optimisation w.r.t Cloud. Have reduced the cost of storing and processing the dataset by upto $1MM/year
  3. - Have a working knowledge with Spark, Python, AWS Cloud services like Kinesis, EMR, Glue , Athena , Quicksight , Lambda , DynamoDB , S3 etc
  4. - Have worked on Redshift Datawarehouse optimisation, WLM settings, performance tuning and table design
Systems Engineer
Infosys Limited
Full time contract05/2016 - 04/2018
    Education
    Galgotias University
    B.Tech - Computer Science and Engineering
    05/2012 - 04/2016Bachelor's DegreeClass of 2016
    My projects
    AWS Billing Pipeline Optimisation
    portfolio show
    Optimise the AWS Billing pipeline containing Line Items details(SKU details). Key Highlights:

1. Reduce the processing time by 35%
2. Save storage and compute cost by $1MM
3. Build the reusable framework based on PySpark
    Role: Lead Data Engineer
    Completed: 11/2022
    Live project: N/A
    1. 1
    2. 2
    Skills
    PythonTransforming dataData pipelineData cleaning and preparationSparkAmazon Web ServicesData warehousingDatabase ManagementAWSArchitectures, Data lakes,Hadoop 
    ExperienceSenior-level5-8 years
    Hourly rate$15/hr
    Similar profiles
    1. no alt text
      Dinesh  Madhivanan
      ETL Developer (Extraction, Transformation, Loading)
    2. no alt text
      sudarshan bharadiya
      ETL Developer (Extraction, Transformation, Loading)
    3. no alt text
      Aritra Ghosh
      ETL Developer (Extraction, Transformation, Loading)
    4. no alt text
      Sarath Kaimal
      ETL Developer (Extraction, Transformation, Loading)
    5. no alt text
      DURGESH SAINDANE
      ETL Developer (Extraction, Transformation, Loading)
    astro circleWelcome to Outdefine
    A free tokenized community dedicated to connecting global tech talent with remote job opportunities. Our platform is designed to help you connect, learn, and earn in the tech industry while providing the chance to collect DEF tokens. Join our vibrant community today and explore a world of possibilities for your tech career!
    Join for free
    astro-hello
    Join a community, when you join Outdefine!Connect with 72,000 tech professionals globally.
    A free tokenized community dedicated to connecting global tech talent with remote job opportunities. Our platform is designed to help you connect, learn, and earn in the tech industry while providing the chance to collect DEF tokens. Join our vibrant community today and explore a world of possibilities for your tech career!
    Log inJoin for free