Photo of Premanand Nandhakumar

Premanand Nandhakumar

Data Engineer

Courtice, ON, Canada
0
Followers
0
Following
•	Around 17 years of IT experience in all aspects of project development life cycle including Analysis, Design, Development, Implementation, Modeling, Testing, Reconciling, and Supporting for Enterprise Data warehousing, Data marts, Data migration, Data Integration, Data management projects.
•	Experience in building Data Lake and Data pipelines using AWS serverless services like Lambda, Glue, S3, Dynamo DB and AWS Redshift.
•	Expertise in strategizing the Data migration and integration from traditional on-prem databases and applications to Snowflake Cloud Datawarehouse using DBT cloud.
•	Accelerate migration and modernization of Customer’s on-premises legacy data warehouses to achieve operational excellence, security, reliability, performance efficiency and cost optimization.
•	Extensive experience in Informatica Power Center (10.x/9.x/8.x) tools along with Informatica Big Data Management 10x (BDM).  Expertise in loading various source system data in to Hadoop data lake. 
•	Expertise in design and implementation of SCD - Slowly changing dimensions types (1, 2 and 3) and CDC - Change data capture.
•	Experience in all phases of Software Development Life Cycle (SDLC), Waterfall and AGILE methodologies. Performed various system - related analytical activities within all the phases.
•	Ability to gather and document Business Requirements, experienced in writing Use Cases. 
•	Extensive experience in building ETL data pipelines from multiple data sources into a Reporting and Analytical Data Model.
•	Expertise in Databases like Snowflake,Oracle, Teradata etc. Development of SQL, PL/SQL and Query tuning for better performance
•	Hands on experience in HiveQL, and experience on Pushdown optimizations.
•	Build Python packages for making API calls and reconciliations to create orchestration across applications.
•	Expertise in the area of Business Intelligence and Analytical, Dashboard reporting.

Careers

Data Engineer - Lead

Ciena

Full time02/2022 -
  1. Responsible for setting the technical direction and strategy for the data engineering team, including selecting and implementing the appropriate technologies and tools.
  2. Leading the design, development, and maintenance of data pipelines, data models, and data storage systems, ensuring that they meet the organization's data quality and performance requirements.
  3. Lead the data engineering team in migrating the existing Informatica ETL process to DBT+Snowflake (cloud).
  4. Designing and implementing data pipelines to extract, transform, and load data from various sources like STRIIM, Fivetran, AWS S3 Snowpipe,IICS into Snowflake
  5. Writing DBT models to transform and clean the data stored in Snowflake, such as creating derived tables, performing data validation, and implementing data lineage.
  6. Defining and implementing DBT tests to ensure data quality and consistency. Building and maintaining DBT documentation, including data dictionaries, to help users understand the data and its lineage
  7. Build python packages and implement the orchestration of multiple applications via API calls using Python on Prefect Platform.
  8. Collaborating with other teams, such as data science, analytics, and product development, to understand their data needs and support them in building data-driven solutions
  9. Ensuring data quality and consistency by implementing data validation and testing processes
  10. Leading the design and development of data infrastructure, ensuring that it is scalable, maintainable, and cost-effective
  11. Keeping up-to-date with new features and capabilities of Snowflake (like use of Snowpark, Streamlit etc) and other data technologies.

Education

Anna Universtiry

Mech. Engg

06/2001 - 05/2005Bachelor's DegreeClass of 2005
Skills
SnowflakePythonAWSData EngineeringELT/ETLInformaticadbtBig Data
Experience8+ years
Hourly rate$60/hr
Open to
remote

Similar profiles

  1. no alt text

    Azam Haddadi Amlashi

    Data Engineer

  2. no alt text

    Brad Broten

    Data Engineer

  3. no alt text

    Ovo Okpubuluku

    Data Engineer

  4. no alt text

    Samia Bouhaddou

    Data Engineer

  5. no alt text

    Lakshmi Priya Ramisetty

    Data Engineer

astro circleWelcome to Outdefine

A free tokenized community dedicated to connecting global tech talent with remote job opportunities. Our platform is designed to help you connect, learn, and earn in the tech industry while providing the chance to collect DEF tokens. Join our vibrant community today and explore a world of possibilities for your tech career!

Join for free
astro-hello

Join a community, when you join Outdefine!Connect with 72,000 tech professionals globally.

A free tokenized community dedicated to connecting global tech talent with remote job opportunities. Our platform is designed to help you connect, learn, and earn in the tech industry while providing the chance to collect DEF tokens. Join our vibrant community today and explore a world of possibilities for your tech career!

Log inJoin for free