HADOOP/SPARK DEVELOPER

VERIZONE

1. ● Imported data using Sqoop to load data from MySQL to HDFS on regular basis. ● Worked extensively on Hadoop Components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node, YARN, Spark and Map Reduce programming. ● Analysed data which need to be loaded into hadoop and contacted with respective source teams to get the table information and connection details. ● Performing aggregations on large amounts of data using Apache Spark, Scala and landing data in Hive warehouse for further analysis. ● Load and transform large sets of structured, semi structured and unstructured data. ● Involved in loading data from UNIX file system to HDFS. ● Created Managed and External Hive tables with static/dynamic partitioning. ● Written Hive queries for data analysis to meet the Business requirements.

jnthu

COMPUTER SCIENEC