Hadoop Developer
JOB DESCRIPTION
· 4+ yrs of strong experience in Hadoop Framework and its ecosystem – HDFSArchitecture, MapReduce Programming, Hive, Pig, Sqoop, Hbase, Zookeeper, Oozie, Spark, Scala, Flume, etc.
· Good knowledge of Hadoop Architecture and ecosystems such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node, and Map Reduce programming paradigm.
· Hands experience in installing, and configuring Cloudera’s Apache Hadoop ecosystem components like Flume-ng, Hbase, Zoo Keeper, Oozie, Hive, Spark, Sqoop, Hue, Pig, Hue
· Hand with analyzing data using HiveQL, Pig Latin, HBase, and custom Map Reduce programs
· 4+ years experience in developing data ingestion from multiple data platforms & multiple modes: batch, realtime(Spark(SQL/Streaming). Need good working knowledge of data processing frameworks – Apache Spark
· Any experience in distributing event processing systems like Kafka is a plus.
· 4+ years experience in data modeling, and data transformation with detailed designs & integration processes that move data from raw to curated/publish zones of data warehouses
· Experience with Cloud technologies such as AWS or GCP or Azure with focuses on big data management stacks: AWS- Redshift/Kinesis/Glue or GCP-BigQuery/PubSub, DataFlow, Azure – Synapse, EventsHub, Stream Analytics