Roles and Responsibilities

Hadoop Developer Responsibilities:

• Meeting with the development team to assess the companys big data infrastructure.
• Designing and coding hadoop applications to analyze data collections.
• Creating data processing frameworks.
• Extracting data and isolating data clusters.
• Testing scripts and analyzing results.
• Troubleshooting application bugs.
• Maintaining the security of company data.
• Creating data tracking programs.
• Producing Hadoop development documentation.
• Training staff on application use.

Hadoop Developer Requirements:

• Bachelors degree in software engineering or computer science.
• Previous experience as a hadoop developer or big data engineer.
• Advanced knowledge of the hadoop ecosystem and its components.
• In-depth knowledge of Hive, HBase, and Pig.
• Familiarity with MapReduce and Pig Latin Scripts.
• Knowledge of back-end programming languages including JavaScript, Node.js, and OOAD.
• Familiarity with data loading tools including Squoop and Flume.
• High-level analytical and problem-solving skills.
• Good project management and communication skills.