Responsibilities:

• Meeting with the development team to assess the company's big data infrastructure

• Designing and coding hadoop applications to analyze data collections

• Creating data processing frameworks

• Extracting data and isolating data clusters

• Testing scripts and analyzing results

• Troubleshooting application bugs

• Maintaining the security of company data

• Creating data tracking programs

• Producing Hadoop development documentation

• Training staff on application use

Requirements:

• Requires 7+ years of development experience

• Experience working with big data and eco system (e.g. Hadoop, Hive, pySpark, HBase, Sqoop, Impala, Kafka, Flume, Oozie, MapReduce, S3 etc.)

• Experience with high level programming languages (Python, Java, etc)

• Experience working with database systems (e.g. Exadata, NoSQL, Cassandra, Neo4j, etc.)

• Experience working as part of an Agile team and using Agile SDLC tools (Jira, etc.)

• Ability to partner with other functional areas to ensure execution of development, design, coding, testing, debugging and documenting application