Addison, Texas
Skills : Hadoop,JAVA,python,architecture,Design,Engineering, SQL,Java
Description :
In this role, you will be helping to build new data pipelines, identifying existing data gaps, and providing automated solutions to deliver advanced analytical capabilities and enriched data to applications that are supporting the operations team.
You will also be responsible for obtaining data from the System of Record and establishing real-time data feed to provide analysis in an automated fashion.
Desired Skills:
• Experience working with Hadoop/Big Data related field
• Working experience on tools like Hive, Spark, HBase, Sqoop, Impala, Kafka, Flume, Oozie, MapReduce, etc.
• Hands on programming experience in perhaps Java, Scala, Python, or Shell Scripting, to name a few
• Experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines
• Strong experience with SQL and Data modelling
• Experience working in Agile development process and deep understanding of various phases of the Software Development Life Cycle
• Experience using Source Code and Version Control systems like SVN, Git, etc.
• Deep understanding of the Hadoop ecosystem and strong conceptual knowledge in Hadoop architecture components
• Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets
• Ability to comprehend customer requests and provide the correct solution
• Strong analytical mind to help take on complicated problems
• Desire to resolve issues and dive into potential issues
Specific Skillsets:
• Experience working with Hadoop/Big Data related field
• Working experience on tools like Hive, Spark, HBase, Sqoop, Impala, Kafka, Flume, Oozie, MapReduce, etc.
• Hands on programming experience in perhaps Java, Scala, Python, or Shell Scripting, to name a few
• Experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines
Top 3 Qualifications:
1. Experience with backend data engineering
2. Experience with data analytics and quality control
3. Engaging with Engineering team partners to understand requirements documents