We are seeking a Senior Developer with a minimum of 5 years of hands-on experience in extracting data from Data Kale systems. In this role, you shall design and implement data extraction from huge databases. You are required to have good knowledge of using SQL/PLSQL, Python, PyHive, PySpark etc. You are expected to be proficient in wiring complex SQL Queries and procedural scripts. Experience working in Data Warehouse and Data Lake will be highly desired.

No of Positions

1

Skills Required

• Good knowledge of scripting languages such as Python and Shell script
• Experience with Hadoop v2 and Spark
• Expert level skills in SQL and PL/SQL
• Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
• Management of Hadoop cluster, with all included services and ability to solve any ongoing issues with operating the cluster

Good to have

• Experience in real-time streaming data processing with Spark/Kafka/Kinesis
• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
• Experience with Google Cloud Platform, AWS etc

Roles & Responsibilities

• Interface with onsite/offshore team to gather, understand, and translate requirements related to Data Extraction and Big Data Processing into the delivery process.
• Work closely with other Engineers to provide technical requirements and implementation details.
• Develop Python scripts for data extraction
• Deploy, Run, and Debug the scripts developed by the team
• Ensure continuous improvement in data engineering excellence by implementing best practices for coding, testing, and deploying.

Experience

3 8 years

Location

Hyderabad