Mandatory Skills : Hadoop,Spark, Hive

Location : PAN INDIA

• Expertise working with large scale distributed systems (Hadoop, Spark, Hive).
• Strong understanding of the big data cluster, and its architecture
• Experience building and optimizing big data ETL pipelines.
• Advanced programming skills with Python, Java, Scala.
• Good knowledge of spark internals and performance tuning of spark jobs.
• Strong SQL skills and is comfortable operating with relational data models and structure.
• Experience with messaging systems like Kafka.
• Experience with No SQL databases, DashDB, etc.
• Expertise with Continuous Integration/Continuous Delivery workflows and supporting applications.
• Exposure to cloud environments and architectures. (Preferably AWS)
• Ability to work collaboratively with other teams.
• Experience with containerization using tools such as Docker will be added advantage.
• Strong knowledge of Linux and Bash. Can interact with the OS at the command line and create shell scripts to automate workflows.
• Advanced understanding of software development and collaboration, including experience with tools such as Git.
• Excellent written and verbal communication skills, comfortable presenting in front of non-technical audiences.
• Experience is orchestration tools like Airflow, Jenkins
• Experience in Apache Ni-Fi process