Work closely with analytics team members to optimize the companys data systems and pipeline architecture
Design and build the infrastructure for data extraction, preparation, and loading of data from spark & kafka
Build various data & analytics tool
Required Candidate profile
Software Development in Spark, Scala, Hadoop, Python & Hbase with minimum 3 years relevant experience.
Relational SQL and NoSQL databases
Data pipeline/workflow mgt tools such as Azkaban and Airflow