Bigshyft Hiring for Paytm

Data Engineer Big Data

  • Job Type: Full Time
  • Industry Type: IT Sector
  • Industry Location: Noida
  • Experience: 4-9yrs
  • No. of Positions: 10
  • Salary Range: 14-24 lac
  • Primary Skills: Hive MySQL Big Data Kafka
  • Secondary Skills: Spark
  • Job Location: Noida
  • Posted Date: 94 days ago
Job Description

What you'll do :-

  • Brainstorm and create new platforms that can help in our quest to make data available to cluster users in all shapes and forms, with low latency and horizontal scalability.
  • Make changes to our data platform, refactoring/redesigning as needed and diagnosing any problems across the entire technical stack.
  • Design and develop a real-time events pipeline for Data ingestion for real-time dash-boarding.
  • Develop complex and efficient functions to transform raw data sources into powerful,reliable components of our data lake.
  • Design & implement new components and various emerging technologies in Hadoop Eco System, and successful execution of various projects.
  • Monitor job performances, file system/disk-space management, cluster & database connectivity, log files, management of backup/security and troubleshooting various user issues.

 

What makes you a great fit :-

  • Strong hands-on experience with Hadoop, MapReduce, Hive, Spark.
  • Excellent programming/debugging skills in Java/Scala.
  • Experience with any scripting language such as Python, Bash etc.
  • Good to have experience of working with noSQL databases like Hbase, Cassandra.
  • Hands on programming experience with multithreaded applications.
  • Good to have experience in Database, SQL, messaging queues like Kafka.
  • Good to have experience in developing streaming applications eg Spark Streaming, Flink, Storm, etc.
  • Good to have experience with AWS and cloud technologies such as S3
  • Experience with caching architectures like Redis, Memcached etc.
Relevant Job Openings
Senior Software lead Engineer Python sdn Development
MNC Hiring For Data Scientist Analyst Gurgaon
Urgent Opening For Data Scientist
Full Stack Developer Nodejs
IOS Developer
WordPress Developer PHP Magento