2coms

Sr Data Engineer Big Data Bangalore

  • Job Type: Full Time
  • Industry Type: IT Sector
  • Industry Location: Bangalore/Bengaluru, Bangalore North
  • Experience: 2-7yrs
  • No. of Positions: 10
  • Salary Range: 2-2 lac
  • Primary Skills: bigdata data analyst
  • Secondary Skills: Big Data
  • Job Location: Bangalore/Bengaluru, Bangalore North
  • Posted Date: 59 days ago
Job Description

Urgent Hiring Experienced Big data Developer in a Leading Brand Company

 
Client Details :
Our client is a is pioneering what AI and analytics can do to solve some of the toughest problems faced by organizations globally. We develop bespoke solutions powered by data and technology for several Fortune 500 companies.

Location
: Bangalore
 
Responsibilities:
 
  • As a Data Engineer, you will build a variety of big data analytics solutions, including big data lakes. More specifically, you will:
  • Design and build scalable data ingestion pipelines to handle real time streams, CDC events, and batch data
  • Execute high-performance data processing for structured and unstructured data, and data harmonization
  • Schedule, orchestrate, and validate pipelines
  • Design exception handling and log monitoring for debugging
  • Make tech stack and tools related decisions
  • Collaborate with business consultants, data scientists, and application developers to develop analytics solutions
 


Requirements

Hands-on experience with:

  • Hadoop ecosystem - HDFS, Hive, Sqoop, Kafka, ELK Stack etc
  • Spark, Scala, Python and core/advance Java
  • NOSQL databases e.g. Hbase, Cassandra, MongoDB
  • Relevant AWS or Azure components required to build big data solutions
  • Good to know: Databricks, Snowflake
  • Ability to develop and manage scalable Hadoop cluster environments
  • Good understanding of data warehousing concepts, distributed systems, data pipelines, ETL
  • 5-10 years of tech experience with at least 3 years in big data engineering
 

 

Relevant Job Openings
Senior Backend Developer
Backend Developer
UI Staff Software Engineer
Software Engineer
Lead Data Engineer Spark AWS
GCP Architect