QuEST Global Engineering Services Private Limited

Data Engineer
  • Job ID: 6KNIKWSHVT
  • Job Type: Full Time
  • Industry Type: IT Sector
  • Industry Location: Bangalore/Bengaluru
  • Experience: 4-6yrs
  • No. of Positions: 10
  • Salary Range: 4-7 lac
  • Primary Skills: Airflow Azure Data Factory NoSQL Hadoop Cassandra Big Data Kafka
  • Secondary Skills: Spark Tableau SQL Python
  • Job Location: Bangalore/Bengaluru
  • Posted Date: 6 days ago
Job Description
Data Engineer

Bangalore (Bengaluru)

Karnataka

India

Job Description

Responsibilities
.Expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.
.Support software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.
.Create and maintain optimal data pipeline architecture.
.Assemble large, complex data sets that meet functional / non-functional business requirements.
.Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
.Develop real-time data ingestion pipelines

Mandatory Skills:
.A successful history of manipulating, processing and extracting value from large disconnected datasets.
.Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
.Experience in Develop data pipelines using Azure Data Factory, SQL data base & Data Lake, Databricks
.Experience with big data tools: Hadoop, Spark, Kafka, etc.
.Experience with relational SQL and NoSQL databases, including Cosmos DB , Postgres and Cassandra.
.Experience with object-oriented/ object function scripting languages: Python
Secondary Skills:
.Experience with data pipeline and workflow management tools: Azure Monitor, Azkaban, Luigi, Airflow, etc.
.Experience with stream-processing systems: Spark-Streaming.
.Reporting tools: Power BI, tableau etc

Good to have:
.Experience with AWS cloud services: EC2, EMR, RDS, Redshift
.Understanding of messaging infrastructure like event hub, service bus & notification hub.
.Experience with stream-processing systems: Storm

Capabilities
.Takes strong initiative and ownership
.Good at communicating within team as well as with all stake holders
.Strong customer focus & Highly proactive
.Experience supporting and working with cross-functional teams in a dynamic environment.
.Good at decision making

Education Type

B.E/B.Tech/ BS- Computer Science

Job Type

Full Time-Regular

Experience Level

Entry Level

Total Years of Exp

4 to 6

Relevant Skill Jobs
Senior Software Engineering SME
Azure Data Engineer SSR
Mobile Application IOS Developer
Senior Devops Engineer
Opportunity with Infogain For Database Architect Only
Senior Java Architect