Huquo Consulting Pvt. Ltd

Data Engineer Python Spark Big Data

  • Job Type: Full Time
  • Industry Type: IT Sector
  • Industry Location: Bangalore/Bengaluru
  • Experience: 4-9yrs
  • No. of Positions: 10
  • Salary Range: 4-10.8 lac
  • Primary Skills: Data Pipeline Hadoop Big Data Azure Databricks Data Warehousing Spark Data Analytics
  • Secondary Skills: ETL AWS SQL Python
  • Job Location: Bangalore/Bengaluru
  • Posted Date: 392 days ago
Job Description

 

R- BIG QUERY+ BIG DATA/ANALYTICS/PYSPARK

 

Job Responsibilities :

- Use different data warehousing concepts to build a data warehouse for reporting purpose

- Assist Analytics/ Reporting teams in setting up data pipelines & monitoring daily jobs

- Lead and provide guidance to junior members in team. Oversee project life cycle from intake through delivery

- Responsible for Planning, Architecture and Design for journey towards Spark, Hadoop Big Data and cloud solutions like AWS, Databricks, etc

- Develop and test ETL components to high standards of data quality and act as hands-on development lead

Must have :

- 4+ years of experience in ETL (or) data engineering role in an analytics environment

- Bachelor's degree from Tier I colleges (Comp. Sci degree preferred not mandatory)

- Expertise in building data pipelines in Big data platforms; Good understanding of Data warehousing concepts

- Knowledge of Shell scripting, SQL, Python & some of the standard data science packages (Pandas, Numpy, etc.)

- Prior Exposure- to Big Data Technologies (Spark, Hadoop, Hive & so on)

- Exposure to ETL software like Talend, Informatica, etc. is a plus; Not Mandatory

- Strong verbal and business communication skills

- Strong business acumen & demonstrated an aptitude for analytics that incite action

Relevant Job Openings
Python Developer
Python Developer
Immediate Hiring For IOS Developer Hyderabad