Huquo Consulting Pvt. Ltd

Data Engineer Python Spark Big Data

  • Job Type: Full Time
  • Industry Type: IT Sector
  • Industry Location: Bangalore/Bengaluru
  • Experience: 5-10yrs
  • No. of Positions: 11
  • Salary Range: 6-12 lac
  • Primary Skills: Data Science Pyspark Hive Big Data Analytics Data Engineering Hadoop
  • Secondary Skills: Spark Numpy Python SQL
  • Job Location: Bangalore/Bengaluru
  • Posted Date: 384 days ago
Job Description

R- BIG QUERY+ BIG DATA/ANALYTICS/PYSPARK

Job Responsibilities :

- Use different data warehousing concepts to build a data warehouse for reporting purpose

- Assist Analytics/ Reporting teams in setting up data pipelines & monitoring daily jobs

- Lead and provide guidance to junior members in team. Oversee project life cycle from intake through delivery

- Responsible for Planning, Architecture and Design for journey towards Spark, Hadoop Big Data and cloud solutions like AWS, Databricks, etc

- Develop and test ETL components to high standards of data quality and act as hands-on development lead

Must have :

- 4+ years of experience in ETL (or) data engineering role in an analytics environment

- Bachelor's degree from Tier I colleges (Comp. Sci degree preferred not mandatory)

- Expertise in building data pipelines in Big data platforms; Good understanding of Data warehousing concepts

- Knowledge of Shell scripting, SQL, Python & some of the standard data science packages (Pandas, Numpy, etc.)

- Prior Exposure- to Big Data Technologies (Spark, Hadoop, Hive & so on)

- Exposure to ETL software like Talend, Informatica, etc. is a plus; Not Mandatory

- Strong verbal and business communication skills

- Strong business acumen & demonstrated an aptitude for analytics that incite action

Relevant Job Openings
Python Developer
Python Developer
B2B Inside Sales Executive
Immediate Hiring For IOS Developer Hyderabad