Job description

We are looking for an AWS Data Engineer with 5+ years of experience to join our team for one of our well-known client. You will use various methods to transform raw data into useful data systems. Overall, youll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of learning machine methods.

Roles & Responsibilities

• 5-7 years of Python scripting knowledge is required. Experience in designing Data
  Ingestion/Data Integration jobs & pipelines using Pyspark.
• Java Data Engineering experience is good to have.
• Expert Level SQL 7 Data System knowledge.
• AWS platform Experience. Experience using AWS EMR, S3, IAM and other services.
• Experienced in writing Airflow DAGS, working on Snowflake or Redshift data warehouses, Git version control, DevOps setup and CICD
• Knowledge of bash commands.
• Experienced with working on JSON, Rest API & SOAP APIs
• Experienced in working at least one Data Integration/ETL tool.
• 2-4 years in working on lien facing Data Warehousing Data Lake , Data Migration and related projects.
• Clear and precise communication skills. A quick learner is able to pick up new technologies.

Good to have:

• Experienced in working on Snowflake.
• Experienced in working on Test cases using pytest/ unit test or any other framework. Experienced in working on Jenkins, Jira, Bitbucket, AWS Appstream, AWS SSO, SonarQube and Zscaler .