ETL Developer with Spark, AWS

  • Job Type: Contract Corp-To-Corp
  • Industry Type: IT Sector
  • Industry Location: Remote
  • Experience: NA
  • No. of Positions: 1
  • Primary Skills: AWS ETL
  • Secondary Skills: Spark
  • Job Location: Remote, Remote
  • Posted Date: Posted today
Job Description


  • Implement ETL routines on AWS
  • Contribute to CI/CD tools for continuous validation.
  • Understands when to automate and when not to.
  • Understand what it takes to create well architected applications for Cloud
  • Think of code and quality being owned by the entire team.
  • Identify code defects and work with other developers to address quality issues in functional code.
  • Find bottlenecks and thresholds in existing code through the use of automation tools.
  • Passion for continuing education and improving code quality.
  • Operational triage of bugs, failed test cases and system failures
  • Creating and optimizing infrastructure performance metrics
  • Participate in peer code reviews and pair programming
  • Deploying & developing cloud applications end to end
  • Working in stages of the environment lifecycle
  • Automation of manual data object creation and test cases
  • Ask smart questions, take risks and champion new ideas.


Skills and Experience Needed

  • Professional ETL experience using Spark (Python or Scala)
  • 2+ year experience designing technical solutions using object-oriented design concepts.
  • 1+ year of AWS solution engineering and architecture experience
  • 1+ year of CI/CD experience (Jenkins, Terraform, CloudFormation etc.)
  • Experience working with large data stores
  • Understanding of all aspects of database technologies - schema design, optimization, scalability, etc
  • Experience in SDLC, especially testing and deployment.
  • Understanding of different types of testing Unit, Acceptance, Regression, Performance, etc.
  • Experience or understanding of Test Driven Development (TDD) or Pair Programming desired
  • Knowledge of Unix-like operating system environments
  • Software version control (e.g. git working knowledge or greater)
  • Experience contributing to open source software projects.


  • AWS Certification
Relevant Job Openings
.Net Architects
Senior Data Engineer
Senior Data Engineer
Solution Architect
Java Developer
Big Data Developers with Scala