E-Solutions, Inc.

Senior Big Data Engineer
  • Job Type: Contract W2
  • Industry Type: IT Sector
  • Industry Location: City of Dallas
  • Experience: NA
  • No. of Positions: 1
  • Primary Skills: BIGDATA BIG DATA APACHE
  • Secondary Skills: KAFKA JAVA
  • Job Location: City of Dallas, Texas
  • Posted Date: Posted today
Job Description

Hi
Please go through the job description and let me know your interest.

Job Title: Senior Big Data Engineer
Location: Bristol, CT
Mode : Fulltime
Domain: Big Data
Skillset: Coding and Database / AWS / Snowflake / Python

 

Description Basic Qualifications
  • We need an experienced Data Engineer who drive multiple data initiatives applying innovative architecture that can scale in the cloud.
  • We are looking for a creative and talented individual who loves to design a scalable platform which scale at peta-byte level and extract value from both structured and unstructured real-time data. Specifically, we are looking for a technology leader to build a highly scalable and extensible Big Data platform which enables collection, storage, modeling, and analysis of massive data sets from numerous channels.
  • The internet-scale platforms that you design, and build will be a core asset in the delivering the highest quality content to over 150MM+ consumers on monthly basis. This is an opportunity to fundamentally evolve how Client delivers content and monetizes our audiences.
 Build scalable analytics solution, including data.

JOB DESCRIPTION
  • Processing, storage, and serving large-scale data through batch and stream, analytics for both behavioral & ad revenue through digital & non-digital channels. Harness curiosity Change the way how we think, act, and utilize our data by performing exploratory and quantitative analytics, data mining, and discovery.
  • Whiteboard solutions at the macro and granular level and debate technical solutions with data architects and Data Engineers. Innovate and inspire Think of new ways to help make our data platform more scalable, resilient, and reliable and then work across our team to put your ideas into action.
  • Think at scale - Lead the transformation of a peta-byte scale batch-based processing platform to a near real-time streaming platform using technologies such as Apache Kafka, Spark, and other open-source frameworks.
  • Cleary communicate design & development strategies to all stake holders, educate them as and when needed. Have pride Ensure performance isn't our weakness by implementing and refining robust data processing using Java, Scala, and other database technologies such as Snowflake.
  • Continuously re-assess the cloud compute capabilities to optimize environment, infrastructure and get the best value and performance out of cloud assets.
  • Lead and coach Mentor other software engineers by developing re-usable frameworks. Review design and code produced by other engineers.
  • Assist in the preparation of presentations and formal analysis in support of executive decision making and strategy development.
  • Build and Support Embrace the DevOps mentality to build, deploy support applications in cloud with minimal help from other teams
  • You are also very handy with big data framework such as Hadoop, Apache Spark, No-SQL systems such as Cassandra or DynamoDB, Streaming technologies such as Apache Kafka; Understand reactive programming and dependency injection such as Spring to develop REST services.
  • Have a technology toolbox Hands on experience with newer technologies relevant to the data space such as Spark, Airflow, Apache Druid, Snowflake (or any other OLAP databases).
  • Cloud First - Plenty of experience with developing and deploying in a cloud native environment preferably AWS cloud.
  • Embrace Client Work with data scientists to operationalize machine learning models and build apps to make use of power of machine learning.
  • Problem solver Enjoy new and meaningful technology or business challenges which require you to think out of the box.

Preferred Qualifications - 10+ years of experience developing data driven application using mix of languages (Java, Scala, Python, SQL etc.) and open-source frameworks to implement data ingest, processing, and analytics

Required Education BS
Preferred Education
Additional Information INTAKE- This is a remote role- Team sits in CT.

Day to Day responsible for leading a squad- lead application work with data engineers and product owners- to complete all work

Code experience- Java/Scala/spark/kafka/ AWS/ Snowflake

Expertise to complete development work

Snowflake is definitely preferred
Database experience is a big plus


Thanks
Prisca
408 708 3892

Disclaimer:
E-Solutions provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state and local laws. We especially invite women, minorities, veterans, and individuals with disabilities to apply. EEO/AA/M/F/Vet/Disability.

Relevant Job Openings
Tableau developer
Azure Data Architect with Talend
Azure Cloud Architect
Senior Java Developers
Senior Data Engineer
Senior Data Engineer