Core Compete Pvt. Ltd.

Architect Data Engineering

  • Job Type: Full Time
  • Industry Type: IT Sector
  • Industry Location: Hyderabad/Secunderabad, Pune
  • Experience: 12-15yrs
  • No. of Positions: 2
  • Salary Range: 14-18 lac
  • Primary Skills: Airflow Hive Hadoop Big Data Spark Data Warehousing
  • Secondary Skills: AWS SQL Python Solution Architecture
  • Job Location: Hyderabad/Secunderabad, Pune
  • Posted Date: 384 days ago
Job Description

 

Job Title: Architect-Data Engineering

Experience 12+ Years

Location: Hyderabad/Pune

 

Job Overview -

 

Core Compete, a leader in Cloud Analytics, is now part of the Accenture Applied Intelligence (AI) team. To know more, read here.

Our capabilities in Cloud Data Warehousing, AI & ML Innovation, Analytics Application Modernization, and Intelligent Decisioning, have helped global Fortune 1000 companies to develop and deploy modern cloud-based analytical solutions. Our clients are in financial services, retail, manufacturing, and media. We have our employees spread across U.S., U.K., and India who specialize in cloud engineering, software engineering, data engineering, managed services, data science, and business consulting. We are a top-tier partner with AWS, Google Cloud, Azure, SAS, Snowflake, Databricks, and others, with 500+ certifications completed by our team members. We are a certified Great Place to Work (GPTW) company and our employees rate us highly on being the best place to learn and grow.

 

As an architect, you will be responsible for the technical architecture, design, and delivery of scalable data-driven solutions for our clients. You would be responsible for working with the sales team in pre-sales engagements, interacting with clients understanding their business needs, and defining and designing optimal solutions to meet their needs. Building data pipelines, tools, and accelerators to bring pace to the development and reduce implementation timelines. Guiding delivery teams in organizing and managing the work.

 

Job Duties and Responsibilities -

  • Provide architecture and solutioning help in large-scale distributed systems, especially those involving Hadoop, Spark, NoSQL databases, and analytical programming languages (Python is preferred).
  • Analyse multiple sources of structured and unstructured data to propose and design data architecture solutions for scalability, high availability, fault tolerance, and elasticity.
  • Conceptualize and visualize data frameworks.
  • Expertise in Cloud-Based (AWS preferred, GCP, Axure) solutions and platforms.
  • Document and lead design reviews and provide input to the design recommendations.
  • Explore new technologies and mentor/coach the team on them.
  • Provide estimations for proposals
  • Create project plans to deliver services to new clients and allocate consultants for implementation.
  • Manage customer expectations through effective communication of timely status updates.
  • Take ownership of your work as well as the teams and be accountable for the quality of work done.

 

Required Skills and Experience

  • Experience in Cloud-Based (AWS preferred) solutions and platforms with big data and analytical solutions.
  • Experience in Requirements Engineering, Solution Architecture, Design, Development, and Deployment
  • Experience in Monitoring technologies, Big data backup strategies, and Virtualization environments8 to 14 years of technology-related experience.
  • 3 to 4 years of experience in Big Data Consulting and associated management roles
  • Must have hands-on experience on Spark, Hadoop, Hive, Python/Scala, and SQL
  • ETL/ELT experience is a must.
  • Experience with Orchestration and monitoring tools such as Apache Airflow and Cloud Composer.
  • Exposure to Data Governance, Security, and Data management best practices.
  • Proven experience with managing 24/7 business-critical applications
  • Outstanding verbal and written communication skills for both technical and non-technical audiences
  • Have a passion for customer success.
  • Ability to work comfortably in ambiguous situations and ability to optimize teams resources to achieve business goals.
  • In-depth understanding of BI and Analytics Solution Architecture
  • Should be able to benchmark systems, analyze system bottlenecks and propose solutions to eliminate them.
  • Able to perform a detailed analysis of business problems and technical environments and use this in designing the solution.
  • Capable of working creatively and analytically in a problem-solving environment.
  • Must be able to clearly articulate the pros and cons of various technologies and platforms.
  • Mentor team members in areas of big data development and architecture.

 

Travel
The role may require traveling globally up to 50% of the time.

 

Education Preference:

Bachelors/Masters degree preferably in Computer Science, Computer Engineering, or related discipline

Relevant Job Openings
Python Developer
Python Developer
Immediate Hiring For IOS Developer Hyderabad