Job Summary:
Lowe's Forecasting team is seeking an experienced Data Engineer in Machine Learning. You will build, maintain, and optimize state-of-the-art pipelines for our predictive models. Lowe's is a rapid - growing retail company (ranked 31st on 500 fortune 2020) with millions of customers and billions of records. Join us if you are also excited about improving our production/ pipelines to practical, scalable, time and memory efficient, reliable applications. Here at Lowe's Forecasting, you will have the freedom and ownership to lead cutting-edge researches and impactful projects, in a collaborative and flexible environment with great work-life balance.

Key Responsibilities:

• Translates business requirements and specifications into logical program designs, modules, stable application systems, and data solutions with occasional guidance from senior colleagues; partners with Product Team to understand business needs and functional specifications
• Develops, configures, or modifies integrated business and/or enterprise application solutions within various computing environments by designing and coding component-based applications using various programming languages
• Conducts the implementation and maintenance of complex business and enterprise data solutions to ensure successful deployment of released applications
• Supports systems integration testing (SIT) and user acceptance testing (UAT), provides insight into defining test plans, and ensures quality software deployment
• Participates in the end-to-end product lifecycle by applying and sharing an in-depth understanding of company and industry methodologies, policies, standards, and controls
• Understands Computer Science and/or Computer Engineering fundamentals; knows software architecture and readily applies this to Data or Platform solutions
• Automates and simplifies team development, test, and operations processes; develops conceptual, logical, and physical architectures consisting of one or more viewpoints (business, application, data, and infrastructure) required for business solution delivery
• Solves difficult technical problems; solutions are testable, maintainable, and efficient

Data Engineering Responsibilities

• Supports the build, maintenance, and enhancements of data lake development; supports simple to medium complexity API, unstructured data parsing and streaming data ingestion
• Excels in one more domain; understands pipelines and business metrics
• Builds, tests, and enhances data curation pipelines integration data from a wide variety of sources like DBMS, File systems and APIs for various KPIs and metrics development with high data quality and integrity
• Supports the development of feature / inputs for data models in an Agile manner
• Works with Data Science team to understand mathematical models and algorithms; participates in continuous improvement activities including training opportunities; continuously strives to learn analytic best practices and apply them to daily activities
• Handles data manipulation (extract, load, transform), data visualization, and administration of data and systems securely and in accordance with enterprise data governance standards
• Maintains the health and monitoring of assigned analytic capabilities for a specific data engineering solution; ensures high availability of the platform; monitors workload demands; works with Technology Job Description Page 2 of 3 Infrastructure Engineering teams to maintain the data platform; serves as an SME of one or more application

Minimum Qualifications:

• Bachelor's Degree in Engineering, Computer Science, CIS, or related field (or equivalent work experience in a related field)
• 2 years of experience in Data, BI or Platform Engineering, Data Warehousing/ETL, or Software Engineering
• 1 year of experience working on project(s) involving the implementation of solutions applying development life cycles (SDLC)

Data Engineering Qualifications:

• 2 years of experience in Hadoop or any Cloud Bigdata components
• Expertise in Java/Scala/Python, SQL, Scripting, Teradata, Hadoop (Sqoop, Hive, Pig, Map Reduce), Spark (Spark Streaming, MLib), Kafka or equivalent Cloud Bigdata components

Preferred Qualifications:

• Degree in Computer Science, Engineering, Mathematics, Data Science, Analytics, Information System, or related quantitative field.
• 3 years hand-on experience in building robust, reliable, and scalable machine learning pipelines from ground up as well as transitioning from MVP to production (ingestion, scheduling, security, notifications, validation, backups, optimizations).
• Experience with CI/CD pipelines such as Concourse, Jenkins.
• Experience with distributed systems (Spark, Hive, HDFS, Hadoop, HBase, Druid, Cloudera, Kafka) along with Airflow to orchestrate data pipeline.
• Experience with process optimizations and fine-tuning existing applications in distributed computing environment.
• Write quality code in Python/Pyspark followed by unit tests and documentation.
• Experience in configuring/building data quality frameworks - PyDeequ, great expectations or any other tools to increase reliability.
• Define, execute, and operate monitoring and alerting steps over critical SLA's - (PrometheNagios, Grafana).
• Out-of-the box thinker and deep diver to provide efficient solutions to problems
• Agile development skills and experience.
• Data Science Exposure.

About Lowe's:
Lowe's Companies, Inc. (NYSE: LOW) is a FORTUNE® 50 home improvement company serving approximately 18 million customers a week in the United States and Canada. With fiscal year 2019 sales of $72.1 billion, Lowe's and its related businesses operate or service more than 2,200 home improvement and hardware stores and employ approximately 300,000 associates. Based in Mooresville, N.C., Lowe's supports its hometown Charlotte region and all communities it serves through programs focused on creating safe, affordable housing and helping to develop the next generation of skilled trade experts. For more information, visit Lowes.com.

About Lowe's in the Community:
As a FORTUNE® 50 home improvement company, Lowe's is committed to creating safe, affordable housing and helping to develop the next generation of skilled trade experts through nonprofit partnerships. Across every community we serve, Lowe's associates donate their time and expertise through the Lowe's Heroes volunteer program. For the latest news, visit Newsroom.Lowes.com or follow @LowesMedia on Twitter.

Lowe's is an equal opportunity affirmative action employer and administers all personnel practices without regard to race, color, religion, sex, age, national origin, disability, sexual orientation, gender identity or expression, marital status, veteran status, genetics or any other category protected under applicable law.