Data Engineer

Job Summary

The primary purpose of this role is to translate business requirements and functional specifications into logical program designs and to deliver modules, stable application systems, and Data or Platform solutions. This includes developing, configuring, or modifying integrated business and/or enterprise infrastructure or application solutions within various computing environments. This role facilitates the implementation and maintenance of business and enterprise Data or Platform solutions to ensure successful deployment of released applications.

Key Responsibilities:

• Translates business requirements and specifications into logical program designs, modules, stable application systems, and data solutions with occasional guidance from senior colleagues; partners with Product Team to understand business needs and functional specifications
• Develops, configures, or modifies integrated business and/or enterprise application solutions within various computing environments by designing and coding component-based applications using various programming languages
• Conducts the implementation and maintenance of complex business and enterprise data solutions to ensure successful deployment of released applications
• Supports systems integration testing (SIT) and user acceptance testing (UAT), provides insight into defining test plans, and ensures quality software deployment
• Participates in the end-to-end product lifecycle by applying and sharing an in-depth understanding of company and industry methodologies, policies, standards, and controls
• Understands Computer Science and/or Computer Engineering fundamentals; knows software architecture and readily applies this to Data or Platform solutions
• Automates and simplifies team development, test, and operations processes; develops conceptual, logical and physical architectures consisting of one or more viewpoints (business, application, data, and infrastructure) required for business solution delivery
• Solves difficult technical problems; solutions are testable, maintainable, and efficient
• Supports the build, maintenance and enhancements of data lake development; supports simple to medium complexity API, unstructured data parsing and streaming data ingestion
• Excels in one more domain; understands pipelines and business metrics
• Builds, tests and enhances data curation pipelines integration data from a wide variety of sources like DBMS, File systems and APIs for various KPIs and metrics development with high data quality and integrity
• Supports the development of feature / inputs for data models in an Agile manner
• Works with Data Science team to understand mathematical models and algorithms; participates in continuous improvement activities including training opportunities; continuously strives to learn analytic best practices and apply them to daily activities
• Handles data manipulation (extract, load, transform), data visualization, and administration of data and systems securely and in accordance with enterprise data governance standards
• Maintains the health and monitoring of assigned analytic capabilities for a specific data engineering solution; ensures high availability of the platform; monitors workload demands; works with Technology Job Description Page 2 of 3 Infrastructure Engineering teams to maintain the data platform; serves as an SME of one or more application
• Supports the build, maintenance and enhancements of BI solutions; creates standard and ad hoc reports; uses basic report formatting like sorting, totaling, and exporting
• Excels in one or more domains; understands pipelines and business metrics
• Demonstrates database skill (Teradata/Oracle/Db2/Hadoop) by constructing Logical SQL statements, validating MicroStrategy Report SQL and DB SQL for data testing, and using MicroStrategy Web
• Builds, tests and enhances BI solutions from a wide variety of sources like DBMS and File systems; develops solutions with high data quality and integrity
• Works with business analysts to understand the requirements and create dashboard/dossiers wireframes
• Provides daily monitoring of jobs/cubes, and overall health of the platform; resolves user access requests; works on data tickets and enhancements; monitors Enterprise Manager loads; works on creating the reports on Enterprise Manager metrics
• Deploys and maintains a Hadoop cluster, adding and removing nodes using cluster monitoring tools like Ganglia Nagios or Cloudera Manager, configuring the Name Node high availability, and keeping track of all the running Hadoop jobs
• Implements, manages and administers the overall Hadoop infrastructure
• Works closely with the Data Engineer, Network, BI and Application teams to make sure that all the big data applications are highly available and performing as expected
• Completes capacity planning and estimating of the requirements for lowering or increasing the capacity of the Hadoop cluster
• Sets up / migrates job between on-prem to cloud, using knowledge of cloud networking and IAM

Qualifications

Minimum Qualifications

• Bachelor's Degree in Engineering, Computer Science, CIS, or

EEO Statement

Lowe’s is an equal opportunity employer and administers all personnel practices without regard to race, color, religious creed, sex, gender, age, ancestry, national origin, mental or physical disability or medical condition, sexual orientation, gender identity or expression, marital status, military or veteran status, genetic information, or any other category protected under federal, state, or local law.

Pay Range for Colorado, New York, and New Jersey : $54,000.00 - $140,000.00 annually

Starting rate of pay may vary based on factors including, but not limited to, position offered, location, education, training, and/or experience. For information regarding our benefit programs and eligibility, please visit https://talent.lowes.com/us/en/benefits. Pay Range for Colorado, New York, and New Jersey : $54,000.00 - $140,000.00 annually Starting rate of pay may vary based on factors including, but not limited to, position offered, location, education, training, and/or experience. For information regarding our benefit programs and eligibility, please visit https://talent.lowes.com/us/en/benefits.