Job description

Costco IT is responsible for the technical future of Costco Wholesale, the third largest retailer in the world with wholesale operations in fourteen countries. Despite our size and explosive international expansion, we continue to provide a family, employee centric atmosphere in which our employees thrive and succeed. As proof, Costco ranks eighth in Forbes “World’s Best Employers” .

This is an environment unlike anything in the high-tech world and the secret of Costco’s success is its culture. The value Costco puts on its employees is well documented in articles from a variety of publishers including Bloomberg and Forbes. Our employees and our members come FIRST. Costco is well known for its generosity and community service and has won many awards for its philanthropy. The company joins with its employees to take an active role in volunteering by sponsoring many opportunities to help others.

Come join the Costco Wholesale IT family. Costco IT is a dynamic, fast-paced environment, working through exciting transformation efforts. We are building the next generation retail environment where you will be surrounded by dedicated and highly professional employees.

Data Engineers are responsible for developing and operationalizing data pipelines/integrations to make data available for consumption (i.e. Reporting, Data Science/Machine Learning, Data APIs, etc.). This includes data ingestion, data transformation, data validation/quality, data pipeline optimization, orchestration; and deploying code to production via CI/CD. The Data Engineer role requires knowledge of software development/programming methodologies, various data sources (Relational Databases, flat files (csv, delimited), APIs, XML, JSON, etc.), data access (SQL, Python, etc.), followed by expertise in data modeling, cloud architectures/platforms, data warehousing, and data lakes. This role also will partner closely with Product Owners, Data Architects, Platform/DevOps Engineers, etc. to design, build, test, implement, and maintain data pipelines.

The Data Engineer is responsible for developing data pipelines and/or data integrations of test data for Costco’s enterprise certified data sets that are used for business-critical data consumption use cases (i.e. Reporting, Data Science/Machine Learning, Data APIs, etc.). At Costco, we are on a mission to significantly leverage data to provide better products and services for our members. This role is focused on data engineering to build and deliver data pipelines that will deliver data securely for use by Costco business groups. The Data Engineer will partner with product owners, data architects, and data platform teams to design, build, test, and automate data pipelines that are relied upon across the company as the single source of truth.

If you want to be a part of one of the worldwide BEST companies “to work for”, simply apply and let your career be reimagined.

ROLE

  • Implements streaming data pipelines using event/message-based architectures.
  • Works in tandem with Data Architects to align on data architecture requirements provided by the requestor.
  • Defines and maintains optimal data pipeline architecture.
  • Identifies, designs, and implements internal process improvements: automating manual processes, optimizing data delivery/orchestration.
  • Analyzes data to spot anomalies, trends, and correlate data to ensure Data Quality.
  • Performs peer review for another Data Engineer’s work.
  • Develops and operationalizes data pipelines to bring data into the various test environments used for the development of our certified data sets.
  • Works in tandem with Data Architects, Data Stewards, and Data Quality Engineers to design data pipelines and recommends ongoing optimization of data storage, data ingestion, data quality, and orchestration.
  • Designs, develops, and implements ETL/ELT/CDC processes using Informatica Intelligent Cloud Services (IICS), Azure Data Factory, AWS Glue, dbt, and other ETL products.
  • Uses Azure services such as Azure SQL DW (Synapse), ADLS, Azure Event Hub, Cosmos, Databricks, and Delta-Lake to improve and speed delivery of our data products and services.
  • Implements big data and NoSQL solutions by developing scalable data processing platforms to drive high-value insights to the organization.
  • Identifies ways to improve data reliability, efficiency, and quality of data management.
  • Communicates technical concepts to non-technical audiences both in written and verbal form.

Required

  • 5+ years’ experience engineering and operationalizing data pipelines with large and complex datasets.
  • 2+ years’ hands-on experience with Informatica IICS, Azure Data Factory, AWS Glue, or other ETL tools.
  • 3+ years’ experience working with Cloud technologies such as ADLS, Azure Databricks, Spark, Azure Synapse, Cosmos DB, and other big data technologies.
  • 5+ years’ experience with Data Pipeline, ETL, and Data Warehousing.
  • Extensive experience working with various data sources (DB2, SQL,Oracle, flat files (csv, delimited), APIs, XML, JSON.
  • Experience implementing data integration techniques such as event/message-based integration (Kafka, Azure Event Hub), ETL.
  • Advanced SQL skills; solid understanding of relational databases and business data; ability to write complex SQL queries against a variety of data sources.
  • Strong understanding of database storage concepts (data lake, relational databases, NoSQL, Graph, data warehousing).
  • Experience with Git/Azure DevOps.

Required Documents

  • Cover Letter
  • Resume

California applicants, please click here to review the Costco Applicant Privacy Notice.

Pay Ranges

Level 2 - $105,000 - $135,000

Level 3 - $130,000 - $160,000

We offer a comprehensive package of benefits including paid time off, health benefits - medical/dental/vision/hearing aid/pharmacy/behavioral health/employee assistance, health care reimbursement account, dependent care assistance plan, short-term disability and long-term disability insurance, AD&D insurance, life insurance, 401(k), stock purchase plan to eligible employees.

Costco is committed to a diverse and inclusive workplace. Costco is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or any other legally protected status. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to IT-Recruiting@costco.com

If hired, you will be required to provide proof of authorization to work in the United States. In some cases, applicants and employees for selected positions will not be sponsored for work authorization, including, but not limited to H1-B visas.

Please let the company know that you found this position on this Job Board as a way to support us, so we can keep posting cool jobs.

Similar jobs

Browse All Jobs
Amazon
October 30, 2024
Devire
October 30, 2024
Exadel
October 30, 2024