Senior Data Engineer

Posted to IASSIST on: 2022-10-05

Employer: ICPSR

Employer URL: https://icpsr.umich.edu/

Description

Senior Data Engineer

Job Opening ID: 220911

Working Title: Senior Data Engineer

Job Title: App Programmer/Analyst Sr

Work Location: Ann Arbor Campus, Ann Arbor, MI

Full/Part Time: Full-Time

Regular/Temporary: Regular

FLSA Status: Exempt

Organizational Group: Inst Soc Research

Department: ICPSR

Posting Begin/End Date: 11/16/2022 - 1/10/2023

Salary: $95,000.00 - $115,000.00

Career Interest: Information Technology

Summary

The Inter-university Consortium for Political and Social Research (ICPSR) is embarking on a 5 year project to build a cloud-native platform for delivering digital social science artifacts to a global research community, and we need a Data Engineer to join our team. We focus on delivering value quickly in an Agile environment that fosters creativity, exploration, and learning. As a member of our team, you will help implement a microservices-based architecture using technologies such as Apache Airflow, RedHat OpenShift, NoSQL databases, and AWS services. You will be supported by a small, diverse team committed to delivering high-quality products and an exceptional user experience through modern development and delivery practices. If you love creating secure, scalable, resilient data pipelines within a test-driven development framework, and can coach others in best practices, we want to talk to you!

You will report to the Data Engineering Lead.

Responsibilities

  • Author production-quality ETL workflows running in a distributed, containerized, cloud-native environment to support ingestion, transformation, and dissemination of complex social science research data and metadata from a variety of data sources.
  • Apply best practices in software development and data management to improve curation workflows in our secure data environment by building a library of reusable scripts and tools orchestrated by automated data pipelines.
  • Develop secure, scalable, and resilient APIs to expose data as a service to upstream producers and downstream consumers.
  • Support development teams in all aspects of data management, from the conceptual modeling stage through to the application of data governance policies.
  • Implement monitoring solutions for data engineering products and provide operational support to pipelines and APIs in production.
  • Research and identify open source and COTS tools to solve challenging problems while minimizing the need for custom code.
  • Mentor curation staff on data engineering best practices.

Required Qualifications

  • Bachelor’s degree in computer science, a related field, or equivalent experience.
  • Five or more years’ experience using Python for data engineering projects.
  • Five or more years’ experience with relational database management using SQL.
  • Three or more years’ experience in building production-quality data pipelines using a modern ETL, data integration, or data orchestration framework.
  • Three or more years’ experience building interfaces with heterogeneous data sources and sinks including REST APIs.
  • Three or more years’ experience with Linux and shell scripting.

Desired Qualifications

  • Knowledge of data management fundamentals such as data modeling and governance.
  • Experience managing data pipelines in production using monitoring tools such as Prometheus or Grafana and log indexers such as Elasticsearch or Splunk.
  • Knowledge of NoSQL databases, in particular graph databases or triple stores.
  • Understanding of distributed microservices architectures and their orchestration using tools like Kubernetes.
  • Experience with cloud storage and computing (AWS experience preferred).

Work Locations

We have returned to in-person work at our offices in Ann Arbor, MI, but we support hybrid work schedules. Part of this job may require some work outside normal working hours to analyze and correct critical problems that arise in ICPSR’s 24 hours per day operational environment.

Underfill Statement

The requirements listed reflect a senior-level expectation with an attendant salary range of $95,000 - $115,000. Candidates with lesser experience are encouraged to apply and may be considered if the primary goal is not met. Lesser-experienced candidates will be reviewed at the intermediate level, which requires at least 3 years of experience with a salary range of $80,000 - 95,000.

Additional Information

The Institute for Social Research at the University of Michigan wants to employ a diverse workforce as a reflection of our commitment to serve the diverse people of Michigan, to maintain the excellence of the university, and to ground our research in varied disciplines, perspectives, and ways of knowing and learning.

Benefits at the University of Michigan

In addition to a career filled with purpose and opportunity, The University of Michigan offers a comprehensive benefits package to help you stay well, protect yourself and your family and plan for a secure future. Benefits include:

  • Generous time off
  • A retirement plan that provides two-for-one matching contributions with immediate vesting
  • Many choices for comprehensive health insurance
  • Vision, dental, and life insurance
  • Long-term disability coverage
  • Flexible spending accounts for healthcare and dependent care expenses
  • Tuition reimbursement

Learn More About U-M Benefits

Application Deadline

Institute for Social Research job openings are posted for a minimum of fourteen (14) calendar days. This opening may be removed from posting boards and filled any time after the minimum posting period has ended.

U-M EEO/AA Statement

The University of Michigan is an equal opportunity/affirmative action employer.

Job Location

Ann Arbor, MI

More info/apply URL: https://careers.umich.edu/job_detail/220911/senior-data-engineer

Archived on: 2022-11-28