"Data Engineer II"

Data Engineer II

The Data Engineer II helps advance oncology research and patient care by enabling the generation, management, and interpretation of clinical and research data at Dana-Farber Cancer Institute in collaboration with Boston Children’s Hospital and other partners. This role contributes to the development and maintenance of databases, scalable ETL pipelines, automated quality monitoring, and the integration of data into consumer applications while leveraging cloud infrastructure and APIs.

The Data Engineer II translates stakeholder requirements into data resource designs, documents data lineage, and builds metrics and dashboards to optimize ETL performance and data quality. This role also provides operational support, resolves incidents through root-cause analysis, and stays current on industry tools and best practices, consistently representing DFCI’s mission and patients.

The Data Engineer II will contribute to the generation, management, and interpretation of data for DFCI’s portfolio of clinical decision support algorithms including Treatment Pathways and Symptom Management Pathways. Treatment pathways are evidence-based decision trees built to help providers choose the best care for their patient based on the patient’s disease and condition. Symptom Management pathways are algorithms built to help manage side effects of cancer treatment.

Reporting to the Lead Data Engineer, this role is a data team member supporting the Solutions Team within the Business Strategy department at DFCI. The responsibilities of the Data Engineer include contributing to the development and maintenance of a variety of data resources and ensuring high quality data are consistently delivered to Data Analysts and other team members who rely on data to perform their roles.

Primary Duties and Responsibilities

• Understand data consumer requirements and translate them to data resource designs
• Develop and maintain databases and ETL processes for large-scale data ingestion from various data sources
• Develop and maintain data pipeline monitoring to ensure optimal ETL execution and highest data quality; develop metrics and dashboards to monitor and improve ETL data pipelines
• Document data pipelines and transformations so data consumers can understand data lineage
• Leverage cloud infrastructure and Application Programming Interfaces (APIs) where appropriate
• Stay current with industry trends and technologies, and evaluate and adapt new tools as needed
• Provide operational support for data platforms, including resolving incidents and performing root cause analysis
• Ability to represent the interests and mission of DFCI consistently and ethically and act on behalf of its current and future patients

Knowledge, Skills and Abilities

• Expert with SQL programming language and exploration
• Proficient with data warehousing and ETL pipelines
• Proficient with Excel and other Microsoft Office tools
• Proficient with Python
• Familiar with SDLC and understanding of cloud computing concepts
• Familiar with project management practices
• Familiar with writing technical requirements and specifications
• Understanding of software engineering practices such as code review, version control, testing, and continuous integration/continuous deployment (CI/CD)
• Proficient with R, Scala, Java, or another modern programming language used in data engineering (preferred, but not required)
• Hands-on experience with clinical data (preferred, but not required)
• Hands-on experience with Business intelligence tools (i.e., Tableau, neo4j, or R Shiny) (preferred, but not required)

Minimum Job Qualifications

• Bachelor’s Degree in Data Engineering, Computer Science, Biomedical Informatics, Health Services Research, Epidemiology, Biostatistics, or Public Health required.
• 2 years of hands-on SQL programming and data warehousing experience required.

License/Certification/Registration Required: None

Supervisory Responsibilities: No

Patient Contact: No