System Engineer for ML Platform on a Cloud-like HPC Infrastructure (Data-Centric Focus)

About Us

The Singapore-ETH Centre, established in 2010 by ETH Zurich and Singapore's National Research Foundation, serves as ETH Zurich's only research centre outside Switzerland. The centre enhances research capabilities to address global challenges in urban sustainability, resilience, and health through innovative programmes.

Project Overview

The AIS Instrumentation Gym, developed in collaboration with the National University of Singapore, is a cutting-edge multi-tier ML platform that enables researchers to bridge the gap between high-dimensional scientific data and hypothesis generation. The platform supports various computational environments, empowering scientists to derive insights from complex imaging data.

Role Summary

In this position, you will be responsible for managing a data-centric ML platform infrastructure that supports the complete research lifecycle, from data tokenization to model validation. Your expertise will drive the development and enhancement of CI/CD pipelines, automate integrations, and ensure comprehensive observability throughout the model's lifecycle.

Key Responsibilities

• Manage the ML platform to ensure robust support for the complete research lifecycle.
• Implement data-centric CI/CD pipelines for automatic artifact provenance logging.
• Utilize automation frameworks to facilitate seamless component integrations within research environments.
• Ensure platform observability enables researchers to access and query data effectively.
• Maintain infrastructure provisioning APIs for dynamic resource allocation.
• Oversee the provisioning and management of the ML platform, including artifact repositories and secret vaults.

Qualifications

Essential Qualifications:

• Bachelor's degree or higher in computer engineering, computer science, or a related field.
• Proficiency in:
  • Microservice architecture
  • Linux administration
  • CI/CD processes and tools, including GitLab CI and HashiCorp Vault.
  • Developing Ansible configurations
  • Versioning systems and CI/CD workflows, such as ArgoCD.

Preferred Qualifications:

• Familiarity with "Data-Centric" ML principles.
• Experience in building CI/CD pipelines for scientific/ML libraries.

Personal Qualities:

• Self-motivated and proactive team player.
• Strong communication skills.
• Problem-solving mindset with adaptability to change.
• Collaborative approach to address user needs.
• Eagerness to learn new technologies.

Project Management Skills:

• Experience working in self-organized teams.
• Familiarity with Agile methodology.
• Experience with test-driven development is a plus.

Benefits and Work Environment

• Accreditation with the Tripartite Alliance for Fair & Progressive Employment Practices.
• A diverse workplace with extensive opportunities for mutual learning.
• Positive and inclusive working environment.
• Generous leave policies, including annual and birthday leave.
• Healthcare insurance and dental benefits.
• Flexible hybrid work arrangements.
• Networking opportunities across various disciplines.

Diversity and Inclusion

We are committed to nurturing a culture of inclusivity and sustainability. We value diversity and strive to create an environment that respects the rights and dignity of all staff and students, fostering growth and learning for everyone.

Curiosity and Innovation

We are driven by curiosity and welcome individuals eager to explore the frontiers of knowledge and innovation. Join us to contribute to groundbreaking research and shape the future of sustainable urban living.