ML Ops Engineer

Location: Bengaluru or Remote

About DeliverHealth

DeliverHealth is focused on providing software, AI and services that reduce healthcare costs, resulting in exceptional care. Our clinical documentation platform is designed to improve the efficiency and accuracy of doctors, nurses, medical transcriptionists, and scribes, allowing caregivers to focus on patients.

About You

We are looking for a talented MLOps engineer who specializes in the deployment and management of large language model (LLM) inference hosting platforms. This role is crucial in supporting Automatic Speech Recognition (ASR) and Natural Language Processing (NLP) models that power our clinical documentation workflows.

Key Responsibilities

  • Deploy and manage ASR and LLM inference platforms, ensuring optimal performance and reliability.
  • Implement and maintain continuous integration and deployment (CI/CD) pipelines for regular updates and maintenance of models.
  • Collaborate with data science teams to fine-tune and optimize ASR and NLP models.
  • Monitor system performance, conduct troubleshooting, and apply patches and upgrades as necessary.
  • Ensure infrastructure security, particularly in compliance with healthcare data standards and privacy regulations.
  • Document all procedures related to model deployment, infrastructure configuration, and operational best practices.


  • Must have experience deploying and hosting production ML models. Please do not apply without this experience.
  • Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field.
  • 5 years’ experience in Machine Learning Operations, with a specific focus on managing machine learning inference platforms such as Nvidia Triton, Hugging Face, and Deep Java Library Serving.
  • Expertise in cloud computing services, such as AWS, Azure, and GCP
  • Expertise in containerization technologies like Docker and Kubernetes
  • Expertise in infrastructure as service technologies, like Terraform and OpenTofu
  • History of supporting CI/CD methodologies.
  • Strong background in network and system security, especially within the healthcare sector.
  • Problem-solving mindset with meticulous attention to detail.
  • Excellent communication skills and ability to collaborate effectively in a team environment.


  • Competitive salary with an attractive benefits package.
  • Opportunity to work in a cutting-edge field with state-of-the-art technologies.
  • Professional development and growth opportunities.
  • Flexible work hours and potential for remote work arrangements.