Machine Learning Researcher, Audio Job at Bland AI, United States

VUJIMFdXQm4zLzJxcjBJZkVkenRUUSsvVGc9PQ==
  • Bland AI
  • United States

Job Description

Machine Learning Researcher / Engineer, Multimodal LLMs

Location: San Francisco, CA or Remote (US)

About Bland

At Bland.com, our mission is to empower enterprises to build AI phone agents at scale. Voice is quickly becoming the primary interface between businesses and their customers, and we are building the models and infrastructure that make those interactions feel natural, reliable, and genuinely human.

We've raised $65M from leading investors including Emergence Capital, Scale Venture Partners, Y Combinator, and founders of Twilio, Affirm, and ElevenLabs.

The Role: Research Engineer

We are looking for someone to spearhead the development of our next-generation multimodal LLM stack, combining speech, text, tools, and real-time reasoning into a single unified system. You'll be responsible for building industry-leading conversational AI models that power Bland's agent, and taking them all the way from idea to production.

At Bland, we're not just thinking about text modeling. You will define how our agents listen, think, and act in real time, integrating streaming audio, tool execution, and dynamic context into a single coherent system.

This role sits at the intersection of:

  • LLM architecture and fine-tuning
  • real-time speech systems
  • agent design (prompting + tools + policies)
  • multimodal reasoning (audio + text + actions)

You will take ideas from research through production systems serving millions of calls per day.

What Makes You a Great Fit

Strong LLM / Multimodal Background

  • Experience with LLMs, multimodal models, or speech-language systems
  • Deep understanding of prompting, fine-tuning, and alignment techniques
  • Familiarity with streaming or real-time inference is a strong plus

Systems Thinking

  • Ability to reason about full systems, not just models
  • Comfortable designing interactions between:
    • model
    • tools
    • prompts
    • runtime constraints

Fast Experimental Loop

  • You can go from idea → dataset → experiment → conclusion in days
  • You know how to design experiments that actually answer the question

Product Intuition

  • Strong sense for what makes an interaction feel natural vs robotic
  • Ability to translate abstract modeling ideas into user-facing improvements

Builder Mentality

  • You take ownership from research through deployment
  • You thrive in ambiguous, fast-moving environments
  • You care about impact, not just elegance
How You Show Up
  • You think in systems, not just models
  • You obsess over latency, correctness, and real-world behavior
  • You are comfortable discarding ideas quickly when data disagrees
  • You push toward simple abstractions for complex problems
Bonus Points
  • Experience with real-time voice systems or conversational AI
  • Background in tool-using agents or agent frameworks
  • Experience with multimodal datasets (audio + text + actions)
  • Contributions to LLM or speech-related research or open source
Why This Role Matters

Your work will define how our agents:

  • understand users in real time
  • decide when to respond
  • choose what tools to call
  • balance speed vs correctness
  • behave under complex policies

This is the core intelligence layer of the product.

Compensation & Benefits
  • Competitive salary: $180,000 – $260,000
  • Meaningful equity
  • Full healthcare, dental, vision
  • Office in Jackson Square, SF
  • High autonomy, high impact

Job Tags

Work at office, Remote work

Similar Jobs

Community Veterinary Partners

Call Center, Customer Service Representative (Small Animal) Job at Community Veterinary Partners

 ...Helping People? Be the Voice That Connects Clients to Exceptional Care. We are seeking a dedicated and compassionate Call Center Customer Service Representative (CSR) to join our veterinary team! In this fast-paced role, you'll be the first point of contact for clients... 

Versant Media Inc

Senior Enterprise Sales Exec Remote, Non-Sport Growth Job at Versant Media Inc

 ...A leading media company is hiring a Senior Enterprise Sales Representative to drive sales for their non-sport verticals. The role involves developing strategies, managing client relationships, and ensuring high customer satisfaction. Ideal candidates have over 10 years... 

CMU Health

Internal Medicine Physician Job at CMU Health

 ...OVERVIEW Central Michigan University (CMU) College of Medicine and CMU Health an academic medical institution in Saginaw, MI is looking for full-time BC/BE Internal Medicine to join our faculty team. This role includes resident and medical student education, as well... 

Cal Services

P&D Driver Job at Cal Services

 ...Join our dynamic team as a P&D Driver, where you will play a crucial role in ensuring timely and efficient pick-up and delivery services...  ...independently and manage time effectively. Benefits ~ Medical Benefits after 3 months for full-time employees. ~ Paid Time... 

Aequor

Research Assistant I Job at Aequor

Overview: The Research Assistant will support in vivo preclinical imaging projects within the Bioimaging group of the Global Discovery...  ...for professional development in preclinical imaging sciences, with direct exposure to cutting-edge multimodal imaging technologies...