LiteLLM jobs, judged for you, free

What they do

LiteLLM is an open source AI gateway. It connects apps to LLMs, agents, and MCP servers through one OpenAI-compatible API. Platform teams set budgets and rate limits, and see the cost by key, user, and team. Customers install it in their own cloud, on-prem, or air-gapped. LiteLLM Enterprise adds SSO, audit logs, and support. Users include Netflix, NVIDIA, and Okta.

What they value

• Build in the open: the gateway has an MIT license and more than 1,700 contributors.
• Find the root cause of a problem, not a surface fix.
• Care about customers and make them successful with the product.
• Take high ownership, and solve problems without waiting to be asked.
• Ship quickly and learn from real users.
• Work directly with the founders.

Where they hire

The board lists 10 open postings. Six are in San Francisco, and five of those are on-site. Three are open in the United States: the technical account manager and the two forward deployed engineer roles. The senior security engineer role is remote, and one senior support engineer role is remote in India. The postings do not mention visa sponsorship.

Teams and roles

Berrie AI Incorporated makes LiteLLM. It was in the Y Combinator Winter 2023 batch, and it is building a second product. The board has three teams.

• Engineering: an AI engineer, the first security engineer, and two senior support engineers. The AI engineer converts OpenAI and Anthropic requests into the formats of other providers. Support engineers work the ticket queue and submit pull requests for fixes.
• Product: a product engineer, the first developer relations hire, a technical account manager, and two forward deployed engineers. The account manager and one forward deployed engineer own the 30 most important accounts.
• Sales: an account executive who sells to enterprises.

The stack is Python, FastAPI, Redis, and Postgres. Every posting except the India one states a pay range, from $120K to $260K. Most add equity.

What they look for

Many postings ask for technical depth in the LiteLLM product, a focus on customers, and a habit of solving root causes. The AI engineer role asks for one to two years of backend or full-stack work, and knowledge of the OpenAI API. The security role wants audits of production Python code, SAST and DAST tools, and security work outside the job, such as CTFs. The product engineer role asks for a CS degree and production software, preferably in Python. The new grad role requires a CS degree from a top university. The account executive role asks for two to four or more years of B2B sales and a record of meeting quota. The postings do not describe the interview steps.