Product Engineer
About the Role
This is a product engineering role at the intersection of building and distribution, focused on an AI agent evaluation product that transforms traces into reliable regression tests. You will ship features directly used by AI agent builders while creating in public to surface community signal that feeds back into the product. If you believe invisible shipping is shipping that doesn't matter, this role was written for you.
What You'll Do
Build and ship product features, including evals, replay, cohorts, and developer experience improvements, with strong taste and judgment about what is genuinely useful versus surface-level theater.
Create in public on X and GitHub, posting, demoing, and engaging with the AI engineering community to pull signal directly into product decisions.
Wear whatever hat the week demands, whether that is feature work, a marketing motion, customer demos, or community engagement, focusing on whatever moves the needle.
Stay close to the target user, including AI agent builders, eval practitioners, and developers working with agent frameworks and custom runtimes.
Close the loop between community feedback and what ships, ensuring no wall exists between build and distribution.
What We're Looking For
3+ years of experience building or shipping production software, with demonstrated work building or evaluating agents in real systems.
Strong Python proficiency for production code.
Hands-on experience with agent frameworks such as LangGraph, Claude Code, or equivalent tools.
Experience with evaluation systems for LLM or agent outputs, and with trace data, observability, or debugging agent execution.
Experience shipping developer tools, SDKs, or APIs with attention to documentation, ergonomics, and demos.
Open-source contributions with measurable adoption or usage by other developers.
Active presence in AI engineering communities on GitHub, X, or similar platforms.
Comfort operating in early-stage, high-uncertainty environments where wearing multiple hats is a necessity, not an exception.
Strong design and developer experience instincts across docs, APIs, and demos.
Compensation & Benefits
Salary range: $120,000 to $190,000 USD annually.
Location
Fully remote. Primary location is Munich, Bavaria, Germany, though candidates in other remote-friendly locations are also considered.