Raindrop

Sentry for AI Agents

Hiring — 6 openYC-W24B2B -> Engineering, Product and DesignEarly

What Raindrop does

Monitor your AI agents the right way. AI engineers use Raindrop to get alerts about silent failures in their AI agents. Raindrop sends you alerts when your AI misbehaves and links straight to the events, so you can dig into the conversations or traces, understand the root cause, and fix it, fast.

6 open roles

Developer Experience Engineer
San Francisco, CA, USFull-time3+ years$150K - $250K0.10% - 1.50% equityVisa: US citizen/visa only
What the role involves

Raindrop is the monitoring platform for AI agents. Engineering teams at some of the fastest growing AI companies including Replit, Speak, Clay, and more use Raindrop to get alerts about silent failures with their AI agents. Raindrop sends alerts when AI agents misbehave, so AI engineers can dig into the conversations or traces, understand the root cause, and fix it, fast. Why It Matters AI agents fail constantly in ways both hilarious and terrifying. Regular software throws exceptions. But AI agents fail silently, leaving engineers with almost no visibility into how their agents are actually performing. The current status quo is sifting through millions of logs and trying debug flaky evals that just aren't matching real world results. Evals are like unit tests, they confirm your model got specific test cases right. But in the real world agents call thousands of tools, run for hours, and encounter millions of unpredictable actions. That’s where Raindrop comes in. It learns the unique shape of each AI agent’s issues. Starting from presets like Laziness, Forgetting, or Task Failure, to automatically tuning itself to each agent and discovering unknown unknowns. With one click of a button, AI engineers start tracking issues or topics across 100% of their production data. They can see frequency over time, how many users are affected, relevant properties and more. In order to process hundreds of millions of events, we gradually train small, custom models, private to each company, that learn to uniquely understand how their product is used. As part of the early team, you’ll play a fundamental role in shaping the company - from making strategy and product decisions, to helping scale the team, to shaping the future of AI agents.Our Investors We’re backed by incredible investors including Lightspeed and leading AI companies including Figma Ventures, Vercel Ventures, founders of Replit (Amjad Masad and Michele Castata), Cognition (Walden Yan), Framer (Koen Bok and Jorn van Dijk), Speak (Andrew Hsu), Notion (Akshay Kothari) and more. Your Focus Ensure customers have a world-class developer experience integrating and using Raindrop Maintain, improve and add SDKs Help customers debug integration Write clear documentation, tutorials, and guides Quick iteration without compromising on quality Deeply understand the customer Ideal Candiate Knows how to balance short-term and long-term speed Strong programming, problem solving, and debugging skills Passion for working with developers and building developer communities Excellent technical writing skills Interest in AI products + tools (ideally experience building these or an avid user) Growth mindset Cares about building well-designed products Willing to do whatever it takes to solve a problem Must be in person in San Francisco (or willing to move)

Founding Recruiter
San Francisco, CA, USFull-time3+ years$150K - $200K0.10% - 0.50% equityVisa: US citizen/visa only
What the role involves

Raindrop is the monitoring platform for AI agents. Engineering teams at some of the fastest growing AI companies including Replit, Speak, Clay, and more use Raindrop to get alerts about silent failures with their AI agents. Raindrop sends alerts when AI agents misbehave, so AI engineers can dig into the conversations or traces, understand the root cause, and fix it, fast. Why It Matters AI agents fail constantly in ways both hilarious and terrifying. Regular software throws exceptions. But AI agents fail silently, leaving engineers with almost no visibility into how their agents are actually performing. The current status quo is sifting through millions of logs and trying debug flaky evals that just aren't matching real world results. Evals are like unit tests, they confirm your model got specific test cases right. But in the real world agents call thousands of tools, run for hours, and encounter millions of unpredictable actions. That’s where Raindrop comes in. It learns the unique shape of each AI agent’s issues. Starting from presets like Laziness, Forgetting, or Task Failure, to automatically tuning itself to each agent and discovering unknown unknowns. With one click of a button, AI engineers start tracking issues or topics across 100% of their production data. They can see frequency over time, how many users are affected, relevant properties and more. In order to process hundreds of millions of events, we gradually train small, custom models, private to each company, that learn to uniquely understand how their product is used. As part of the early team, you’ll play a fundamental role in shaping the company - from making strategy and product decisions, to helping scale the team, to shaping the future of AI agents. Our Investors We’re backed by incredible investors including Lightspeed and leading AI companies including Figma Ventures, Vercel Ventures, founders of Replit (Amjad Masad and Michele Castata), Cognition (Walden Yan), Framer (Koen Bok and Jorn van Dijk), Speak (Andrew Hsu), Notion (Akshay Kothari) and more. Your Focus Own the end-to-end recruiting function: sourcing, outreach, interviewing, coordination, closing. Build a world-class top-of-funnel engine through relentless outbound sourcing, referrals, content, and other creative recruiting tactics Help make the company a magnet for top talent by building a reputation for talent density Track and analyze recruiting metrics (pipeline, offer acceptance rates, time-to-hire) to inform hiring strategies Ideal Candiate Has recruited strong engineering teams, ideally at high-growth startups or AI / dev tool companies. Proven ability to source, engage, and close standout engineering candidates in competitive markets. Understands technical talent deeply and has strong instincts for evaluating engineering profiles. Strong communication skills. Aggressive user of AI tools and automation; always looking for ways to make work more efficient and scalable. Growth mindset Highly organized and reliable. Willing to do whatever it takes to solve a problem. Excited to work closely with leadership and own high-impact work from day one. Must be in person in San Francisco (or willing to move)

Security Engineer
San Francisco, CA, USFull-time6+ years$150K - $250K0.10% - 1.50% equityVisa: US citizen/visa only
What the role involves

Raindrop is the monitoring platform for AI agents. Engineering teams at some of the fastest growing AI companies including Replit, Speak, Clay, and more use Raindrop to get alerts about silent failures with their AI agents. Raindrop sends alerts when AI agents misbehave, so AI engineers can dig into the conversations or traces, understand the root cause, and fix it, fast. Why It Matters AI agents fail constantly in ways both hilarious and terrifying. Regular software throws exceptions. But AI agents fail silently, leaving engineers with almost no visibility into how their agents are actually performing. The current status quo is sifting through millions of logs and trying debug flaky evals that just aren't matching real world results. Evals are like unit tests, they confirm your model got specific test cases right. But in the real world agents call thousands of tools, run for hours, and encounter millions of unpredictable actions. That’s where Raindrop comes in. It learns the unique shape of each AI agent’s issues. Starting from presets like Laziness, Forgetting, or Task Failure, to automatically tuning itself to each agent and discovering unknown unknowns. With one click of a button, AI engineers start tracking issues or topics across 100% of their production data. They can see frequency over time, how many users are affected, relevant properties and more. In order to process hundreds of millions of events, we gradually train small, custom models, private to each company, that learn to uniquely understand how their product is used. As part of the early team, you’ll play a fundamental role in shaping the company - from making strategy and product decisions, to helping scale the team, to shaping the future of AI agents. Our Investors We’re backed by incredible investors including Lightspeed and leading AI companies including Figma Ventures, Vercel Ventures, founders of Replit (Amjad Masad and Michele Castata), Cognition (Walden Yan), Framer (Koen Bok and Jorn van Dijk), Speak (Andrew Hsu), Notion (Akshay Kothari) and more. Your Focus Secure the platform end-to-end from application code to cloud infrastructure Design and implement security controls that scale with millions of requests per day Conduct threat modeling, security audits, and incident response Communicate directly with our customer’s security teams Ideal Candidate Has experience with security engineering at a fast-growing startup Familiar with compliance (SOC 2, HIPAA etc.) Has contributed to the security community (eg. exploits, open-source) Interest in AI products + tools (ideally experience building these or an avid user) Growth mindset Willing to do whatever it takes to solve a problem Strong communicator who can explain ideas clearly Must be in person in San Francisco (or willing to move)

Information SecuritySoftware Security
Product Engineer
San Francisco, CA, USFull-time3+ years$150K - $250K0.10% - 1.50% equityVisa: US citizen/visa only
What the role involves

Raindrop is the monitoring platform for AI agents. Engineering teams at some of the fastest growing AI companies including Replit, Speak, Clay, and more use Raindrop to get alerts about silent failures with their AI agents. Raindrop sends alerts when AI agents misbehave, so AI engineers can dig into the conversations or traces, understand the root cause, and fix it, fast. Why It Matters AI agents fail constantly in ways both hilarious and terrifying. Regular software throws exceptions. But AI agents fail silently, leaving engineers with almost no visibility into how their agents are actually performing. The current status quo is sifting through millions of logs and trying debug flaky evals that just aren't matching real world results. Evals are like unit tests, they confirm your model got specific test cases right. But in the real world agents call thousands of tools, run for hours, and encounter millions of unpredictable actions. That’s where Raindrop comes in. It learns the unique shape of each AI agent’s issues. Starting from presets like Laziness, Forgetting, or Task Failure, to automatically tuning itself to each agent and discovering unknown unknowns. With one click of a button, AI engineers start tracking issues or topics across 100% of their production data. They can see frequency over time, how many users are affected, relevant properties and more. In order to process hundreds of millions of events, we gradually train small, custom models, private to each company, that learn to uniquely understand how their product is used. As part of the early team, you’ll play a fundamental role in shaping the company - from making strategy and product decisions, to helping scale the team, to shaping the future of AI agents. Our Investors We’re backed by incredible investors including Lightspeed and leading AI companies including Figma Ventures, Vercel Ventures, founders of Replit (Amjad Masad and Michele Castata), Cognition (Walden Yan), Framer (Koen Bok and Jorn van Dijk), Speak (Andrew Hsu), Notion (Akshay Kothari) and more. Your Focus Build out a world-class product - servicing millions of requests a day + growing. Architect, implement, and scale the application Quick iteration without compromising on quality Deeply understand the customer Ideal Candiate Knows how to balance short-term and long-term speed Proven experience scaling applications Interest in AI products + tools (ideally experience building these or an avid user) Growth mindset Willing to do whatever it takes to solve a problem Cares about building well-designed products Must be in person in San Francisco (or willing to move)

Node.jsPythonTypeScriptTorch/PyTorchPrompt Engineering
Backend Engineer
San Francisco, CA, USFull-time3+ years$150K - $250K0.10% - 1.50% equityVisa: US citizen/visa only
What the role involves

Raindrop is the monitoring platform for AI agents. Engineering teams at some of the fastest growing AI companies including Replit, Speak, Clay, and more use Raindrop to get alerts about silent failures with their AI agents. Raindrop sends alerts when AI agents misbehave, so AI engineers can dig into the conversations or traces, understand the root cause, and fix it, fast. Why It Matters AI agents fail constantly in ways both hilarious and terrifying. Regular software throws exceptions. But AI agents fail silently, leaving engineers with almost no visibility into how their agents are actually performing. The current status quo is sifting through millions of logs and trying debug flaky evals that just aren't matching real world results. Evals are like unit tests, they confirm your model got specific test cases right. But in the real world agents call thousands of tools, run for hours, and encounter millions of unpredictable actions. That’s where Raindrop comes in. It learns the unique shape of each AI agent’s issues. Starting from presets like Laziness, Forgetting, or Task Failure, to automatically tuning itself to each agent and discovering unknown unknowns. With one click of a button, AI engineers start tracking issues or topics across 100% of their production data. They can see frequency over time, how many users are affected, relevant properties and more. In order to process hundreds of millions of events, we gradually train small, custom models, private to each company, that learn to uniquely understand how their product is used. As part of the early team, you’ll play a fundamental role in shaping the company - from making strategy and product decisions, to helping scale the team, to shaping the future of AI agents. Our Investors We’re backed by incredible investors including Lightspeed and leading AI companies including Figma Ventures, Vercel Ventures, founders of Replit (Amjad Masad and Michele Castata), Cognition (Walden Yan), Framer (Koen Bok and Jorn van Dijk), Speak (Andrew Hsu), Notion (Akshay Kothari) and more. Your Focus Build out world-class infrastructure - servicing millions of requests a day + growing. Architect, implement, and scale the application Quick iteration without compromising on quality Deeply understand the customer Ideal Candidate Knows how to balance short-term and long-term speed Proven experience scaling applications Interest in AI products + tools (ideally experience building these or an avid user) Growth mindset Willing to do whatever it takes to solve a problem Must be in person in San Francisco (or willing to move)

PythonTypeScript
ML Engineer
San Francisco, CA, USFull-time3+ years$150K - $250K0.10% - 1.50% equityVisa: US citizen/visa only
What the role involves

Raindrop is the monitoring platform for AI agents. Engineering teams at some of the fastest growing AI companies including Replit, Speak, Clay, and more use Raindrop to get alerts about silent failures with their AI agents. Raindrop sends alerts when AI agents misbehave, so AI engineers can dig into the conversations or traces, understand the root cause, and fix it, fast. Why It Matters AI agents fail constantly in ways both hilarious and terrifying. Regular software throws exceptions. But AI agents fail silently, leaving engineers with almost no visibility into how their agents are actually performing. The current status quo is sifting through millions of logs and trying debug flaky evals that just aren't matching real world results. Evals are like unit tests, they confirm your model got specific test cases right. But in the real world agents call thousands of tools, run for hours, and encounter millions of unpredictable actions. That’s where Raindrop comes in. It learns the unique shape of each AI agent’s issues. Starting from presets like Laziness, Forgetting, or Task Failure, to automatically tuning itself to each agent and discovering unknown unknowns. With one click of a button, AI engineers start tracking issues or topics across 100% of their production data. They can see frequency over time, how many users are affected, relevant properties and more. In order to process hundreds of millions of events, we gradually train small, custom models, private to each company, that learn to uniquely understand how their product is used. As part of the early team, you’ll play a fundamental role in shaping the company - from making strategy and product decisions, to helping scale the team, to shaping the future of AI agents. Our Investors We’re backed by incredible investors including Lightspeed and leading AI companies including Figma Ventures, Vercel Ventures, founders of Replit (Amjad Masad and Michele Castata), Cognition (Walden Yan), Framer (Koen Bok and Jorn van Dijk), Speak (Andrew Hsu), Notion (Akshay Kothari) and more. Your Focus Build out a world-class product - servicing millions of requests a day + growing. Architect, implement, and scale ML pipelines Quick iteration without compromising on quality Deeply understand the customer Ideal Candidate Knows how to balance short-term and long-term speed Proven experience scaling applications Interest in AI products + tools (ideally experience building these or an avid user) Growth mindset Cares about building well-designed products Willing to do whatever it takes to solve a problem Must be in person in San Francisco (or willing to move)

PythonTypeScriptTorch/PyTorch

Roles are as last read from the company’s own listings. Openings close without notice — check the date on the listing before you spend an evening on the application.

Check the company’s own careers page — linked at the top — before a job board. A role appears there first, sometimes weeks before it is syndicated anywhere else.

Questions and experiences

Nobody has asked anything about Raindrop yet. If you have interviewed here, what you know is worth more to the next person than anything on the rest of this page.

Reviewed before it appears. Do not include anything that identifies you or anyone else.

Company facts compiled from public sources and last refreshed 9 September 2026. Details change; treat the company’s own site as the authority.

jobo is a browser extension. Open this on a computer to install it.