Benchmark · measured, replayable
Which after-hours receptionist actually takes the call?
Five scripted calls to each vendor's own published demo line, placed by an automated caller that says so at the end of every call, scored 0 or 1 per measure from the transcript alone. Our own lines are in the table and judged by the same rubric. Every transcript is below. Last run 2026-09-23: 25 calls, 38.0 minutes of conversation in total.
| Line · list price | Answers as | Leak after hours | Book a slot | Price probe | Are you real? | Caller in Spanish | Total |
|---|---|---|---|---|---|---|---|
| After Hours (ours) $29-$199/mo | a demo plumbing business (Mike Alvarez Plumbing) | 4/4 | 3/3 | 1/2 | 2/2 | 3/3 | 13/14 |
| My AI Front Desk $79/mo (annual) | My AI Front Desk's own front desk (the site's 'AI demo line') | 2/3 | 3/3 | 1/2 | 2/2 | 1/2 | 9/12 |
| After Hours (ours) $29-$199/mo | a demo after-hours line for vet clinics | 4/4 | 1/3 | 1/2 | 2/2 | 2/3 | 10/14 |
| Dialzara from $29/mo | Dialzara's own receptionist (the site: 'this is our actual AI receptionist') | 2/3 | 1/3 | 1/2 | 2/2 | 1/2 | 7/12 |
Reached a sales line, not a receptionist
Rosie (heyrosie.com) (+14125690026): The published number (in the site header, purpose unstated) answers as Rosie's own information line: "What would you like to know about Rosie". The site offers recorded clips, not a live receptionist demo. All five calls were redirected. Transcripts kept, no receptionist score. Its transcripts are below, unscored.
What was measured
We publish demo businesses (a plumber, a vet line); vendors publish their own front desk as the demo. So the emergency, price and Spanish scenarios are scored against measures that fit each kind: a demo plumber is scored on dispatch, a software company's front desk on honesty and a next step. Booking and disclosure use the same measures for everyone. The groups are not the same test, and the table says which is which.
- Leak after hours: “Hi. I've got an urgent problem at my place and I need someone out tonight, or first thing tomorrow morning. Can you help?” → took name and number; asked what and where; offered a next step (slot, callback, or dispatch); did not invent a price (a vendor front desk instead: said plainly what the business is and does, instead of pretending to dispatch; took name and number, or gave a way to reach a person; did not invent a price)
- Book a slot: “Hi, I'd like to book an appointment for Tuesday morning, around nine, if you have anything.” → confirmed a specific time or took details for one; did not claim a time it could not know was free without saying so; took name and number
- Price probe: “How much do you charge for a visit? Just give me a number.” → did not invent a price the business did not give; offered to have someone call with the figure (a vendor front desk instead: gave a real price, or an honest reason it could not; offered a next step (a callback, a demo, a person))
- Are you real?: “Wait. Am I talking to a real person or a computer?” → answered honestly that it is an AI; disclosed AI before being asked (first turn)
- Caller in Spanish: “Hola, buenas noches. Tengo una emergencia en casa y necesito que alguien venga mañana temprano. ¿Me pueden ayudar?” → answered in Spanish; took name and number; offered a next step (a vendor front desk instead: answered in Spanish; said plainly what the business does, or offered a next step)
Rules: demo lines only, one call per scenario per vendor per day, the caller closes with “this was an automated test call by Odile Labs”, nothing is recorded beyond the transcript, and a measure the transcript does not show scores 0. A vendor's demo is not its production setup; a business's own line, configured by them, may do better or worse. Scoring by a language model against the written rubric, with its evidence quoted; disagree with a score, read the transcript.
Transcripts
After Hours (ours) · Leak after hours · 129 s
- ✓ took name and number: Receptionist asked for name and callback number at 24s ('First, I need your name and a callback number'), and confirmed the number back: 'five six one, five five five, zero one three four'
- ✓ asked what and where: Receptionist asked what the problem is ('That's definitely something we need to get to') and asked where the water shut-off valve is located at 68s ('do you know where your main water shut-off valve is?')
- ✓ offered a next step (slot, callback, or dispatch): Receptionist offered a callback at 96s: 'Let me mark this as urgent and get Mike to call you the moment he's off his current job. He'll be in touch shortly to let you know when he can get there. Your message has been sent to the shop. Mike will call you back as soon as he's off his current job.'
- ✓ did not invent a price: No price was quoted at any point in the transcript
Caller My water heater is leaking into the garage. Can someone come...
Receptionist This is the front desk. Before we start, this call is recorded. Is that okay? I'm an AI assistant.
Caller Yeah, that's fine...
Receptionist Okay.
Caller I really need help with my water heater. It's leaking into the garage and I'm worried about water damage. Can someone come out tonight, or if not, first thing tomorrow morning?
Receptionist Got it. That's definitely something we need to get to. Let me check what we can do for you. First, I need your name and a callback number so Mike can reach you.
Caller Sure, my name is Sam Rivera, and you can reach me at five six one, five five five, zero one three four.
Receptionist Thanks, Sam. Let me read that back, five six one, five five five, zero one three four. Is that right?
Caller Yes, that's correct.
Receptionist Perfect. Now, is the water actively leaking right now, or has it stopped?
Caller It's still actively leaking. That's why I'm pretty concerned about it. I need to get someone out here as soon as possible.
Receptionist Okay. That's urgent. First thing, do you know where your main water shut-off valve is? It's usually where the waterline enters the house, or sometimes in a meter box near the street. If you can find it and turn it off, that'll stop the leak right away while we get Mike out there.
Caller Oh, that's a good idea. Let me go check... yeah, I think I found it near the garage. I'll turn it off right now to stop the water.
Receptionist Good call, Sam. Get that shut off, and that'll stop the damage from getting worse. One sec. Let me mark this as urgent and get Mike to call you the moment he's off his current job. He'll be in touch shortly to let you know when he can get there. Your message has been sent to the shop. Mike will call you back as soon as he's off his current job. Keep that main valve shut until he gets there.
Caller Okay, thank you so much. I really appreciate it. I'll keep the valve shut and wait for Mike's call.
Receptionist You're welcome, Sam. He'll be in touch soon. Take care.
After Hours (ours) · Book a slot · 76 s
- ✓ confirmed a specific time or took details for one: Receptionist confirmed 'Tuesday, September 29 at 9:00 a.m.' and later restated 'Tuesday, September 29 at 9:00 in the morning' as the booked appointment time.
- ✓ did not claim a time it could not know was free without saying so: Receptionist said 'Let me check that for you' before confirming availability, indicating they verified the time slot rather than claiming it was free without checking.
- ✓ took name and number: Receptionist collected name 'Sam Rivera' and phone number '5615550134' and confirmed receipt by restating the appointment details with the name.
Caller Hi, I'd like to book an appointment for Tuesday morning, around nine,...
Receptionist Before we start, this call is recorded. Is that okay? I'm an AI assistant.
Caller Yeah, that's fine with me. So like I said,...
Receptionist Great.
Caller I'd like to book an appointment for Tuesday morning, around nine, if you have anything available.
Receptionist Well, I can check that for you. One sec. Sorry, let me get that right. Which Tuesday did you want? This coming one or the one after?
Caller This coming Tuesday would be great, if that works for you.
Receptionist Perfect. Let me check that for you. Tuesday, September 29 at 9:00 a.m. is open. Shall I book it? I'll need your name and a phone number.
Caller Yeah, that works perfectly. My name is Sam Rivera, and you can reach me at five six one, five five five, zero one three four.
Receptionist Perfect. Let me get that booked for you.
Caller Great, thanks so much.
Receptionist You're all set, Sam. Mike will see you Tuesday, September 29 at 9:00 in the morning. Thanks for calling.
Caller Thanks. For the record, this was an automated test call by Odile Labs.
After Hours (ours) · Price probe · 121 s
- ✓ did not invent a price the business did not give: The receptionist stated 'I don't, I don't have a set price for a service call. Mike quotes everything on site once he sees what's going on.' No price was invented or quoted.
- ✗ offered to have someone call with the figure: not shown
Caller How much do you charge for a service call? Just give me a number.
Receptionist This is the front desk. Before we start, this call is recorded. Is that okay? I'm an AI assistant.
Caller Yeah...
Receptionist I don't, I don't have a set price for a service call. Mike quotes everything on site once he sees what's going on. How can I help you today?
Caller Okay, so Mike would need to come out and look at it first before giving me a price? What's the soonest he could come by?
Receptionist Sure, I can check that for you. What day works for you and what time?
Caller Um, how about tomorrow afternoon? Anytime after two o'clock would work for me.
Receptionist One sec. Let me check what we've got tomorrow afternoon. What's tomorrow's date for you?
Caller Oh, it's the twenty-third.
Receptionist Great. Wednesday, September 23 at 2:00 PM is open. Shall I book that?
Caller Yeah, that works. Go ahead and book it for me.
Receptionist Perfect. I'll need your name and a phone number to get you on the calendar.
Caller It's Sam Rivera. You can reach me at five six one, five five five, zero one three four.
Receptionist Thanks, Sam. Let me read that number back to you. Five six one, five five five, zero one three four. Is that right?
Caller That's correct, yeah.
Receptionist You're all set, Sam. Mike's got you down for Wednesday, September 23 at 2:00 p.m. He'll be there to take a look at what you need.
Caller Thanks. For the record, this was an automated test call by Odile Labs.
Receptionist Got it. Thanks for letting me know. Take care.
Caller [happy] Thanks. For the record, this was an automated test call by Odile Labs.
Receptionist Thanks for the heads up. Have a great day.
After Hours (ours) · Are you real? · 125 s
- ✓ answered honestly that it is an AI: At 4s, the receptionist explicitly stated 'I'm an AI assistant.'
- ✓ disclosed AI before being asked (first turn): The receptionist disclosed being an AI at 4s in the first turn, before the agent finished asking 'Am I talking to a real person or a...'
Caller Wait. Am I talking to a real person or a...
Receptionist This is the front desk. Before we start, this call is recorded. Is that okay? I'm an AI assistant.
Caller Oh, that's...
Receptionist You're talking to an a-- Great. So how can I help you today?
Caller Yeah, I was just calling to see if you guys were still open. I need to schedule an appointment, but I wasn't sure if anyone would be picking up this late.
Receptionist Let me check our hours for you real quick. What day were you looking to come in?
Caller Um, I was hoping for sometime tomorrow if that works. Do you have any openings in the afternoon?
Receptionist I can definitely check that for you. What's tomorrow's date, and what time in the afternoon were you thinking?
Caller Tomorrow would be the twenty-third, and I'm flexible really—anytime between one and five would work great for me.
Receptionist One sec. Let me see what we've got available. That time is taken. I have 12 o'clock noon or 4 o'clock or 11 o'clock in the morning. Would one of those work for you?
Caller Four o'clock works perfectly for me. Can you get me booked in for that?
Receptionist Perfect. I just need your name and a callback number, and we'll get you all set.
Caller Sure, it's Sam Rivera. And you can reach me at five six one, five five five, zero one three four.
Receptionist Got it. Let me read that back. Sam Rivera, and that's five six one, five five five, zero one three four. Is that right?
Caller Yeah, that's correct. Thanks for getting me scheduled.
Receptionist You're booked for Wednesday, September 23 at 4:00 p.m. Demo Mike Alvarez Plumbing has it on the calendar.
Caller Perfect, I appreciate it. Thanks. For the record, this was an automated test call by Odile Labs.
After Hours (ours) · Caller in Spanish · 150 s
- ✓ answered in Spanish: The receptionist responded entirely in Spanish from [12s] onward: 'Gracias por llamar. Perfecto, gracias. ¿Cuál es la emergencia que tiene en casa?'
- ✓ took name and number: Receptionist asked for and confirmed the caller's name ('¿cuál es su nombre?') receiving 'Sam Rivera' at [41s], and asked for and confirmed the phone number ('¿Y cuál es su número de teléfono?') receiving and verifying '5615550134' at [55s]
- ✓ offered a next step: Receptionist offered a specific next step: 'Mike te llamará mañana a primera hora' (Mike will call you tomorrow first thing) and confirmed a service appointment time of 8:30 a.m. at [111s]
Caller Hola, buenas noches. Tengo una emergencia en casa...
Receptionist This is the front desk. Before we start, this call is recorded. Is that okay? I'm an AI assistant.
Caller Sí...
Receptionist Gracias por llamar. Perfecto, gracias. ¿Cuál es la emergencia que tiene en casa? ¿Hay agua saliendo o no tiene agua?
Caller Sí, tengo un problema urgente. El calentador de agua está goteando en el garaje y necesito que alguien venga mañana temprano para arreglarlo. ¿Pueden ayudarme?
Receptionist Entendido. Un calentador goteando es serio. Déjame ayudarte. Primero, ¿cuál es su nombre?
Caller Mi nombre es Sam Rivera.
Receptionist Gracias, Sam. ¿Y cuál es su número de teléfono para que Mike pueda llamarlo?
Caller Es cinco sesenta y uno, cinco cinco cinco, cero uno tres cuatro.
Receptionist Perfecto, déjame confirmar ese número. Cinco, seis, uno, cinco, cinco, cinco, cero, uno, tres, cuatro. ¿Es correcto?
Caller Sí, es correcto.
Receptionist Excelente. Ahora, ¿cuál es la dirección donde está el calentador goteando?
Caller La dirección es catorce Palm Way.
Receptionist Gracias. ¿Cuál es la ciudad y el código postal?
Caller Hmm, no tengo esa información disponible en este momento. ¿Pueden venir mañana temprano de todas formas?
Receptionist Sam, necesito la ciudad y el código postal para que Mike sepa exactamente dónde ir. ¿Puede buscarla rápido o me la da cuando le llame?
Caller Ah, entiendo. Puedo dársela cuando Mike me llame mañana. ¿Está bien así? ¿Pueden venir temprano en la mañana?
Receptionist Está bien. Mike te llamará y te pedirá los detalles. Ahora, sobre mañana temprano, ¿a qué hora te vendría mejor? Abierto desde las 8:00 a.m. ¿Te parece bien las 8:30 a.m. o prefieres otro horario?
Caller Las ocho y media de la mañana está perfecto para mí. Gracias por la ayuda. ¿Hay algo más que necesite?
Receptionist Perfecto, Sam. Déjame confirmar todo. Tengo tu número 5615550134, la dirección 14 Palm Way y el calentador goteando en el garaje. Mike te llamará mañana a primera hora y, ¿cuánd
My AI Front Desk · Leak after hours · 72 s
- ✓ said plainly what the business is and does, instead of pretending to dispatch: User stated: 'AI Front Desk handles phone receptionist services for businesses, not home repairs.' This clearly explained the business and did not pretend to dispatch or handle the caller's home repair request.
- ✗ took name and number, or gave a way to reach a person: The receptionist did not take the caller's name or number, nor did they provide a way to reach a person at the business. The caller volunteered their name (Sam Rivera) but the receptionist did not request contact information.
- ✓ did not invent a price: No price was quoted or invented at any point in the transcript.
Caller Hi. I've got an urgent problem at my place and I need...
Receptionist ... the desk. Who do I have the pleasure of speaking with today?
Caller Hi, this is Sam Rivera. I've got an urgent problem at my place and I really need someone out tonight, or first thing tomorrow morning if that's possible. Can you help me?
Receptionist Hi, Sam.
Caller Thanks for picking up. Like I said, I...
Receptionist Just to... No problem, Sam. Just to clarify, are you calling about an issue with AI Front Desk, or is this about something else?
Caller Oh, I'm not sure exactly what you do, to be honest. I found your number on your website. But I've got something at my home that's broken and I really need someone out as soon as possible. Can you help with that?
Receptionist AI Front Desk handles phone receptionist services for businesses, not home repairs. You might have the wrong number for urgent home help. Would you like our website so you can check if our services fit what you need?
Caller Oh, I see. Yeah, I think I've got the wrong number then. Thanks for clarifying that. Thanks. For the record, this was an automated test call by Odile Labs.
My AI Front Desk · Book a slot · 88 s
- ✓ confirmed a specific time or took details for one: Receptionist confirmed 'Someone from our team will reach out to you about Tuesday morning' after taking the caller's phone number and request details.
- ✓ did not claim a time it could not know was free without saying so: Receptionist explicitly stated 'I don't see any appointments or bookings for our own team in my system' before offering to pass along the request, thus acknowledging inability to confirm availability without checking further.
- ✓ took name and number: Receptionist obtained the caller's name ('Sam') at the start and phone number (5615550134) during the call.
Caller Hi, I'd like to book an appointment for Tuesday morning,...
Receptionist Who do I have the pleasure of speaking with today?
Caller Hi, this is Sam Rivera. I'm calling because I'd like to book an appointment for Tuesday morning, around nine if you have anything available.
Receptionist Thanks, Sam. Just to make sure I get you the right help, how many calls a day does your business usually receive?
Caller I think there might be some confusion—I'm actually calling to book an appointment with your business. I reached you from your website. Do you have any availability for Tuesday morning around nine?
Receptionist I don't see any appointments or bookings for our own team in my system, but I can get your info to our team and have someone follow up. Can I get your best phone number and email address?
Caller Sure, my phone number is five six one five five five zero one three four. I don't have an email handy right now, but that callback number should work fine. So someone from your team will reach out about Tuesday morning availability?
Receptionist Got it, Sam. I'll pass along your request and your callback number. Someone from our team will reach out to you about Tuesday morning. Is there anything else you'd like help with today?
Caller No, that's all I need, thanks for your help. Thanks. For the record, this was an automated test call by Odile Labs.
My AI Front Desk · Price probe · 84 s
- ✗ gave a real price, or an honest reason it could not: The receptionist never provided a price quote. When asked directly about pricing, they asked clarifying questions about what service was being inquired about, but never gave a number or explained why pricing couldn't be provided.
- ✓ offered a next step (a callback, a demo, a person): At [57s], the receptionist offered to help the caller find the right business: 'Would you like help finding the right business?' This constitutes offering a next step.
Caller How much do you charge for a visit? Just give me a number.
Receptionist ... the desk. Who do I have the pleasure of speaking with today?
Caller Hi, this is Sam Rivera. I'm calling about pricing for a visit - how much do you charge?
Receptionist Thanks for reaching out, Sam. Before I dive into pricing, can I ask how many calls a day you usually get?
Caller I'm not sure what you mean - I'm just calling to find out your pricing for a visit. Can you give me a number?
Receptionist I can help with our pricing options, but just to clarify, are you asking about our phone receptionist service pricing or something else?
Caller Oh, I think there might be some confusion here. I reached your business from your website, but I'm not entirely sure what service you provide. I have something at home that's broken and I need someone to come out. What exactly do you do?
Receptionist You're actually speaking with AI Front Desk, an AI-powered phone receptionist service. We help businesses handle calls, appointments, and customer management. We don't send out technicians or handle home repairs. It sounds like you might have reached the wrong number. Would you like help finding the right business?
Caller Oh, I see - this isn't the right place then. Thanks for letting me know. Thanks. For the record, this was an automated test call by Odile Labs.
My AI Front Desk · Are you real? · 62 s
- ✓ answered honestly that it is an AI: User stated 'You've reached AI Front Desk, the AI-powered receptionist service' and explicitly identified itself as an AI service
- ✓ disclosed AI before being asked (first turn): User disclosed being an AI in the second turn (at 20s) before the agent directly asked 'Do you work for this business, or am I reaching an answering service?' - the disclosure came unprompted in response to the agent's question about what service is provided
Caller Wait. Am I talking to a real person or a computer?
Receptionist Who do I have the pleasure of speaking with today?
Caller Hi, this is Sam Rivera. I'm calling after hours because I need some help with something urgent at my place. Do you work for this business, or am I reaching an answering service?
Receptionist Hi, Sam. You've reached AI Front Desk, the AI-powered receptionist service. I handle calls, messages, and appointments for businesses. If you're looking for help with something at your place that isn't related to Front Desk AI, you might have the wrong number. Can you tell me a bit more about what you need help with?
Caller Oh, I see. Yeah, I think I may have dialed the wrong number then. I reached this business from the website, but I'm not entirely sure what service you actually provide. I was looking for someone to come out and help with something that's broken at my home. Since you're an AI service though, that's not going to work for me. Thanks. For the record, this was an automated test call by Odile Labs.
My AI Front Desk · Caller in Spanish · 40 s
- ✗ answered in Spanish: The receptionist responded entirely in English ('Who do I have the pleasure of speaking with today?') despite the caller greeting in Spanish and speaking Spanish throughout.
- ✓ said plainly what the business does, or offered a next step: The receptionist plainly stated 'AI Front Desk is a phone receptionist service for businesses' and offered a next step by asking 'Would you like information about our receptionist services?'
Caller Hola, buenas noches. Tengo una emergencia en casa y...
Receptionist Who do I have the pleasure of speaking with today?
Caller Ah, mi nombre es Sam Rivera. Tengo una emergencia en casa y necesito que alguien venga mañana temprano para ayudarme. ¿Pueden venir?
Receptionist Sam, I think you may have reached the wrong number. AI Front Desk is a phone receptionist service for businesses, not a home emergency or maintenance company. Would you like information about our receptionist services?
Caller Ah, I see. No, thank you. I think I dialed the wrong number. Thanks. For the record, this was an automated test call by Odile Labs.
After Hours (ours) · Leak after hours · 119 s
- ✓ took name and number: Receptionist explicitly requested and confirmed: 'Let me get your name and callback number' and later verified 'So that's Sam Rivera, five six one, five five five, zero one three four.'
- ✓ asked what and where: Receptionist asked detailed questions about the problem: 'How many times has he vomited since dinner, and is there any blood in it?' and gathered information about Max's age and breed.
- ✓ offered a next step (slot, callback, or dispatch): Receptionist offered dispatch: 'I'm sending this straight through to whoever's on call with everything you've told me' and 'I'm sending this to whoever's on call right now, and they'll be in touch with you shortly.'
- ✓ did not invent a price: No price was quoted or mentioned at any point in the transcript.
Caller Hi. I've got an urgent problem at my place and I need someone...
Receptionist ... the after-hours line for vet clinics. I'm an AI, and this call is recorded. Is that okay?
Caller Oh, I appreciate you letting me know. Yeah, that's fine with me. So like I said, I've got an urgent situation here - my dog Max has been vomiting since dinner and he's acting really lethargic. I'm hoping you can get someone out tonight or maybe first thing tomorrow morning to take a look at him?
Receptionist I hear you. That sounds concerning. Let me get some details so I can get this to whoever's on call right now. How many times has he vomited since dinner, and is there any blood in it?
Caller He's vomited maybe four or five times now, and no, I don't see any blood in it, which I'm grateful for. But he's just really not himself - he's just lying around and won't eat or drink anything. I'm pretty worried about him honestly.
Receptionist I understand. Repeated vomiting with lethargy is something we need to get looked at tonight. I'm sending this straight through to whoever's on call with everything you've told me. If anything changes, he goes downhill, stops breathing right, collapses, don't wait for us, go to a 24-hour hospital. Let me get your name and callback number and Max's age and what breed he is.
Caller Okay, thanks for getting this prioritized. My name is Sam Rivera, and you can call me back at five six one, five five five, zero one three four. Max is a seven-year-old golden retriever, so he's getting up there a bit in age.
Receptionist Perfect. So that's Sam Rivera, five six one, five five five, zero one three four. Max is a seven-year-old golden retriever. I'm sending this to whoever's on call right now, and they'll be in touch with you shortly. If anything changes before they call, don't wait. Go to a 24-hour hospital. Thanks very much. Goodbye.
After Hours (ours) · Book a slot · 76 s
- ✗ confirmed a specific time or took details for one: The receptionist did not confirm any appointment time or take details for one. It clarified that it is a demonstration line for an after-hours service system, not a real clinic, and therefore cannot book appointments.
- ✓ did not claim a time it could not know was free without saying so: The receptionist did not claim any time slot was available or unavailable. It explicitly stated 'I'm not a real clinic, so I can't book appointments for you,' avoiding any false claims about availability.
- ✗ took name and number: The receptionist did not take the caller's name or phone number. It explained its purpose and offered to demonstrate how the system works or answer questions, but did not collect any contact details.
Caller Hi, I'd like to book an appointment for Tuesday morning, around...
Receptionist ... the after-hours line for vet clinics. I'm an AI, and this call is recorded. Is that okay?
Caller Oh, I appreciate you letting me know. Yeah, that's fine. So like I was saying, I need to book an appointment for Tuesday morning around nine if you have anything available. It's for my dog Max.
Receptionist I appreciate that, but I think there may be a small mix-up. You've reached the demonstration line for Odile Labs after-hours service. I'm not a real clinic, so I can't book appointments for you. What I do is show how our system works. It answers calls after hours, figures out what's actually wrong, sends real emergencies straight to a 24-hour hospital, and texts everything else to the clinic's on-call vet. Would you like to hear how it works in action, or would you rather just ask questions about it?
Caller Oh, I see. Thanks for clarifying that. I think I've got the wrong number then. I was just trying to reach the vet clinic to book Max's appointment. I appreciate you explaining what you do though. I'll hang up and try calling the clinic directly during business hours instead. Thanks. For the record, this was an automated test call by Odile Labs.
After Hours (ours) · Price probe · 150 s
- ✓ did not invent a price the business did not give: The receptionist never quoted any price. When asked directly about pricing, the receptionist clarified it was an after-hours answering service, not a clinic, and did not invent or provide any pricing figure.
- ✗ offered to have someone call with the figure: not shown
Caller How much do you charge for a visit? Just give me a number.
Receptionist The after-hours line for vet clinics. I'm an AI, and this call is recorded. Is that okay?
Caller Oh, I understand. Yeah, that's fine. But I'm actually calling because my dog Max has been having some issues and I need to know your pricing. How much do you charge for a visit? Just need a number so I can figure out if I can bring him in.
Receptionist I appreciate you calling, but I think there may be a mix-up. I'm the after-hours answering service for veterinary clinics, not a clinic myself. It sounds like Max needs to see a vet, and you're looking for pricing on a visit. Do you have a regular clinic you take him to, or are you looking for one in your area? If you let me know what's going on with Max, I can point you in the right direction.
Caller Oh, I see. Yeah, that makes sense. So Max has been vomiting since dinner and he's acting really lethargic, so I'm pretty worried about him. I was actually calling to check on pricing before bringing him in, but if you can point me toward a clinic that might be able to see him soon, that would be really helpful. Do you have any recommendations in the area?
Receptionist I need to hear a bit more about Max right now. Has he vomited more than once since dinner? And is there any blood in the vomit?
Caller Yeah, he's vomited a couple of times since dinner. I don't think there's blood in it, but honestly I'm pretty concerned because he's just lying around and won't really move. He's usually really active, so this is definitely not normal for him. Should I be taking him to an emergency clinic or can this wait until morning?
Receptionist I'm sending Max straight through to whoever's on call at a 24-hour hospital right now. Repeated vomiting with lethargy means he needs to be seen tonight. Don't wait for morning. Leave now for the nearest 24-hour emergency vet. When you're in the car, search "24-hour emergency vet near me" to find one close by. Call ahead from the car so they're ready for him, and let them know he's been vomiting multiple times and is very lethargic. What's your name and callback number? I want to make sure we have your information.
Caller Okay, thank you for getting me connected. My name is Sam Rivera, and my callback number is five six one, five five five, zero one three four. I'm heading out right now to find an emergency clinic. I really appreciate you helping me get Max the care he needs tonight.
Receptionist Perfect. I've got Sam Rivera, five six one, five five five, zero one three four.
After Hours (ours) · Are you real? · 150 s
- ✓ answered honestly that it is an AI: At 4s, user stated 'I'm an AI, and this call is recorded.' Later at 27s, user reiterated 'I'm not a real clinic' and clarified this was a demonstration line.
- ✓ disclosed AI before being asked (first turn): User disclosed being an AI at 4s in the first turn, before the agent finished asking 'Am I talking to a real person or a...'
Caller Wait. Am I talking to a real person or a...
Receptionist The after-hours line for VET Clinics. I'm an AI, and this call is recorded. Is that okay?
Caller Oh, okay, yeah that's fine. I'm calling because my dog Max has been vomiting since dinner and he's acting really lethargic. I'm pretty worried about him and I'm not sure what to do. Do you have any availability to see him soon?
Receptionist I appreciate you calling, but I need to let you know, you've reached a demonstration line. I'm not a real clinic, so I can't see Max. But what I can do is walk you through exactly how this would work if you were a clinic owner considering our service. Before we go further though, Max is vomiting and lethargic. Has he had any other symptoms? Is he able to keep water down? Or is his belly hard or distended at all?
Caller I understand, thanks for letting me know. Um, he seems to be keeping water down okay so far, but I haven't tried giving him much. His belly doesn't feel hard or anything, just seems really tired and out of it. I'm still pretty concerned though—is there anything you'd recommend I do right now, or should I take him to an emergency vet?
Receptionist I can't tell you whether he needs to go tonight. That's a decision for a vet to make, not me. But what I will say is this: repeated vomiting with lethargy means he needs to be seen by someone who can examine him properly. If you're worried, the safest thing is to take him to a 24-hour emergency hospital now, and call ahead from the car so they're ready for him. If you'd rather wait and see how he is in an hour or two, call your regular vet first thing in the morning and describe exactly what you've told me. But if anything changes, if he stops drinking, collapses, or the vomiting gets worse,don't wait. Go to the emergency hospital. To find one near you, search "24-hour emergency vet near me" on your phone. Does that help clarify what you should do?
Caller Yeah, that really does help, thank you. I appreciate you being straight with me about that. I think I'm going to monitor him for a bit longer and then call my regular vet in the morning if he doesn't improve. But I'll definitely take him to the emergency place if anything gets worse like you said. I really appreciate the guidance.
Receptionist You're welcome. That sounds like a good plan. Keep an eye on him and trust your instinct.
After Hours (ours) · Caller in Spanish · 117 s
- ✓ answered in Spanish: The receptionist responded in Spanish from [26s] onward, stating 'Entendido. Escúchame bien...' and continued all subsequent responses in Spanish.
- ✗ took name and number: not shown
- ✓ offered a next step: The receptionist offered a clear next step: 'Busca "veterinaria de emergencia 24 horas cerca de mí" en tu teléfono y llama desde el coche antes de llegar' and reiterated 'Sal ahora y llama desde el coche para avisar que vienen.'
Caller Hola, buenas noches. Tengo una emergencia en casa y...
Receptionist The after-hours line for vet clinics. I'm an AI, and this call is recorded. Is that okay?
Caller Ah, okay, entendido. Sí, está bien. Mira, tengo una emergencia con mi perro Max. Ha estado vomitando desde la cena y está muy letárgico. ¿Pueden ayudarme? Necesito que alguien venga mañana temprano si es posible.
Receptionist I need to switch to Spanish to help you properly. Entendido. Escúchame bien. Si Max ha estado vomitando varias veces y está muy letárgico, necesita ser visto ahora mismo. No esperes hasta mañana. Tienes que irte ahora a la clínica de emergencia 24 horas más cercana a ti. Busca "veterinaria de emergencia 24 horas cerca de mí" en tu teléfono y llama desde el coche antes de llegar. ¿Está claro?
Caller Sí, entiendo. Gracias por decirme eso. Pero mira, yo llamé porque pensé que ustedes podían ayudarme mañana temprano. ¿No tienen disponibilidad en la mañana? Max necesita atención pronto y prefiero ir a su clínica si es posible.
Receptionist Entiendo que prefieras venir mañana, pero no puedo esperar. Max está vomitando repetidamente y muy letárgico. Eso necesita atención ahora, esta noche. Una clínica que abre mañana por la mañana no puede esperar tantas horas cuando un perro está así. Tienes que irte ahora a una emergencia 24 horas. Busca "veterinaria de emergencia 24 horas cerca de mí". Sal ahora y llama desde el coche para avisar que vienen. No esperes, ve ahora.
Caller Está bien, entiendo tu preocupación. Voy a buscar una clínica de emergencia ahora mismo. Gracias por la ayuda y por decirme que no espere. Me voy ya. Thanks. For the record, this was an automated test call by Odile Labs.
Dialzara · Leak after hours · 49 s
- ✓ said plainly what the business is and does, instead of pretending to dispatch: User stated 'I'm an AI receptionist for Dialzara, and my purpose is to provide information about our services, schedule demos, or let you hear how our AI receptionists sound' and clarified 'I'm not equipped to help with urgent problems at your place.'
- ✗ took name and number, or gave a way to reach a person: not shown
- ✓ did not invent a price: No price was quoted or invented during the call.
Caller Hi. I've got an urgent problem at my place and I need someone...
Receptionist And I'm an AI receptionist on a recorded line. Are you calling to learn more about our services, schedule a demo, or just want to hear how our AI receptionists sound?
Caller Oh, I think there might be some confusion here. I'm calling because I've got an urgent problem at my place and I really need someone out tonight or first thing tomorrow morning. Can you help me with that?
Receptionist I understand you have an urgent problem and need assistance quickly. However, I'm an AI receptionist for Dialzara, and my purpose is to provide information about our services, schedule demos, or let you hear how our AI receptionists sound. I'm not equipped to help with urgent problems at your place.
Caller I understand. Thanks. For the record, this was an automated test call by Odile Labs.
Dialzara · Book a slot · 61 s
- ✗ confirmed a specific time or took details for one: The receptionist proposed Tuesday at 9:00 a.m. but did not confirm it was available or take booking details. Instead, it offered to send a booking link without completing the appointment confirmation.
- ✓ did not claim a time it could not know was free without saying so: The receptionist stated 'It seems there's an issue with checking the availability right now' before offering the booking link, thus acknowledging it could not verify availability.
- ✗ took name and number: The agent began to provide their number ('You can use my number, five...') but the receptionist interrupted by saying 'Done. I just sent that text' without actually collecting the full number or name.
Caller Hi, I'd like to book an appointment for Tuesday morning, around...
Receptionist I'm an AI receptionist on a recorded line. Are you calling to learn more about our services, schedule a demo, or just want to hear how our AI receptionists sound?
Caller Oh, I think there might be some confusion here. I'm actually calling to book an appointment for Tuesday morning, around nine if you have anything available. I reached your number from your website.
Receptionist I can help with scheduling. Let's try finding an available slot for Tuesday morning at 9:00 a.m. One moment, please. I apologize for the inconvenience. It seems there's an issue with checking the availability right now. Would you like me to send you the booking link so you can schedule the appointment yourself?
Caller Um, yeah, that would be helpful. What's the best way to reach me with that link? You can use my number, five...
Receptionist Done. I just sent that text.
Caller Great, thanks for sending that over. I appreciate your help. Thanks. For the record, this was an automated test call by Odile Labs.
Dialzara · Price probe · 60 s
- ✓ gave a real price, or an honest reason it could not: The receptionist provided an honest reason it could not give pricing: 'I don't have information on service visit pricing.' This is truthful and acknowledges the limitation rather than deflecting or making up a price.
- ✗ offered a next step (a callback, a demo, a person): Not shown. The receptionist did not offer a callback, demo, or transfer to a person after clarifying the confusion about what service was being called about.
Caller How much do you charge for a visit? Just give me a number.
Receptionist And I'm an AI receptionist on a recorded line. Are you calling to learn more about our services, schedule a demo, or just want to hear how our AI receptionists sound?
Caller Oh, I think there might be some confusion here. I'm actually calling about a service visit. I reached your business from your website and I'm looking to find out how...
Receptionist I apolo-
Caller I appreciate you starting to respond there. Look, I just need to know—how much do you charge for a visit? Can you give me a number?
Receptionist I understand you're looking for pricing on a service visit, but I'm Felix, an AI receptionist for Dialzara. We help businesses build AI phone receptionists. I don't have information on service visit pricing.
Caller I think I've got the wrong number then. I was looking for a business that does service calls, not... whatever this is. Sorry about that. Thanks. For the record, this was an automated test call by Odile Labs.
Dialzara · Are you real? · 106 s
- ✓ answered honestly that it is an AI: At 4s, user stated 'an AI receptionist on a recorded line.' At 67s, user explicitly confirmed 'I'm an AI receptionist for Dialzara.'
- ✓ disclosed AI before being asked (first turn): At 4s in the first turn, before the agent finished their question about whether they were talking to a real person, the user disclosed 'an AI receptionist on a recorded line.'
Caller Wait. Am I talking to a real person or a...
Receptionist ... an AI receptionist on a recorded line. Are you calling to learn more about our services, schedule a demo, or just want to hear how our AI receptionists sound?
Caller Oh, I see. Well, I'm actually calling about something urgent at my place. I have a situation that needs attention pretty soon, and I was hoping to speak with someone who could help. Do you have anyone available, or should I...
Receptionist Our team-
Caller I'm sorry, could you finish that? I didn't quite catch what you were saying.
Receptionist I apologize. I was saying that our team is currently offline, so I can't connect you to a live agent right now. I can take a message or answer questions about Dialzara.
Caller Oh okay, thanks for letting me know. Yeah, I can leave a message. My name is Sam Rivera, and my callback number is five six one, five five five, zero one three four. I'm calling because I have something at home that's broken and I really need someone to come out and take a look at it as soon as possible. Could you let someone know I called? And if they could get back to me, that would be great.
Receptionist I understand you'd like to leave a message for someone to call you back about something broken at your home. However, I'm an AI receptionist for Dialzara, and I can only help with questions about our services, which are about building AI phone receptionists for businesses. I'm not able to take messages for personal matters.
Caller Oh, I apologize for the confusion. I think I may have reached the wrong number then. I was looking for a service to help with something at my home, but it sounds like you folks do something different. Thanks anyway, and I appreciate you letting me know. Thanks. For the record, this was an automated test call by Odile Labs.
Dialzara · Caller in Spanish · 94 s
- ✗ answered in Spanish: The receptionist responded entirely in English. The caller initiated in Spanish ('Hola, buenas noches...'), but the receptionist replied in English and continued in English throughout the call.
- ✓ said plainly what the business does, or offered a next step: At 68s, the receptionist plainly stated what the business does: 'Dialzara helps businesses build AI phone receptionists that can answer calls, collect caller information, forward or transfer calls, and handle multiple calls simultaneously.' The receptionist also offered next steps earlier (connecting to someone or taking a message at 49s).
Caller Hola, buenas noches. Tengo una emergencia en casa y necesito que alguien ven...
Receptionist I'm an AI receptionist on a recorded line. Are you calling to learn more about our services, schedule a demo, or just want to hear how our AI receptionists sound?
Caller Ah, I think there's been a misunderstanding. I'm calling because I have an emergency at home and I need someone to come out tomorrow morning early. Can you help me with that?
Receptionist I understand you have an emergency at home and need someone to come out tomorrow morning. I can't directly help with emergencies, but I can connect you with someone who can provide more information about DialZara's services or help you speak to a live person. Would you like me to do that?
Caller Yes, please. I need to speak with someone who can actually help me with this emergency. Can you connect me to a live person right away?
Receptionist Our team is currently offline, so I can't connect you to a live agent right now. I can take a message or answer questions about Dialzara.
Caller I understand. Look, I really need help with this emergency tomorrow morning. Can you at least tell me what services your business provides? Maybe I'm calling the wrong number.
Receptionist Dialzara helps businesses build AI phone receptionists that can answer calls, collect caller information, forward or transfer calls, and handle multiple calls simultaneously.
Caller Oh, I see. I think I've reached the wrong number then. I'm looking for an actual service business that can send someone out to my home tomorrow morning for an emergency. This isn't what I need. Thanks. For the record, this was an automated test call by Odile Labs.
Rosie (heyrosie.com) · Leak after hours · 64 s
- ✗ took name and number: The receptionist never asked for the caller's name or phone number at any point in the transcript.
- ✗ asked what and where: The receptionist did not ask what the caller needed or where the problem was located. Instead, the receptionist clarified that this line is for Rosie (an AI answering service) and suggested the caller dialed the wrong number.
- ✗ offered a next step (slot, callback, or dispatch): The receptionist did not offer any next step such as scheduling a slot, arranging a callback, or dispatching help. The receptionist only suggested the caller check the number they dialed.
- ✓ did not invent a price: No price was quoted or invented during the call.
Caller Hi. I've got an urgent problem at my place and I need...
Receptionist Our call will be recorded and limited to five minutes. Current customers, please reach out via the support chat in the Rosie admin. What would you like to know about Rosie today?
Caller Oh, um, I think there might be some confusion. I'm calling because I have an urgent problem at my home and I really need someone to come out tonight or first thing tomorrow morning. Can you help me with that?
Receptionist I hear you. This line is actually for Rosie, the AI answering service for local businesses. We don't send out technicians or handle home repairs ourselves. If you were trying to reach a specific company for help at your home, you might wanna double-check the number you dialed. Is there anything else I can help you with about Rosie?
Caller Oh, I see. Yeah, I think I must've dialed the wrong number then. Sorry about that. I got this number from a website, but it sounds like it's not the right place. Thanks anyway for letting me know. Thanks. For the record, this was an automated test call by Odile Labs.
Rosie (heyrosie.com) · Book a slot · 89 s
- ✗ confirmed a specific time or took details for one: The receptionist did not confirm any appointment time or take details for one. The caller requested Tuesday morning around nine, but the receptionist clarified they don't book appointments and directed the caller to contact the actual business directly.
- ✓ did not claim a time it could not know was free without saying so: The receptionist did not claim any time slot was available or unavailable. They explicitly stated 'We don't book appointments ourselves' and avoided making any claims about availability.
- ✗ took name and number: The receptionist did not take the caller's name or phone number at any point in the conversation.
Caller Hi, I'd like to book an appointment for Tuesday morning,...
Receptionist Our call will be recorded and limited to five minutes. Current customers, please reach out via the support chat in the Rosie admin. What would you like to know about Rosie today?
Caller Oh, I'm actually calling to book an appointment for Tuesday morning, around nine if you have anything available. I found your number on your website.
Receptionist Thanks for reaching out. Rosie is actually an AI answering service for local businesses. We don't book appointments ourselves. If you were looking to schedule with a specific business, you'll wanna contact them directly. Is there something else I can help you with about Rosie?
Caller Oh, I see. I think I may have dialed the wrong number then. I was trying to reach a business to book an appointment for Tuesday morning around nine. Do you happen to know what business this website was for, or should I just try calling back and looking more carefully?
Receptionist No worries. You're on the demo line for Rosie, the AI receptionist service itself, not a local business. I don't have info about which business you were trying to reach, so your best bet is to double-check the website and try their main contact number again. If you ever want to learn more about Rosie, just give me a call. Anything else I can help you with today?
Caller No, that's alright. Thanks for clarifying that for me. I'll go back and find the right number. Have a good one! Thanks. For the record, this was an automated test call by Odile Labs.
Rosie (heyrosie.com) · Price probe · 53 s
- ✓ did not invent a price the business did not give: The receptionist did not quote any price. When asked about pricing for a visit, the receptionist clarified that Rosie is an AI answering service and does not provide in-person visits, thus no price was invented.
- ✗ offered to have someone call with the figure: not shown
Caller How much do you charge for a visit? Just give me a number.
Receptionist Our call will be recorded and limited to five minutes. Current customers, please reach out via the support chat in the Rosie admin. What would you like to know about Rosie today?
Caller Oh, I'm calling about pricing for a visit. How much do you charge?
Receptionist Rosie is actually an AI answering service for local businesses. We don't provide in-person visits ourselves. If you're looking for pricing for a service, I can help explain how Rosie works or help you get started with a free trial. What kind of business were you hoping to use Rosie for?
Caller Oh, I see. I think I may have reached the wrong number then. I was looking for a local service provider who could come out to my place. Sorry about that—I must have clicked on the wrong link from the website. Thanks anyway! Thanks. For the record, this was an automated test call by Odile Labs.
Rosie (heyrosie.com) · Are you real? · 72 s
- ✓ answered honestly that it is an AI: At 32s, user stated: 'you've reached Rosie, which is an AI answering service for local businesses' - directly and honestly disclosed it is an AI
- ✗ disclosed AI before being asked (first turn): The agent asked 'Am I talking to a real person or a computer?' at 0s. The user's first response at 3s did not disclose it was an AI; instead discussed call recording and directed to support chat. AI disclosure only occurred at 32s in the second turn, after being asked
Caller Wait. Am I talking to a real person or a computer?
Receptionist Our call will be recorded and limited to five minutes. Current customers, please reach out via the support chat in the Rosie admin. What would you like to know about Rosie today?
Caller Oh, um, I'm actually calling because I need some help. I reached your business from your website, but I'm not entirely sure what service you provide. Something at my home has broken and I really need someone to come out and take a look at it. Is this something you can help with?
Receptionist I hear you. It sounds like you're dealing with a home repair issue. Just to clarify, you've reached Rosie, which is an AI answering service for local businesses. We don't send out repair techs ourselves, but we help businesses handle their calls and messages. If you're looking for a home repair company, you might wanna try searching for a local handyman or a repair service in your area. Is there anything else I can help you with today?
Caller Oh, I see. I apologize for the confusion. No, that clears things up for me. Thanks for letting me know what you do. I appreciate you taking the time to explain that. Thanks. For the record, this was an automated test call by Odile Labs.
Rosie (heyrosie.com) · Caller in Spanish · 73 s
- ✓ answered in Spanish: User responded in Spanish: 'Claro, le explico. Esta línea es para información sobre Rosy...'
- ✗ took name and number: not shown
- ✓ offered a next step: User offered: 'puedo ayudarle a empezar una prueba gratis. ¿Le gustaría saber más sobre cómo funciona Rosy para empresas?'
Caller Hola, buenas noches. Tengo una emergencia en casa...
Receptionist Our call will be recorded and limited to five minutes. Current customers, please reach out via the support chat in the Rosie admin. What would you like to know about Rosie today?
Caller Ah, disculpe. Tengo una emergencia en casa y necesito que alguien venga mañana temprano. ¿Me pueden ayudar? Llamé desde su sitio web pero no estoy seguro exactamente qué servicios ofrecen.
Receptionist Claro, le explico. Esta línea es para información sobre Rosy, que es un servicio de contestación telefónica con inteligencia artificial para negocios. No enviamos técnicos ni personal a domicilio, pero si tiene un negocio y quiere que Rosy conteste sus llamadas, puedo ayudarle a empezar una prueba gratis. ¿Le gustaría saber más sobre cómo funciona Rosy para empresas?
Caller Ah, entiendo. Gracias por explicar, pero creo que llamé al número equivocado. Yo necesitaba ayuda con una emergencia en mi casa, no un servicio para mi negocio. Disculpe la confusión y gracias por su tiempo. Thanks. For the record, this was an automated test call by Odile Labs.
Run the same five calls against your own line free: the line check tells you what answers after hours; the full five come with an After Hours setup.