AI that answers the phone: is it ready?

Every missed call at a clinic, a restaurant or a property office is a customer who rings the next name on the list. Most small businesses know they miss calls at lunch, after hours and on busy days. Few can afford someone to answer the phone all the time.

That is the problem voice agents are meant to solve, and in the past year they have become good enough to take seriously.

What changed

OpenAI made its Realtime API generally available last August, with a speech-to-speech model that listens and replies directly instead of converting everything to text and back, and with support for connecting to ordinary phone lines. Since then it has released several upgrades. The latest, on 6 July, specifically improved how well it catches spelled-out letters and numbers, and how it handles being interrupted. Both are things that used to make phone bots painful.

Google's Live API, which also offers native audio models, supports Arabic and Hindi along with dozens of other languages. Specialist companies such as ElevenLabs sell complete voice agent platforms on top of models like these.

The result is a different experience from the "press 1 for sales" menus everyone hates. A good voice agent today lets the caller speak normally, interrupt, change their mind and ask a follow-up, with only a short pause before it answers.

Calls a voice agent handles well

• Answering the questions people ring about: opening hours, location, parking, prices, whether you do a particular service.
• Taking and changing bookings, when it is connected to your real calendar.
• Taking a message properly: name, number, reason for calling, how urgent it is, sent straight to the right person on WhatsApp or email.
• After-hours cover, so calls at 10pm get an answer instead of voicemail.
• Routing: working out what the caller needs and transferring them to the right person or branch.

Calls it should not handle alone

• Complaints and upset customers. They want a person, and an agent that tries to manage them makes things worse.
• Anything medical, legal or financial beyond reading out your published information.
• Taking card payments by voice.
• Outbound sales calls. Beyond being unwelcome, automated promotional calls are tightly regulated in many places, including India.

What to get right before going live

Voice is less forgiving than text. A chatbot can show a link or a list. A voice agent has to get everything across in speech, in a few seconds, to someone who may be driving.

1. Say it is an AI at the start, in one short sentence. Most callers accept it, and people who find out later often feel misled.
2. Make the transfer to a human easy and fast. "Talk to a person" should always work, and the person should get a summary of the call so far.
3. Read back anything that matters: dates, times, names, phone numbers. Confirmation turns a misheard detail into a quick correction rather than a wasted visit.
4. Keep answers short. One or two sentences, then let the caller respond.
5. Test with real accents, real background noise and real phone lines, not a quiet office and a good microphone. In the Gulf and India, test the language mix your callers actually use.
6. Tell callers if you record or transcribe, and follow the rules on keeping recordings.
7. Review a sample of calls every week, especially in the first month.

What it costs

Voice AI is priced by the minute of conversation or by the amount of audio processed. Cheaper tiers have appeared over the past year, and at current rates a minute of AI time usually costs less than a minute of staff time. Watch for the hidden costs, though: long calls that go nowhere, the telephony provider's charges, and the work of connecting the agent to your calendar and systems, which is usually the biggest part of the job.

A sensible first step

Start with after-hours calls. Point your number to a voice agent only outside opening times, with a narrow job: answer the common questions, take bookings or messages, and promise a callback for everything else. Compare a month of that with a month of voicemail.

If callers get what they need and your team starts the morning with a clean list instead of a pile of missed calls, extend it to lunch hours and busy periods. Keep the human line open throughout. The aim is to stop losing customers to an unanswered phone.