Every automation team eventually hits the same wall: you want your automations and processes to understand messy, unstructured text — customer emails, support tickets, invoice line items — but calling a cloud LLM means sending that data outside your organization, paying per-call costs, and depending on an internet connection that might not always be there.
LocalAI removes that tradeoff entirely. It brings real, on-device AI to your Automation Anywhere bots — no cloud, no API keys, no GPU. Using llama.cpp, LocalAI runs seven curated small language models directly on your Bot Agent's CPU, achieving 5-20 tokens/second on a typical 8-core machine.
Once your text is available in a bot — already extracted from a document, email, or ticket — LocalAI's ten actions can classify it into custom categories, pull named fields into a Dictionary, summarize long threads, redact PII before it's logged or sent externally, normalize inconsistent formats like phone numbers and dates, repair malformed JSON, or handle any custom free-form prompt you write.
Models download once (2-3.5GB each) and then run fully offline — perfect for air-gapped or high-security environments. Nothing you send through LocalAI ever leaves your machine, and none of it is ever used to train a model, anywhere.
If you've been automating with rules and triggers and are ready to add real AI — securely, and at no additional cost — LocalAI is where to start.