NVIDIA recently announced the availability of new microservice programs aimed at enabling organizations to embrace agentic AI without sacrificing security or latency.
New NIM programs bring guardrails across content, access, and more
The added microservices are a new component of NVIDIA’s pre-existing NeMo Guardrails, part of the NeMo platform built for curating, customizing, and guardrailing AI.
NVIDIA has introduced the new microservices to help businesses deploy AI agents that operate at scale while maintaining controlled behavior. They focus on the following areas:
- Content safety: to safeguard AI against generating biased or harmful outputs, ensuring responses align with ethical standards.
- Topic control: to keep conversations focused on approved topics, avoiding digression or inappropriate content.
- Jailbreak detection: to add protection against jailbreak attempts, helping maintain AI integrity in adversarial scenarios.
“By applying multiple lightweight, specialized models as guardrails, developers can cover gaps that may occur when only more general global policies and protections exist— as a one-size-fits-all approach doesn’t properly secure and control complex agentic AI workflows,” Vice President of AI Software Product Management Kari Briski said in a post on NVIDIA’s website.
“Technologies like NeMo Guardrails are essential for safeguarding generative AI applications, helping make sure they operate securely and ethically,” said Anthony Goonetilleke, group president of technology and head of strategy at Amdocs, one of the companies utilizing NeMo Guardrails. “By integrating NVIDIA NeMo Guardrails into our amAIz platform, we are enhancing the platform’s ‘Trusted AI’ capabilities to deliver agentic experiences that are safe, reliable and scalable. This empowers service providers to deploy AI solutions safely and with confidence, setting new standards for AI innovation and operational excellence.”
Agentic AI: the new adoption cycle
Anyone who has been reading tech coverage, in the channel or beyond it, should by now not be surprised to encounter the phrase “agentic AI.” In many ways, the new push towards adopting AI agents echoes 2024’s push towards generative AI, then the newest application of LLMs.
Now, companies are betting big on the next iteration of artificial intelligence and AI agents spurring a new era of automation and efficiency.
“I know agents have been all the buzz, but we have seen real progress in our partners using agents in their businesses,” said Briski in a media briefing.
Of course, NVIDIA is no stranger to the world of cutting-edge AI adoption and implementation. In October the company unveiled a slew of other microservices dedicated to helping partners and customers across industries utilize GenAI copilots and agents more efficiently.
NVIDIA also continues to partner with other providers to best support AI adoption worldwide. Read more about the recent agreement between NVIDIA, KION, and Accenture focused on AI in supply chain management.