Couchbase Services to Integrate with NVIDIA Microservices

Couchbase, a developer data platform for critical AI applications, recently announced that it will integrate its Capella AI Model Services with NVIDIA NIM microservices, part of the NVIDIA AI Enterprise software platform.

Integration streamlines AI deployment for enterprise-level success

Through this integration, the AI model services will streamline the deployment of AI-powered applications, providing enterprises with a powerful solution for privately running GenAI models.

“Enterprises require a unified and highly performant data platform to underpin their AI efforts and support the full application lifecycle– from development through deployment and optimization,” said Matt McDonough, SVP of product and partners at Couchbase. “By integrating NVIDIA NIM microservices into Capella AI Model Services, we’re giving customers the flexibility to run their preferred AI models in a secure and governed way, while providing better performance for AI workloads and seamless integration of AI with transactional and analytical data. Capella AI Services allow customers to accelerate their RAG [retrieval-augmented generation] and agentic applications with confidence, knowing they can scale and optimize their applications as business needs evolve.”

Capella AI Model Services were recently introduced as part of a comprehensive offering to streamline agentic application development, provide managed endpoints for LLMs, and embed models for privacy, performance, scalability, and latency requirements. The services streamline agent application development and operations by keeping models and data colocated in a unified platform, which facilitates agentic operations as they happen.

Enabled by NVIDIA AI Enterprise, Capella AI Model services will be able to minimize latency by bringing AI closer to the data, combining GPU-accelerated performance and enterprise-grade security to empower organizations to operate AI workloads seamlessly.

Additionally, this collaboration between Couchbase and NVIDIA will enhance Capella’s agentic AI and RAG capabilities, thus allowing customers to efficiently power high-throughput AI-powered applications while maintaining model flexibility.

Capella’s fully integrated user experience

Through the Capella AI Model Services, Couchbase is helping organizations address challenges such as ensuring agent reliability and compliance, personally identifiable information (PII) data leaks, and managing multiple specialized databases, creating unsustainable operational overhead.

“Integrating NVIDIA AI software into Couchbase’s Capella AI Model Services enables developers to quickly deploy, scale, and optimize applications,” said Anne Hecht, senior director of enterprise software at NVIDIA. “Access to NVIDIA NIM microservices further accelerates AI deployment with optimized models, delivering low-latency performance and security for real-time intelligent applications.”

Capella AI Model Services with NVIDIA NIM provides Couchbase customers with a cost-effective solution that accelerates agent delivery by simplifying model deployments while maximizing resource utilization and performance. The solution leverages pre-tested LLMs and tools, like NVIDIA NeMo Guardrails, to assist businesses in accelerating AI development while enforcing policies and safeguards against AI hallucinations.

NVIDIA recently launched new microservices for NeMo Guardrails to assist enterprises in deploying AI agents. Read more about these new microservice programs and how they enable organizations to embrace agentic AI.