AI agents are poised to transform productivity for the world’s billion knowledge workers with “knowledge robots” that can accomplish a variety of tasks. To develop AI agents, enterprises need to address critical concerns like trust, safety, security and compliance.
New
NVIDIA NIM
microservices for AI guardrails — part of the
NVIDIA NeMo Guardrails
collection of software tools — are portable, optimized inference microservices that help companies improve the safety, precision and scalability of their generative AI applications.
Central to the orchestration of the microservices is NeMo Guardrails, part of the
NVIDIA NeMo
platform for curating, customizing and guardrailing AI. NeMo Guardrails helps developers integrate and manage AI guardrails in large language model (LLM) applications. Industry leaders Amdocs, Cerence AI and Lowe’s are among those using NeMo Guardrails to safeguard AI applications.
Developers can use the NIM microservices to build more secure, trustworthy AI agents that provide safe, appropriate responses within context-specific guidelines and are bolstered against jailbreak attempts. Deployed in customer service across industries like automotive, finance, healthcare, manufacturing and retail, the agents can boost customer satisfaction and trust.
One of the new microservices, built for moderating content safety, was trained using the Aegis Content Safety Dataset — one of the highest-quality, human-annotated data sources in its category. Curated and owned by NVIDIA, the dataset
is publicly available
on Hugging Face and includes over 35,000 human-annotated data samples flagged for AI safety and jailbreak attempts to bypass system restrictions.
NVIDIA NeMo Guardrails Keeps AI Agents on Track
AI is rapidly boosting productivity for a broad range of business processes. In customer service, it’s helping resolve customer issues up to
40% faster
. However, scaling AI for customer service and other AI agents requires secure models that prevent harmful or inappropriate outputs and ensure the AI application behaves within defined parameters.
NVIDIA has introduced three new NIM microservices for NeMo Guardrails that help AI agents operate at scale while maintaining controlled behavior:
Content safety NIM microservice
that safeguards AI against generating biased or harmful outputs, ensuring responses align with ethical standards.
Topic control NIM microservice
that keeps conversations focused on approved topics, avoiding digression or inappropriate content.
Jailbreak detection NIM microservice
that adds protection against jailbreak attempts, helping maintain AI integrity in adversarial scenarios.
By applying multiple lightweight, specialized models as guardrails, developers can cover gaps that may occur when only more general global policies and protections exist — as a one-size-fits-all approach doesn’t properly secure and control complex
agentic AI
workflows.
Small language models, like those in the NeMo Guardrails collection, offer lower latency and are designed to run efficiently, even in resource-constrained or distributed environments. This makes them ideal for scaling AI applications in industries such as healthcare, automotive and manufacturing, in locations like hospitals or warehouses.
Industry Leaders and Partners Safeguard AI With NeMo Guardrails
NeMo Guardrails, available to the open-source community, helps developers orchestrate multiple AI software policies — called rails — to enhance LLM application security and control. It works with NVIDIA NIM microservices to offer a robust framework for building AI systems that can be deployed at scale without compromising on safety or performance.
Amdocs, a leading global provider of software and services to communications and media companies, is harnessing NeMo Guardrails to enhance AI-driven customer interactions by delivering safer, more accurate and contextually appropriate responses.
“Technologies like NeMo Guardrails are essential for safeguarding generative AI applications, helping make sure they operate securely and ethically,” said Anthony Goonetilleke, group president of technology and head of strategy at Amdocs. “By integrating NVIDIA NeMo Guardrails into our amAIz platform, we are enhancing the platform’s ‘Trusted AI’ capabilities to deliver agentic experiences that are safe, reliable and scalable. This empowers service providers to deploy AI solutions safely and with confidence, setting new standards for AI innovation and operational excellence.”
Cerence AI, a company specializing in AI solutions for the automotive industry, is using NVIDIA NeMo Guardrails to help ensure its in-car assistants deliver contextually appropriate, safe interactions powered by its CaLLM family of large and small language models.
“Cerence AI relies on high-performing, secure solutions from NVIDIA to power our in-car assistant technologies,” said Nils Schanz, executive vice president of product and technology at Cerence AI. “Using NeMo Guardrails helps us deliver trusted, context-aware solutions to our automaker customers and provide sensible, mindful and hallucination-free responses. In addition, NeMo Guardrails is customizable for our automaker customers and helps us filter harmful or unpleasant requests, securing our CaLLM family of language models from unintended or inappropriate content delivery to end users.”
Lowe’s, a leading home improvement retailer, is leveraging generative AI to build on the deep expertise of its store associates. By providing enhanced access to comprehensive product knowledge, these tools empower associates to answer customer questions, helping them find the right products to complete their projects and setting a new standard for retail innovation and customer satisfaction.
“We’re always looking for ways to help associates go above and beyond for our customers,” said Chandhu Nair, senior vice president of data, AI and innovation at Lowe’s. “With our recent deployments of NVIDIA NeMo Guardrails, we ensure AI-generated responses are safe, secure and reliable, enforcing conversational boundaries to deliver only relevant and appropriate content.”
To further accelerate AI safeguards adoption in AI application development and deployment in retail, NVIDIA recently announced at the NRF show that its
NVIDIA AI Blueprint for retail shopping assistants
incorporates NeMo Guardrails microservices for creating more reliable and controlled customer interactions during digital shopping experiences.
Consulting leaders Taskus, Tech Mahindra and Wipro are also integrating NeMo Guardrails into their solutions to provide their enterprise clients safer, more reliable and controlled generative AI applications.
NeMo Guardrails is open and extensible, offering integration with a robust ecosystem of leading AI safety model and guardrail providers, as well as AI observability and development tools. It supports integration with
ActiveFence’s ActiveScore
, which filters harmful or inappropriate content in conversational AI applications, and provides visibility, analytics and monitoring.
Hive, which provides its
AI-generated content detection models
for images, video and audio content as NIM microservices, can be easily integrated and orchestrated in AI applications using NeMo Guardrails.
The Fiddler AI Observability platform easily integrates with NeMo Guardrails to enhance AI guardrail monitoring capabilities. And Weights & Biases, an end-to-end AI developer platform, is expanding the capabilities of W&B Weave by adding integrations with NeMo Guardrails microservices. This enhancement builds on Weights & Biases’ existing portfolio of NIM integrations for optimized AI inferencing in production.
NeMo Guardrails Offers Open-Source Tools for AI Safety Testing
Developers ready to test the effectiveness of applying safeguard models and other rails can use
NVIDIA Garak
— an open-source toolkit for LLM and application vulnerability scanning developed by the NVIDIA Research team.
With Garak, developers can
identify vulnerabilities
in systems using LLMs by assessing them for issues such as data leaks, prompt injections, code hallucination and jailbreak scenarios. By generating test cases involving inappropriate or incorrect outputs, Garak helps developers detect and address potential weaknesses in AI models to enhance their robustness and safety.
Availability
NVIDIA NeMo Guardrails microservices, as well as
NeMo Guardrails
for rail orchestration and the
NVIDIA Garak
toolkit, are now available for developers and enterprises. Developers can get started building AI safeguards into AI agents for customer service using NeMo Guardrails with
this tutorial
.
See
notice
regarding software product information.
Categories:
Generative AI
Tags:
Artificial Intelligence
|
Cybersecurity
|
NVIDIA Blueprints
|
NVIDIA NeMo
|
NVIDIA NIM
AI 代理為全球數十億名知識工作者提供可完成各種任務的「知識機器人」，改變他們的生產力。而為了開發 AI 代理，企業需要解決信任、安全、保全及法遵等關鍵問題。
作為
NVIDIA NeMo Guardrails
軟體工具集的一部分，全新用於人工智慧（AI）防護工作的
NVIDIA NIM
微服務是一款可攜式且經過最佳化的推論微服務，可以協助企業提高其生成式 AI 應用的安全性、精確性與可擴充性。
NeMo Guardrails 是這些微服務的協調核心，也是用於彙整、客製化和為 AI 提供保護的
NVIDIA NeMo
平台一部分。NeMo Guardrails 可協助開發人員在大型語言模型（LLM）應用中整合與管理 AI 防護工作。Amdocs、Cerence AI 和 Lowe’s 等業界領導廠商均使用 NeMo Guardrails 來保護 AI 應用。
開發人員可以使用 NIM 微服務來建立更安全、更值得信賴的 AI 代理，在特定情境的指引下提供安全且適當的回應，並且加強防禦嘗試越獄的行為。這些代理可以部署在汽車、金融、醫療保健、製造和零售等產業的客戶服務中，以提升客戶滿意度和信任度。
其中一個新的微服務是為了控制內容安全而建立，使用 Aegis 內容安全資料集（Aegis Content Safety Dataset）進行訓練，該資料集是同類型中品質最高、經人工註解的資料來源之一。Aegis 內容安全資料集由 NVIDIA 編輯和擁有，並在 Hugging Face 上
公開提供
，其中包括超過 35,000 個經人工註解的資料樣本，標示為 AI 安全和試圖繞過系統限制的越獄行為。
NVIDIA NeMo Guardrails
讓
AI
代理保持正常運作
AI 正在快速提升各種業務流程的工作效率。在客戶服務方面，AI 協助解決客戶問題的速度
加快了 40%
。然而，為客戶服務及其他 AI 代理擴大 AI 規模需要輔以安全的模型，以避免輸出有害或不當內容，並且確保 AI 應用的按照訂定的參數運作。
NVIDIA 為 NeMo Guardrails 推出三款全新的 NIM 微服務，可協助 AI 代理大規模運作，同時確保行為受到控制：
內容安全
NIM
微服務
可避免 AI 產生偏見或有害的輸出內容，確保回應內容符合道德標準。
主題控制
NIM
微服務
使得對話專注於經核准的主題上，避免離題或出現不當內容。
越獄偵測
NIM
微服務
可增加對越獄嘗試的防護，協助在對抗性情境中維持 AI 的完整性。
透過應用多種輕量、專用的模型作為防護措施，開發人員可以補足只有適用於一般情況的全面性政策與保護措施時可能出現的缺口，因為一體適用的做法無法妥善保護與控制複雜的
AI 代理
工作流程。
小型的語言模型，如 NeMo Guardrails 系列中的模型，可提供較低的延遲，即使在資源有限或分散式環境中也能高效率地執行。這使得它們成為醫療保健、汽車和製造業等產業在醫院或倉庫等地點擴大 AI 應用範圍的理想選擇。
業界領導廠商與合作夥伴利用
NeMo Guardrails
保護
AI
開放給開源社群使用的 NeMo Guardrails，可協助開發人員協調多種稱為 rails的 AI 軟體原則，以增強大型語言模型應用的安全性與控制能力。它可以與 NVIDIA NIM 微服務搭配使用，提供建置 AI 系統的強大框架，並在不影響安全性或效能的情況下進行大規模部署。
Amdocs 是全球領先的通訊與媒體公司軟體及服務供應商，該公司正使用 NeMo Guardrails 提供更安全、準確且符合情境的回應內容，以強化 AI 驅動的客戶互動。
Amdocs 科技事業群總裁暨策略部門主管 Anthony Goonetilleke 表示：「像 NeMo Guardrails 這樣的技術對於保護生成式 AI 應用的安全來說是非常重要的，能夠確保它們能安全且符合道德標準地進行運作。透過將 NVIDIA NeMo Guardrails 整合至 amAIz 平台，我們強化了平台的『可信任 AI』功能，以提供安全、可靠且具擴充能力的代理體驗。這讓服務供應商能夠安全放心地部署 AI 解決方案，為 AI 創新和卓越營運樹立新標準。」
專為汽車產業提供 AI 解決方案的 Cerence AI 正在使用 NVIDIA NeMo Guardrails 來協助確保其車載助理能夠在該公司 CaLLM 系列大小語言模型的支援下，提供符合情境的安全互動。
Cerence AI 產品與技術部門執行副總裁 Nils Schanz 表示：「Cerence AI 仰賴 NVIDIA 的高效能、安全解決方案來支援我們的車載助理技術。使用 NeMo Guardrails 能夠幫助我們為汽車製造商客戶提供可信賴的情境感知解決方案，並且提供合理、貼心且無幻覺的回應。NeMo Guardrails 還能配合汽車製造商客戶的需求進行客製化，同時協助我們過濾有害或令人不愉快的請求，確保我們的 CaLLM 語言模型系列不會向終端使用者傳送非預期或不當的內容。」
領先的家居裝修零售商 Lowe’s 正在使用生成式 AI 來培養店員具備深厚的專業知識。這些工具能夠讓店員取得更全面的產品知識，協助他們回答客戶的問題，並幫助找到完成裝修案所需的合適產品，同時為零售創新和客戶滿意度立下新標準。
Lowe’s 資料、AI 與創新部門資深副總裁 Chandhu Nair 表示：「我們一直在尋找方法幫助員工為客戶提供超乎期望的服務。透過最近部署的 NVIDIA NeMo Guardrails，我們可以確保 AI 產生出安全、穩妥且可靠的回應，為對話內容設下邊界，只提供相關且適當的內容。」
為了進一步加快在零售業 AI 應用開發和部署的過程中採用 AI 防護措施，NVIDIA 最近在 NRF 大會上宣布，其
適用於零售購物助理的 NVIDIA AI Blueprint
整合 NeMo Guardrails 微服務，以在數位購物體驗中創造更可靠、控制程度更高的客戶互動。
顧問業領導廠商 Taskus、Tech Mahindra 與 Wipro 也將 NeMo Guardrails 與該公司的解決方案進行整合，為企業客戶提供更安全、可靠且可控的生成式 AI 應用。
NeMo Guardrails 具有開放性和可擴展性，可與領先的 AI 安全模型和防護解決方案供應商，以及 AI 可觀察性和開發工具組成的強大的生態系進行整合。它支援與
ActiveFence 的 ActiveScore
整合，可以過濾對話式 AI 應用中的有害或不當內容，並且提供可視性、分析與監控等功能。
Hive 以 NIM 微服務的方式提供該公司針對圖片、影片和聲音內容的
AI 生成內容偵測模型
，可輕鬆整合至使用 NeMo Guardrails 的 AI 應用中並進行協調。
Fiddler AI Observability 平台能輕鬆與 NeMo Guardrails 整合，強化 AI 防護功能的監控能力。而端對端的 AI 開發者平台 Weights & Biases，則是透過加入與 NeMo Guardrails 微服務的整合，來擴充 W&B Weave 的功能。這項增強功能建立在 Weights & Biases 現有的 NIM 整合產品組合上，能夠在生產環境裡最佳化 AI 推論結果。
NeMo Guardrails
提供
AI
安全測試開源工具
準備測試應用安全防護模型和其他 rails 效果的開發人員，能夠使用 NVIDIA Research 團隊開發用於掃描大型語言模型及應用程式漏洞的開源工具包
NVIDIA Garak
。
透過使用 Garak，開發人員可以評估使用大型語言模型的系統是否存在資料外洩、提示注入、程式碼幻覺和越獄情境等問題，從而
找出系統中的漏洞
。Garak 可以藉由產生涉及不適當或不正確輸出內容的測試案例，協助開發人員偵測及解決 AI 模型中的潛在漏洞，以提升其穩健性與安全性。
上市時程
NVIDIA NeMo Guardrails 微服務，以及用於協調 rail 的
NeMo Guardrails
和
NVIDIA Garak
工具包，現已提供給開發人員和企業使用。開發人員可以利用
此教學內容
開始使用 NeMo Guardrails，為用於客戶服務的 AI 代理建置 AI 防護措施。
軟體產品資訊請參見
公告
。
Categories:
生成式人工智慧
Tags:
Artificial Intelligence
|
cybersecurity
|
NVIDIA Blueprints
|
NVIDIA NeMo
|
NVIDIA NIM