|
Listen to this story
|
OpenAI has announced the introduction of new enterprise-grade features for its API customers. The new features include enhanced security, better administrative control, improvements to the Assistants API, and more options for cost management.
This latest announcement builds upon previous enterprise offerings, with a focus on API customers. The new features include Private Link for secure communication between Azure and OpenAI, native Multi-Factor Authentication for access control, and a new Projects feature for granular control and oversight over individual projects within the organisation.
OpenAI also introduced updates to its Assistants API, including improved retrieval with ‘file_search’, streaming support for real-time responses, and new ‘vector_store’ objects for simplified file management and billing.
To help organisations manage costs, the company now offers discounted usage on committed throughput for GPT-4 and GPT-4 Turbo, as well as reduced costs on asynchronous workloads through its new Batch API.
The company works with a wide range of enterprises, including Morgan Stanley, Salesforce, Healthify, Stripe, Khan Academy, Duolingo etc. According to the blog, it plans to add more features focused on enterprise-grade security, administrative controls, and cost management to support the safe and effective deployment of AI across various industries and use cases.
In addition to enhancing enterprise API capabilities, OpenAI introduced an instruction hierarchy to protect language models (LLMs) from vulnerabilities such as prompt injections and jailbreaks. This new security layer ensures that when faced with multiple instructions, the model prioritises those that are higher-privileged or align with them, enhancing robustness and safety. Misaligned instructions, which conflict with primary directives, will be disregarded by the model, thereby preventing manipulation and unauthorised actions.
