OpenAI API — October, 2024

October 1, 2024

This release introduces the gpt-4o-audio-preview model, offering robust audio input and output capabilities, alongside five new voice types for enhanced audio experiences in the Realtime and Chat Completions APIs. Significant new features from DevDay include model and image fine-tuning for GPT-4o vision, a platform for custom model evaluations, and prompt caching for cost savings and faster processing. These updates provide developers with advanced tools for building sophisticated audio applications, optimizing model performance, and streamlining development workflows.

Added

Added five new voice types in the Realtime API and Chat Completions API.
Released new gpt-4o-audio-preview model for chat completions, which supports both audio inputs and outputs. Uses the same underlying model as the Realtime API.
Released several new features at OpenAI DevDay in San Francisco:

Changed

Realtime API: Build fast speech-to-speech experiences into your applications using a WebSockets interface.
Model distillation: Platform for fine-tuning cost-efficient models with your outputs from a large frontier model.
Image fine-tuning: Fine-tune GPT-4o with images and text to improve vision capabilities.
Evals: Create and run custom evaluations to measure model performance on specific tasks.
Prompt caching: Discounts and faster processing times on recently seen input tokens.
Generate in playground: Easily generate prompts, function definitions, and structured output schemas in the playground using the Generate button.