GPT-4o (May '24)

GPT-4o, where the "o" stands for omni, is an omnimodal large language model introduced by OpenAI in May 2024. It is designed to process and generate any combination of text, audio, and images. Unlike previous versions that utilized separate models for different modalities (such as separate transcription and text-to-speech models), GPT-4o is a single neural network trained end-to-end across all data types. This architecture significantly reduces latency and enables the model to perceive and express emotional nuance in voice interactions. ## Performance and Capabilities The model matches the reasoning and coding performance of GPT-4 Turbo while delivering faster response times. It supports over 50 languages and features an improved tokenizer that reduces token usage for many non-English scripts. Additionally, GPT-4o offers enhanced vision capabilities, allowing it to interpret and discuss images or visual inputs from documents and live video feeds in real time. For developers, the model is designed to be more efficient than its predecessors, offering higher rate limits and reduced costs for API usage compared to previous flagship iterations.