Glossary / Latency

Latency

The delay between a request and its response. For voice assistants and live AI features, low latency is what makes them feel natural.

In the news

• Google launches Gemini Decisions API for multimodal decisions1h ago
• Google announces TPU 8tx and TPU 8i Max systems2d ago
• GitHub announces new Git storage architecture for high-volume repositories5d ago
• Together AI introduces compiler that continually optimizes AI inferenceNov 4
• Google launches Connected Apps Platform previewOct 29
• Google and Oracle plan to bring TPUs to Oracle Cloud in 2027Oct 27
• Google introduces Agent Compute Engine and expands agent governanceOct 22
• Google Cloud adds OpenAI models to its model gardenOct 21
• Mistral AI releases Voxtral 3 speech models and voice agent SDKOct 20
• Google releases llm-d 1.0 for distributed AI inferenceOct 20
• Microsoft plans multi-gigawatt Maia inference deployments in 2027Oct 16