Tech Bytes: OpenAI and Broadcom unveil Jalapeño inference chip to power next wave of LLMs

The chip has been designed specifically for large language model inference — the stage where trained AI models generate ...

XMax Announces Up to Approximately US$25 million in AI API-Related Service Contracts and Expansion into GPU-as-a-Service

XMax Inc. (Nasdaq: XMAX) ("XMax" or the "Company") today announced a significant commercial milestone in its artificial ...
InfoQ

JLama: The First Pure Java Model Inference Engine Implemented With Vector API and Project Panama

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Spencer Judge discusses the architectural ...

Upbound Launches Modelplane: The Open Source Control Plane for AI Inference

AI inference is undergoing the same transformation that cloud infrastructure experienced a decade ago. Open-weight models have expanded who runs AI — neoclouds, regulated enterprises, and AI-native ...
Tech Times

OpenAI’s First Custom AI Chip Targets 50% Cheaper Inference: Jalapeño Unveiled

OpenAI’s first custom AI chip Jalapeño was unveiled today in partnership with Broadcom, claiming roughly 50% lower inference ...
Nasdaq

Elasticsearch Open Inference API Extends Support for Hugging Face Models with Semantic Text

Applications using Hugging Face embeddings on Elasticsearch now benefit from native chunking “Developers are at the heart of our business, and extending more of our GenAI and search primitives to ...
SiliconANGLE

OpenRouter nabs $40M in funding for its AI inference API

OpenRouter Inc., a startup working to ease the development of artificial intelligence applications, today announced that it has secured $40 million in funding. The company raised the capital over two ...
Fortune India

OpenAI, Broadcom unveil first custom AI inference chip; target deployment by end-2026 after nine-month development cycle

“Our collaboration with OpenAI represents a fundamental commitment to scaling the physical infrastructure required for the ...
Tech Times

AI Inference and World Model Startups Pull $1.8B in Two Days as Foundation Models Commoditize

AI inference infrastructure investment pulled $1.8 billion in 48 hours as Baseten’s $1.5B round at a $13B valuation and ...
Business Wire

Elasticsearch Open Inference API Now Supports Anthropic’s Claude

SAN FRANCISCO--(BUSINESS WIRE)--Elastic (NYSE: ESTC), the Search AI Company, today announced the Elasticsearch Open Inference API now integrates with Anthropic, providing developers with seamless ...
SDxCentral

Elasticsearch Open Inference API Now Supports Mistral AI Embeddings

Mistral AI embeddings on Elasticsearch benefit from native chunking via a single API call SAN FRANCISCO--(BUSINESS WIRE)--Elastic (NYSE: ESTC), the Search AI Company, today announced the Elasticsearch ...
Business Wire

Elasticsearch Open Inference API now Supports Jina AI Embeddings and Rerank Model

SAN FRANCISCO--(BUSINESS WIRE)--Elastic (NYSE: ESTC), the Search AI Company, announced the Elasticsearch Open Inference API now supports Jina AI’s latest embedding models and reranking products.