AMD Introduces FlyDSL Mono Kernels for Enhanced LLM Serving
AMD's FlyDSL Mono Kernels aim to reduce decode latency in large language model serving by optimizing GPU workloads and improving interactivity.
995 articles
The tools, frameworks, and platforms developers use to build with AI — coding assistants, agent frameworks, APIs, and developer tooling, with the updates that change how you ship.
AMD's FlyDSL Mono Kernels aim to reduce decode latency in large language model serving by optimizing GPU workloads and improving interactivity.
AWS highlights Cartesia's use of State Space Models (SSMs) to deliver sub-100ms text-to-speech and speech-to-text for real-time voice applications.
AWS demonstrates how to build a semantic layer for agentic AI using EDB Postgres AI and Amazon Bedrock AgentCore, enabling agents to answer customer 360 questions by integrating business meaning directly into the database.
Gen Digital's Norton Revamp platform now leverages Amazon Bedrock AgentCore Web Search to provide real-time, AI-curated news feeds for professionals.
AWS now allows AI agents to interact with enterprise APIs while preserving user identity through a new token exchange feature with Microsoft Entra ID.
Amazon Quick now allows users to analyze both structured and unstructured data through a single conversational AI agent, streamlining workflows that previously required multiple tools.
IBM's CUGA harness outperformed alternatives in a benchmark, showing how the right tool can significantly boost task completion rates for enterprise automation.
NVIDIA and partners are deploying AI solutions to enhance urban services, from digital twins to vision agents, with shared computing infrastructure enabling city departments and developers to build AI applications without individual resource investments.
Tom's Hardware provides a primer on key AI concepts like KV cache, weights, and quantization to help users understand recent developments in AI model terminology.
LinearB Inc. introduces Agentic Studio to help manage the increased complexity of software delivery pipelines caused by AI coding tools, offering unified context for both human engineers and autonomous agents.
Anthropic has updated Claude Code to prevent users from cloning existing video games, following a surge in AI-generated knockoffs.
Google Cloud announced updates to its AI infrastructure, including new compute services, open-source models, and tools for scalable AI workloads.