RESEARCH PAPER: Untether AI – Where Performance Intersects With Efficiency

By Matt Kimball, Patrick Moorhead - May 1, 2024

AI is the most disruptive and transformational technology trend we have witnessed. And its unique requirements impact virtually every element of the technology stack – from silicon to compute platforms to software.

While most of the focus has been on the training aspect of AI – the shaping and modeling of datasets – inference, or what to do with trained data, is where the value of this workload is realized. The platforms that perform inference will be broadly deployed because inference happens everywhere and requires real-time responsiveness.

You can download the paper by clicking on the logo below:

Table Of Contents

  • Situation Analysis
  • Breaking Down AI – Training Is Temporary, Inference Lasts Forever
  • The Unique Requirements Of Inference
  • Purpose Built Should Be Purpose Designed
  • Untether AI Delivers Inference Designed For Performance, Openness, And Efficiency
  • Summary
  • Figure 1: Inference For Sentiment Analysis

Companies Cited

  • AMD
  • NVIDIA
  • Untether AI
Matthew Kimball
+ posts

Matt Kimball is a Moor Insights & Strategy senior datacenter analyst covering servers and storage. Matt’s 25 plus years of real-world experience in high tech spans from hardware to software as a product manager, product marketer, engineer and enterprise IT practitioner.  This experience has led to a firm conviction that the success of an offering lies, of course, in a profitable, unique and targeted offering, but most importantly in the ability to position and communicate it effectively to the target audience.

Patrick Moorhead
+ posts

Patrick founded the firm based on his real-world world technology experiences with the understanding of what he wasn’t getting from analysts and consultants. Ten years later, Patrick is ranked #1 among technology industry analysts in terms of “power” (ARInsights)  in “press citations” (Apollo Research). Moorhead is a contributor at Forbes and frequently appears on CNBC. He is a broad-based analyst covering a wide variety of topics including the cloud, enterprise SaaS, collaboration, client computing, and semiconductors. He has 30 years of experience including 15 years of executive experience at high tech companies (NCR, AT&T, Compaq, now HP, and AMD) leading strategy, product management, product marketing, and corporate marketing, including three industry board appointments.