SILICON BEDROCK: CHIPS AS THE BACKBONE OF AI INFRASTRUCTURE
This report provides an overview of critical terms and theories related to AI chips, examines the global AI semiconductor market, highlights notable companies, and offers insights into the US export controls and regulations
SUMMARY
AI Semiconductors:
Concepts and the Global Market
December 20, 2024
AI Chips: Typology & Value Chain
Semiconductor chips are a critical element of the artificial intelligence industry. They provide the hardware infrastructure required to meet modern AI systems' computational needs, scalability, and energy efficiency. As AI evolves, the semiconductor industry will play a critical role in shaping the capabilities of AI technologies.
TERMS
  • Semiconductors are the cornerstone of chip production. Without them, it would be impossible to create transistors, which are the basic elements of computing devices. Silicon is the basic material for chips.
  • Chip (microchip) is a general term for any chip created from a semiconductor material (usually silicon) that contains electronic circuits. Chips can be individual components or part of larger systems.
Semiconductor chip components can be classified as active and passive elements. Transistors are the core of a chip and consist of three key components: source, gate, and drain. They are used to amplify or switch electrical signals.

A chip's main functions are data processing, data storage, signal transmission, and input/output (I/O) operations.

There are two types of chips: digital and analog. Analog chips accept continuous signals, such as sound or light, and perform basic functions like turning on a flashlight when a button is pressed. Digital chips are based on binary values: 1 or 0. They are more complex and the most common.

The digital chip market can be split into two categories: Logic Chips (CPUs, GPUs, FPGAs, ASICs) and Memory Chips.
Сhip types

Semiconductor manufacturing is one of the most complex industrial systems in human history, consisting of many stages.

Semiconductor design and manufacturing ecosystem
Silicon wafers are formed from raw materials (most often silicon) and undergo steps such as deposition, coating, lithography, etching, ionization, cleaning, chemical and mechanical polishing, testing, and other equally important steps.

Specialized equipment is required to perform all of the above operations.

The most well-known hardware manufacturers
  • ASML
    • Lithographic equipment
  • Applied Materials
    • Equipment for chip deposition
    • Polishing
    • Ion implantation and packaging
  • Tokyo Electron Limited
    • Сoating and etching equipment
  • Lam Research
    • Etching equipment
  • KLA Corporation
    • Wafer inspection equipment for defects
The chips are then tested and packaged before becoming part of a computing system.

Chips are designed by so-called Fabless Chip Firms, which often do not have their own production facilities. These firms include NVIDIA, Qualcomm, AMD, Mediatek, Marvell, Broadcom, and others. According to various estimates, Nvidia is the undisputed leader in AI chip development, accounting for between 70% and 95% of all sales.

Fabless Chip Firms are outsourcing the AI chip manufacturing function to semiconductor factories. TSMC makes over 60% of all chips worldwide for over 500 companies, including Nvidia, Apple, AMD, Broadcom, Marvell, MediaTek, Qualcomm and others.

It should be noted that some companies are developing and manufacturing AI chips. These include Samsung, Intel, Micron Technology, and Texas Instruments. Such companies are called integrated manufacturers.

LTM revenue top 7 Fabless chip firms, 2024 3Q

Number of plants under expansion, by region


The high concentration of production in Taiwan is a source of concern, especially for the US, which has been very supportive of the construction of semiconductor plants in Taiwan.

In 2024, the total number of semiconductor plants in expansion mode reached 19. Expansion involves adding new facilities to an existing site rather than building a new plant. Growth in North America is driven by the final stages of construction of one of TSMC's new fabs in Arizona called Fab 21-1. Unofficially, Fab 21-1 is already producing A16 Bionic chips for Apple.

Number of existing and planned Fabs in North America by chip maker

Virtually all major projects to build new semiconductor manufacturing capacity in the US have run into difficulties in 2024 and have had to postpone production startup for months or even years into the future.

For example, Samsung Foundry, a subsidiary of Samsung Electronics, had planned to build new factories totaling 12 Fabs in Texas (Austin and Taylor). However, the company is now facing significant construction delays.

US Export Regulation & AI Semiconductor Market
Total US government spending on microelectronics has increased significantly over the past year, from $2.5B in 2022 to $3.9B in 2023. A significant portion of this spending is allocated in contracts – $3.33B in 2023, with another $0.55B in grants.

US government spending on microelectronics by segment, 2018-2023

In October 2022, the US Department of Commerce imposed controls that require licenses to export to China and Macau certain advanced logic and other chips that can be used to train AI models and build supercomputers. However, because many AI models are trained using cloud services, Congress may consider export control reform allowing the Commerce Department to oversee cloud service providers that sell access to large amounts of computing power.

In August 2022, President Biden n signed P.L. 117-167, known as the CHIPS and Science Act. The Act will provide $39B to expand domestic semiconductor manufacturing capacity, $13.2B for research and development of next-generation semiconductor technologies, and $500M for national information security. According to an official White House statement, in August 2023, the companies announced investments of more than $395B in semiconductors and electronics and the creation of more than 115,000 jobs.
market size

According to Gartner, global AI semiconductor revenue is projected to reach $71B in 2024, up 33% from 2023 and $197.5B in 2028, growing at a CAGR of 29.7%.

Semiconductor market revenue worldwide from 1987 to 2025, $B

  • AI-related workloads are expected to grow at a CAGR of 25-35% through 2027, leading to a significant increase in demand for semiconductors related to artificial intelligence.

  • Deloitte expects GenAI chip sales to reach $50B in 2024, accounting for about 8.5% of total chip sales in value terms.
  • Integrated circuit sales in the semiconductor industry are expected to grow 27% year over year, mainly due to demand for AI chips and related technologies.

  • According to a report by Bain & Company, the semiconductor supply chain may not cope with the growing demand, which could lead to another global shortage by 2026.
M&A & IPO activity

According to KPMG, M&A activity in the semiconductor industry increased significantly in 2024 compared to 2023, from 33 to 44 deals in the first eight months of the year. Deal volume rose from $2.7B to $45.4B, mainly driven by two large deals in electronic design automation (EDA).


The increased activity of 2021 in all markets also affected the semiconductor sector, with five companies going public. Although only one IPO occurred in 2023 (Arm went public on Nasdaq), it was one of the largest and most successful IPOs of the entire year.

Semiconductors – Dynamics of SPAC / IPO number and volume, 2019 - 2024 (8 months)

Semiconductors – Dynamics of the number of VC deals, 2015 - 2024 (11 months)

The compound annual growth rate (CAGR) of the number of deals in the semiconductor venture capital market from 2015 to 2023 was 33.68%. In the first 11 months of 2024, venture capital firms closed 521 deals, down 46% from a year earlier.

Semiconductors – Dynamics of the number of VC volume, 2015 - 2024 (11 months)

Venture capital investment in the semiconductor market grew from $0.39B in 2015 to $9.44B in 2024 (11 months). The compound annual growth rate (CAGR) for 2015-2023 was 57.33% (and 42.48% from 2015 to partial 2024).

AI & ML Semiconductors – Number of Exits, 2015 - 2024 (11 months)

In the first 11 months of 2024, 26 exits occurred in AI & ML Semiconductors. Of these, 16 were via M&A, 8 were via IPO, and 1 each as a result of a Buyout/Secondary Buyout.

Selected Companies
  • SambaNova Systems
    SambaNova Systems is an American startup with no manufacturing facilities. It develops chips and its own AI platform.
    SambaNova RDU (Reconfigurable Dataflow Unit), SN40L, is an advanced AI chip developed by SambaNova Systems and designed to optimize the performance of large-scale AI & ML applications.

    • Year founded: 2017
    • Country: CA, USA
    • Number of employees: 478 (September 20, 2024)
    • Chip Producer: TSMC
    • LFR: Later Stage VC
    • LFR date: August 1, 2024
    • LFR amount: N/A
    • Last known valuation: $5.0 B (Series D, April 2021)
  • Lightmatter
    Lightmatter is an American startup without in-house manufacturing facilities that designs and develops photonic computing processors.
    These processors use light and advanced optics to perform calculations that power AI models.

    • Year founded: 2017
    • Country: CA, USA
    • Number of employees: 200 (October 16, 2024)
    • Outsourced Semiconductor Assembly and Test (OSAT): Amkor Technology
    • LFR: Series D
    • LFR date: October 16, 2024
    • LFR amount: $400 M
    • Last known valuation: $4.40 B
  • Groq
    Groq is an American startup without production facilities that develops semiconductors and software for deploying and running AI models, particularly LLMs.
    The LPU (Language Processing Unit) is the company's main product. The Groq LPU has a single-core unitTensor-Streaming Processor that delivers up to 750 TOPS INT8 and up to 188 Tflops FP16.

    • Year founded: 2016
    • Country: CA, USA
    • Number of employees: 200 (August 5, 2024)
    • Chip Producer: Samsung (since 2026)
    • LFR Series: D
    • LFR date: August 5, 2024
    • LFR amount: $640 M
    • Last known valuation: $2.80 B
  • Celestial AI
    Celestial AI is an American startup without in-house manufacturing facilities specializing in optical interconnect technologies.
    Celestial AI's Photonic Fabric technology is an optical interconnect platform for computing and memory that integrates photonics into AI gas pedals to address the limitations of traditional transistor-based computing.

    • Year founded: 2020
    • Country: CA, USA
    • Number of employees: 114 (September 10, 2024)
    • Chip Producer: Samsung
    • LFR Series: C
    • LFR date: March 26, 2024
    • LFR amount: $175 M
    • Last known valuation: $1.18 B
  • Ayar Labs
    Ayar Labs is a US startup without in-house silicon photonics manufacturing facilities. Ayar Labs' AI-optimized optical input/output solution combines TeraPHY transceivers with the SuperNova multi-wavelength laser to provide multi-terabit bandwidth directly from GPUs, CPUs, or other gas pedals.

    • Year founded: 2015
    • Country: CA, USA
    • Number of employees: 175 (August 21, 2024)
    • Chip Producer: GlobalFoundries
    • LFR: Series C1
    • LFR date: April 1, 2023
    • LFR amount:, $25 M
    • Last known valuation: $0.5 B
  • d-Matrix
    d-Matrix is an American startup without the production facilities to develop AI chips. Corsair's AI chip is specifically designed to efficiently solve AI inference problems. It utilizes the d-Matrix Digital In-Memory Compute (DIMC) architecture, which integrates memory and computation.

    • Year founded: 2019
    • Country: CA, USA
    • Number of employees: 196 (September 10, 2024)
    • Chip Producer: TSMC
    • LFR: Series B
    • LFR date: September 6, 2023
    • LFR amount: $110 M
    • Last known valuation: $0.4B

Download the full version of the report

I am interested in:
By clicking the button, you consent to the processing of personal data and agree to the privacy policy.