Scientific American

How math helped the Allies win World War II

During World War II, statistics helped the Allies estimate the number of enemy tanks, which proved essential in the decisive ...
IEEE

A Survey of AI Inference Technologies for On-Device Systems

Abstract: In recent years, artificial intelligence (AI) technologies represented by foundation models have experienced rapid development. Concurrently, on-device AI inference has become the primary ...

DeepSeek open sources DSpark, a new framework to speed up LLM inference by up to 85%

DSpark can make decoding faster, but acceptance quality still determines how much speed the system actually realizes.

What it Means to Be a Mathematician When AI Does the Math

In the mid-noughties, when music by the Killers and Franz Ferdinand blared out of every pub and nightclub I passed, I spent my days and nights struggling through a Ph. D.
IEEE

Characterizing Cloud-Native LLM Inference at Bytedance and Exposing Optimization Challenges and Opportunities for Future AI Accelerators

Abstract: As a major provider of LLM inference services, ByteDance has continuously explored diverse accelerator options to meet the rapidly growing inference demands of various heterogeneous LLM ...