Scientific American

How math helped the Allies win World War II

During World War II, statistics helped the Allies estimate the number of enemy tanks, which proved essential in the decisive ...

DeepSeek open sources DSpark, a new framework to speed up LLM inference by up to 85%

DSpark can make decoding faster, but acceptance quality still determines how much speed the system actually realizes.

What it Means to Be a Mathematician When AI Does the Math

In the mid-noughties, when music by the Killers and Franz Ferdinand blared out of every pub and nightclub I passed, I spent my days and nights struggling through a Ph. D.
IEEE

Characterizing Cloud-Native LLM Inference at Bytedance and Exposing Optimization Challenges and Opportunities for Future AI Accelerators

Abstract: As a major provider of LLM inference services, ByteDance has continuously explored diverse accelerator options to meet the rapidly growing inference demands of various heterogeneous LLM ...
GitHub

Whisper.cpp: Port of OpenAI's Whisper model in C/C++

The entire high-level implementation of the model is contained in whisper.h and whisper.cpp. The rest of the code is part of the ggml machine learning library. Having such a lightweight implementation ...
IEEE

Defending against Membership Inference Attacks in Federated learning via Adversarial Example

Abstract: Federated learning has attracted attention in recent years due to its native privacy-preserving features. However, it is still vulnerable to various membership inference attacks, such as ...