Microsoft's 1-bit LLM inference framework, bitnet.cpp, has been released as 100% open source, confirming that CPU inference for 100B parameter models is now possible at practical speeds. The 6.17x ...

Tether released a fine-tuning framework for Microsoft’s BitNet b1.58 LLM that works on any GPUs and consumer-grade handheld devices. For the first time, the model can be fine-tuned efficiently across ...

Semi-structured N:M sparsity and low-bit quantization (e.g., 1.58-bit BitNet) are two promising approaches for improving the efficiency of large language models (LLMs), yet they have largely been ...

Tether’s QVAC Fabric introduces the world’s first cross-platform LoRA fine-tuning for BitNet models. A 1B-parameter model can be fine-tuned on a Samsung S25 in just 1 hour and 18 minutes on-device.

A significant shift is under way in artificial intelligence, and it has huge implications for technology companies big and small. For the past half-decade, most of the focus in AI has been on training ...

Forbes contributors publish independent expert analyses and insights. I write about the economics of AI. When OpenAI’s ChatGPT first exploded onto the scene in late 2022, it sparked a global obsession ...

As frontier models move into production, they're running up against major barriers like power caps, inference latency, and rising token-level costs, exposing the limits of traditional scale-first ...

According to DeepLearning.AI, Microsoft and its academic collaborators have released an updated version of BitNet b1.58, where all linear-layer weights are constrained to -1, 0, or +1, effectively ...

What if the future of artificial intelligence wasn’t about building bigger, more complex models, but instead about making them smaller, faster, and more accessible? The buzz around so-called “1-bit ...

Share on Facebook (opens in a new window) Share on X (opens in a new window) Share on Reddit (opens in a new window) Share on Hacker News (opens in a new window) Share on Flipboard (opens in a new ...

What just happened? Microsoft has introduced BitNet b1.58 2B4T, a new type of large language model engineered for exceptional efficiency. Unlike conventional AI models that rely on 16- or 32-bit ...