Liquid Foundation Models

Event CoreRenowned developer /u/xenovatech (the creator of Transformers.js) has demonstrated a significant milestone in mobile AI: LFM3-Omni-2B running fully offline on an iPhone 18 Pro Max (likely referring to high-end Apple Silicon performance) at a blistering ~80 tokens per second. Powered by custom WebGPU kernels within a React Native environment, this feat showcases the convergence of highly efficient non-Transformer architectures and low-level hardware acceleration on edge devices.In-depth DetailsThe technical brilliance of this demonstration lies in the synergy between the Liquid Foundation Model (LFM) architecture and the execution layer. Unlike standard Transformers that struggle with memory bandwidth on mobile, LFMs utilize a more efficient computational graph. Architecture Efficiency: Liquid AI’s models are designed for continuous-time data processing, offering superior scaling and lower memory overhead compared to traditional attention mechanisms. This allows a 2B model to punch significantly above its weight class in terms of throughput.WebGPU as the Equalizer: By bypassing high-level abstractions and implementing custom WebGPU kernels, the developer tapped directly into the GPU's raw compute primitives. This approach minimizes the overhead typically found in cross-platform frameworks.Performance Benchmark: At 80 tok/s, the inference speed is roughly 10x faster than average human reading speed, enabling near-instantaneous multimodal interactions without the latency or privacy risks associated with cloud-based inference.Bagua InsightAt 「Bagua Intelligence」, we view this as a definitive shift toward "Edge-Native AI." The narrative that high-performance GenAI requires massive H100 clusters is being challenged by the efficiency of new architectures like LFMs and SSMs.The strategic implication is clear: the bottleneck for AI adoption is no longer just model intelligence, but the "Latency-Cost-Privacy" triangle. By hitting 80 tok/s on a device that fits in a pocket, the industry is moving toward a future where AI Agents are resident on-device, operating independently of internet connectivity. This undermines the moat of cloud-only AI providers and shifts the power back to hardware OEMs and agile developers who can optimize at the metal level. WebGPU is emerging as the dark horse in this race, providing a high-performance, cross-platform standard that could unify the fragmented mobile AI landscape.Strategic RecommendationsFor Technical Leaders: Stop treating mobile AI as a "lite" version of cloud AI. With 80 tok/s performance, the edge is now capable of hosting sophisticated, real-time agentic workflows. Invest in custom kernel optimization rather than relying on generic wrappers.For Enterprise Architects: Prioritize "Local-First" AI strategies for privacy-sensitive applications. The cost savings from offloading inference from the cloud to the user's device (BYOC - Bring Your Own Compute) will be a major competitive advantage in 2025.For the AI Ecosystem: Keep a close watch on Liquid AI and other non-Transformer alternatives. The next phase of the AI war won't be fought over parameter count, but over efficiency and "tokens per watt" on consumer hardware.