Abstract: In recent years, artificial intelligence (AI) technologies represented by foundation models have experienced rapid development. Concurrently, on-device AI inference has become the primary ...