Who should I follow to learn about On-Device AI models?

If you want to **really learn on-device models** - not just follow generic AI news - I’d follow people and teams working on **inference, quantization, model compression, runtimes, and mobile/edge hardware**. ### My shortlist - **Andrej Karpathy** - Excellent for understanding how models actually work. His material is especially useful before diving into optimization and inference. - **PyTorch / ExecuTorch team** - Follow the people contributing to ExecuTorch. It is PyTorch's dedicated stack for deploying models from phones down to embedded devices, with many hardware backends. [GitHub - pytorch/executorch: On-device AI across mobile, embedded and edge for PyTorch · GitHub](https://github.com/pytorch/executorch?utm_source=chatgpt.com) - **Google AI Edge** - One of the best sources for practical on-device AI. Their current stack includes **LiteRT** and **LiteRT-LM**, covering model conversion, quantization, GPU/NPU acceleration, and local LLMs. [Google AI Edge | Google for Developers](https://developers.google.com/edge?utm_source=chatgpt.com) - **Qualcomm AI team** - Follow them if you care about the hardware side: NPUs, latency, power consumption, quantization, and deploying models on phones/edge devices. [On-Device AI Development | Deploy AI Models | Qualcomm](https://www.qualcomm.com/developer/artificial-intelligence?utm_source=chatgpt.com) - **MLX contributors** - Particularly valuable if you're interested in running and optimizing LLMs on Apple Silicon. - **llama.cpp contributors** - Probably one of the most useful projects to watch if your goal is understanding *how LLMs actually get squeezed onto consumer hardware*: GGUF, quantization, CPU/GPU inference, memory constraints, etc. ### If I were starting today I'd follow this progression: **Karpathy → llama.cpp → MLX → ExecuTorch → Google AI Edge → Qualcomm** That takes you from **"how does a model work?" → "how do I make it small?" → "how do I run it efficiently?" → "how does it exploit real phone hardware?"** And don't overlook the frameworks themselves. The current ecosystem is converging around a handful of important runtimes - llama.cpp, MLX, ExecuTorch, LiteRT/LiteRT-LM, and vendor-specific stacks. [Section 60.2: The Edge Framework Landscape | Building Language AI](https://llmbook.icsgen-ai.org/part-12-llm-systems-at-scale/module-60-edge-on-device-llms/section-60.2.html?utm_source=chatgpt.com) If you tell me whether you're approaching this as a **software engineer, ML researcher, or startup/product builder**, I can give you a much tighter **10-person/10-project follow list**.

**To learn about On-Device AI Models, follow leading researchers, hardware architects, and industry executives who are shaping edge AI and device-native intelligence. Key figures include Yann LeCun, Jensen Huang, Demis Hassabis, Fei-Fei Li, and Andrew Ng.** ## 🌟 Recommended Experts to Follow Expert| Role| Why They Matter for On-Device Models ---|---|--- **Yann LeCun**| Chief AI Scientist at Meta| Strong advocate for _energy-efficient, on-device learning_; emphasizes architectures that can run locally without cloud dependence. **Jensen Huang**| CEO of NVIDIA| Driving GPU and edge hardware innovation; NVIDIA chips power many on-device inference systems. **Demis Hassabis**| CEO of Google DeepMind| Leading multimodal AI research; Gemini ecosystem includes models optimized for mobile and embedded devices. **Fei-Fei Li**| Stanford Professor, Co-Director of HAI| Pioneer in computer vision; her research informs lightweight vision models suitable for smartphones and IoT. **Andrew Ng**| Founder of DeepLearning.AI, Coursera| Focuses on practical AI deployment; promotes _tinyML_ and resource-efficient model training. **Sam Altman**| CEO of OpenAI| While focused on frontier models, he frequently discusses deployment strategies including edge and device-native AI. **Geoffrey Hinton**| AI pioneer| Advocates for biologically inspired approaches that could make on-device models more efficient. **Mustafa Suleyman**| CEO of Inflection AI| Exploring personal AI assistants that run closer to the user, with implications for device-based intelligence. [Top 10 AI Influencers of 2026 - KDnuggets](https://www.kdnuggets.com/top-10-ai-influencers-of-2026)[Top AI Leaders of 2026 | The Industry Leaders](https://www.theindustryleaders.org/leaders/top-25-ai-leaders-2026)[Top 10 Most Influential People in AI for 2026](https://www.analyticsinsight.net/artificial-intelligence/top-10-most-influential-people-in-ai-2026) ## 📌 Why These Voices Are Relevant * **On-device AI** requires balancing _performance, privacy, and energy efficiency_. Hardware leaders like Jensen Huang and Satya Nadella (Microsoft) are embedding AI into everyday tools, while researchers like LeCun and Li are pushing architectures that can run locally. * **Academic pioneers** (Ng, Bengio, Hinton) provide frameworks for lightweight training and inference, crucial for mobile and IoT deployment. * **Industry leaders** (Altman, Hassabis, Suleyman) influence how models are scaled down for consumer devices. ## ⚠️ Risks & Challenges to Watch * **Privacy vs. compute trade-offs**: Running models locally protects data but requires efficient hardware. * **Energy consumption**: On-device inference must minimize battery drain. * **Fragmentation** : Different ecosystems (Apple Neural Engine, Qualcomm AI chips, NVIDIA Jetson) may limit portability. * **Hype vs. reality**: Some influencers focus on frontier AI; not all their insights apply directly to edge deployment. ## ✅ Next Steps for You * Follow these experts on **LinkedIn, X (Twitter), and YouTube** for real-time updates. * Track communities like **TinyML Foundation** and **Edge AI conferences** for practical deployment insights. * Balance following _hardware architects_ (Huang, Nadella) with _research scientists_ (LeCun, Li, Ng) to get both strategic and technical perspectives. Would you like me to curate a **short list of podcasts, newsletters, and conferences** specifically focused on _on-device AI_ so you can go beyond individual influencers?

* **Georgi Gerganov** : Creator of `llama.cpp` and `ggml`, the benchmark open-source projects driving local and on-device model inference on everyday consumer hardware. [People to Follow (X/Twitter) | The Agentic AI Hub - daily.dev](https://daily.dev/agentic-ai-hub/people-to-follow/#:~:text=Evals%20and%20LLM%2Das%2Djudge%2C%20the%20%22measure%20before%20you,Latent%20Space%20and%20the%20AI%20Engineer%20conference.) * **Andrej Karpathy** : Known for minimalist educational tools like `llama2.c`, which strips down language models to raw C code to demonstrate low-level local execution. [Top 5 GitHub Repositories for Cutting-Edge AI Models - Medium](https://medium.com/@hassan.malik.18/top-5-github-repositories-for-cutting-edge-ai-models-a86103f9e168#:~:text=Here%20are%20the%20top%20five%20AI%20repositories,tailored%20for%20specific%20domains.%20The%20best%20part%3F) * **Pete Warden** : A pioneer in the TinyML space and co-author of the foundational text _TinyML: Machine Learning with TensorFlow Lite on Arduino and Ultra-Low-Power Microcontrollers_. * **Apple Machine Learning Research** : Their team regularly publishes open-source repositories and optimization guides - such as running models via Core ML on Apple Silicon. [Top 5 GitHub Repositories for Cutting-Edge AI Models - Medium](https://medium.com/@hassan.malik.18/top-5-github-repositories-for-cutting-edge-ai-models-a86103f9e168#:~:text=MetaGPT%20bridges%20the%20gap%20between%20high%2Dlevel%20requirements,a%20Swift%20package%20for%20seamless%20application%20integration.) * **The TinyML Foundation** : A global community hosting technical symposia, educational tracks, and resources dedicated to ultra-low-power machine learning on edge devices. * **Hugging Face's Client-Side Teams** : Groups tracking tools like `transformers.js` that enable models to run directly inside browsers and local client environments without cloud reliance. [tinyML Talks on Edge AI Applications](https://www.youtube.com/watch?v=oMXSQnwsQGQ) [tinyML Talks: The Value of Edge AI for Industrial Applications](https://www.youtube.com/watch?v=oMXSQnwsQGQ#:~:text=tinyML%20Talks%20The%20Value%20of%20Edge%20AI,is%20arguably%20strongest%20within%20the%20industrial%20sector.) This video provides a practical look at how edge AI and local models are deployed across real-world hardware environments. Would you like recommendations on specific hardware development kits or software frameworks like TensorFlow Lite to start building your first on-device model? [tinyML Talks: The Value of Edge AI for Industrial Applications: onsemi and SensiML IIoT SolutionsEDGE AI FOUNDATION · 703 views[ Open in tinyML Talks: The Value of Edge AI for Industrial Applications: onsemi and SensiML IIoT Solutions ](https://www.youtube.com/watch?v=oMXSQnwsQGQ)](https://www.youtube.com/watch?v=oMXSQnwsQGQ)  

Learning about **on-device models** (often referred to as Edge AI, local inference, or on-device machine learning) requires following practitioners working on hardware acceleration, model compression (quantization and pruning), and efficient architectures like MobileNet or small language models (SLMs). The best researchers, engineers, organizations, and resources to follow include the following: 1\. Key Researchers & Industry Practitioners * ** _Andrej Karpathy_ :** (Independent AI researcher, formerly Tesla/OpenAI) Frequently shares insights on model efficiency, distillation, and how smaller models can punch above their weight class by utilizing clean, high-quality data curation rather than brute-force scaling. Follow his work and commentary on X (formerly Twitter). * **Apple Machine Learning Research Team:** Apple routinely publishes state-of-the-art techniques for running large models locally with tight memory and power constraints (such as their work on flash memory utilization for LLMs). Check out their latest publications and updates directly via the [Apple Machine Learning Research](https://machinelearning.apple.com/) portal. * **Google MediaPipe & TF Lite Teams:** The teams behind TensorFlow Lite and MediaPipe push out practical tools for mobile and embedded computer vision and audio models. Following engineering leads and checking updates on the Google Developers Blog provides hands-on code and deployment tutorials. 2\. Core Organizations & Labs * **Hugging Face (Open-Weight & Edge Teams):** Hugging Face hosts an immense array of quantized models (like GGUF/AWQ formats) optimized for local device execution. Following community leads and engineers there gives you a pulse on real-world local deployment. Explore community updates on Hugging Face. * **Qualcomm AI Research:** Qualcomm regularly publishes breakthroughs in neural processing unit (NPU) architectures, quantization-aware training, and running multi-billion parameter models locally on smartphones. Keep an eye on their technical deep-dives via Qualcomm AI Research. 3\. Essential Communities & Aggregators * **r/LocalLLaMA:** A massive community on Reddit LocalLLaMA dedicated exclusively to running, quantizing, and fine-tuning open-weight models locally on consumer hardware (from MacBooks to edge GPUs and mobile phones). It's one of the fastest places to learn what works in practice. * **Ollama & Llama.cpp Ecosystems:** Following the GitHub repositories and creators behind inference engines like llama.cpp on GitHub lets you see the direct low-level engineering constraints of running models on diverse hardware architectures. Are you looking to build on-device models for **mobile apps (iOS/Android)** , **microcontrollers/IoT** , or running **local LLMs on desktop/laptop hardware**? Let me know so I can tailor specific tutorials or frameworks for you. Show less