I recently came across an fascinating article about bringing Generative AI to the masses using ExecuTorch and KleidiAI. It’s amazing to see how far AI has come, especially with the ability to run large language models on older devices like the Raspberry Pi 5 or even smartphones that are a few years old. The mention of the SDOT instruction making this possible on such a wide range of devices is truly groundbreaking. It makes me wonder about the endless possibilities for on-device AI applications, from private voice assistants to local code generation. I’m excited to see how this technology will evolve and can’t wait to explore it further myself. What are your thoughts on this? How do you see on-device GenAI being used in everyday life?