I'm delighted to share that we have launched ExecuTorch for its Alpha release as the PyTorch ecosystem solution for mobile and edge deployments. Since the successful preview at last year's PyTorch Conference, we've added many major improvements in terms of capabilities, performance, and model scope.
A particular emphasis for this release was support for Large Language Models -- with this version of Executorch, you can deploy LLMs to mobile and edge devices, including iOS, Android, and more. This is also the culmination of so many partnerships with hardware vendors and software partners that enable a broad set of devices and several hardware-optimized backends ("delegates").
A big shout-out to the entire Executorch team, who have brought PyTorch and PyTorch-powered LLMs for self-service deployment to mobile and edge platforms working with the global PyTorch team and building on the same compiler technology that powers PT2 compilation. Check out a video of llama2 running on a phone with Executorch https://lnkd.in/gzXpebXH.
Executorch comes with instructions and sample applications for iOS and Android mobile applications that may be used to chat with LLMs, and support the newly released Llama3, and the popular Llama2 family as well as many other models. You can read more about Executorch at our blog at https://lnkd.in/guyXCb4i, check out the Executorch repo at https://lnkd.in/g9uVqKgR or install Executorch wheel with pip install with Python 3.10.
So download Executorch and try to run the most exciting models on your phone, tablet and more. If you are a maker that's excited about the possibilities of devices such as Raspberry Pi, deploy LLMs on these devices with either Raspbian or Android. Then share on what devices and how you are using Executorch!
#ExecuTorch #PyTorch #LLM #MobileLLM #AcceleratedAI
👩💻Teacher -> Developer | 📱Android, iOS, KMM, React-native, Flutter | 💻GlobalLogic
7moI'm currently working on a project that runs on Java 11 and I had some issues with changing JDK, gradle version and some libraries that doesn't support 11. Gemini couldn't help me solve this problem, it couldn't figure out that it was because of the java version, even when I told it that it was it gave me some faulty way of solving it. Copilot could however after some careful prompting figure out the cause and give me some helpful hints on what to do.