iMac Intel with AMD eGPU for LLMs

I wanted to leverage my AMD eGPU to run LLMs locally on my iMac with an intel I9 processor. I have tried everything from modifying global variables in ollama to using docker images. The small hope I had was with LMstudio; however, that application doesn't, and probably will never, support intel based Macs since Apple has begun their 'hardware war' with Nvidia and AMD smh. Does anyone have any suggestions how I could leverage any gpu (internal or external) for running a local LLM on my intel based iMac or is this a fruitless endeavor?

Posted on Oct 3, 2024 6:29 PM

Reply

Similar questions

1 reply

This thread has been closed by the system or the community team. You may vote for any posts you find helpful, or search the Community for additional answers.

iMac Intel with AMD eGPU for LLMs

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple Account.