ポスト
Ok so Llama3 70b running on the @ASUS Nuc 14 Pro with Intel Core Ultra 155h and 96GB of memory works👍 I’m using Llama.cpp sycl implementation which I know is a bit slower. I’ll try a faster framework tomorrow 😊 Try that on any other non workstation GPU you have on your…
メニューを開く