Proxmox Virtual Environment (VE) 8.2.4 – how to use your first local ‚Meta Llama 3‘ Large Language Model (LLM) project without the need for a GPU and now with Open WebUI

‚Schreibe einen Text über die Geschichte des Eiffelturms in deutsch in 500 Worten‘

Home Lab (local) : 180s / prompt_token/s :  6.06 tokens
ChatGPT : 35s
Apple Mac Mini (local) : 25s / prompt_token/s :  250.3 tokens
Dell/Nvidia (local) : 10s / prompt_token/s :  585.88 tokens

 

‚write me a poem about tulips‘

Home Lab (local) : 70s
ChatGPT : 12s

Leave a Reply

You must be logged in to post a comment.