Proxmox Virtual Environment (VE) 8.2.4 – how to use your first local ‚Meta Llama 3‘ Large Language Model (LLM) project without the need for a GPU and now with Open WebUI

‚Schreibe einen Text über die Geschichte des Eiffelturms in deutsch in 500 Worten‘

Home Lab (local) : 180s / prompt_token/s :  6.06 tokens
ChatGPT : 35s
Apple Mac Mini (local) : 25s / prompt_token/s :  250.3 tokens
Dell/Nvidia (local) : 10s / prompt_token/s :  585.88 tokens

 

‚write me a poem about tulips‘

Home Lab (local) : 70s
ChatGPT : 12s

This entry was posted on Montag, Juli 1st, 2024 at 17:50 and is filed under Administration, AI. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.

Leave a Reply

You must be logged in to post a comment.