Proxmox Virtual Environment (VE) 8.2.4 – how to setting up your first local ‚Meta Llama 3‘ Large Language Model (LLM) project without the need for a GPU

root@pve-ai-llm-01:~# lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 24.04 LTS
Release: 24.04
Codename: noble

root@pve-ai-llm-01:~#

## Installation OLLAMA – a streamlined tool for running open source LLMs locally ##

root@pve-ai-llm-01:~# curl -fsSL https://ollama.com/install.sh | sh
>>> Downloading ollama…
######################################################## 100.0%#=#=#
>>> Installing ollama to /usr/local/bin…
>>> Creating ollama user…
>>> Adding ollama user to render group…
>>> Adding ollama user to video group…
>>> Adding current user to ollama group…
>>> Creating ollama systemd service…
>>> Enabling and starting ollama service…
Created symlink /etc/systemd/system/default.target.wants/ollama.service -> /etc/systemd/system/ollama.service.
>>> The Ollama API is now available at 127.0.0.1:11434.
>>> Install complete. Run „ollama“ from the command line.
WARNING: No NVIDIA/AMD GPU detected. Ollama will run in CPU-only mode.
root@pve-ai-llm-01:~#
## Installation model for OLLAMA ##
root@pve-ai-llm-01:~# ollama pull llama3
pulling manifest
pulling 6a0746a1ec1a… 100% ▕████████████████████████████████████████████████████████▏ 4.7 GB
pulling 4fa551d4f938… 100% ▕████████████████████████████████████████████████████████▏ 12 KB
pulling 8ab4849b038c… 100% ▕███████████████████████████████████████████████████████▏ 254 B
pulling 577073ffcc6c… 100% ▕█████████████████████████████████████████████████████████▏ 110 B
pulling 3f8eb4da87fa… 100% ▕████████████████████████████████████████████████████████▏ 485 B
verifying sha256 digest
writing manifest
removing any unused layers
success
root@pve-ai-llm-01:~#
## Test OLLAMA in CLI ##

root@pve-ai-llm-01:~# ollama run llama3
>>> how to disable compression in oracle rman backup
By default, Oracle RMAN (Recovery Manager) compresses the backup data to reduce storage requirements and improve transfer times. However, there may be
scenarios where you want to disable compression for specific backups or for a particular reason.
To disable compression in an Oracle RMAN backup, you can use the `COMPRESSION` parameter with a value of `OFF` when executing the `BACKUP` command. Here
are some examples:
1. Disable compression for a single backup:
„`sql
RMAN> BACKUP DATABASE COMPRESSION OFF;
„`
This will create a compressed backup of your entire database.
2. Disable compression for a specific tablespace or datafile:
„`sql
RMAN> BACKUP TABLESPACE <tablespace_name> COMPRESSION OFF;
„`
Replace `<tablespace_name>` with the name of the tablespace you want to back up without compression.
3. Disable compression for a specific database file (e.g., an individual datafile):
„`sql
RMAN> BACKUP FILE ‚<datafile_name>‘ COMPRESSION OFF;
„`
Replace `<datafile_name>` with the full path and name of the database file you want to back up without compression.
4. Set the default compression setting for all future backups:
„`sql
RMAN> CONFIGURE DEFAULT DEVICE TYPE TO ‚DISK‘ COMPRESSION OFF;
„`
This sets the default compression setting for all subsequent backups that use the `BACKUP` command with no specific compression setting specified.
Remember to adjust the `COMPRESSION` parameter according to your specific requirements and storage constraints.
>>> Send a message (/? for help)
>>> /bye
root@pve-ai-llm-01:~#

Leave a Reply

You must be logged in to post a comment.