Llama 3.3 70B - THE BEST LOCAL AI YET!

191 Views
Published
This is a simply fantastic new model from Meta. The llama 3.3 is the first model to do this well in my model review. Jump in and check out this performance. Simply amazing how far we have come in... checks cal... 6 months.

AI Home Server Quad 3090 Build https://youtu.be/JN4EhaM7vyw
Quad GPU AI Training Rig Writeup https://digitalspaceport.com/ollama-gpu-3090-home-server-quad-gpu-ai-training-rig/

QUAD 3090 AI SERVER BUILD
GPU Rack Frame https://geni.us/GPU_Rack_Frame
RTX 3090 24GB GPU (x4) https://geni.us/GPU3090
Gigabyte MZ32-AR0 Motherboard https://geni.us/mz32-ar0_motherboard
Kritical Thermal GPU Pads https://geni.us/Kritical-Thermal-Pads
256GB (8x32GB) DDR4 2400 RAM https://geni.us/256GB_DDR4_RAM
PCIe4 Risers (x4) https://geni.us/PCIe4_Riser_Cable
AMD EPYC 7702p https://geni.us/EPYC_7702p
iCUE H170i ELITE CAPELLIX https://geni.us/iCUE_H170i_Capellix
(sTRX4 fits SP3 and retention kit comes with the CAPELLIX)
ARCTIC MX4 Thermal Paste https://geni.us/Arctic_ThermalPaste
CORSAIR HX1500i PSU https://geni.us/Corsair_HX1500iPSU
4i SFF-8654 to 4i SFF-8654 (x4) https://geni.us/SFF8654_to_SFF8654
HDD Rack Screws for Fans https://geni.us/HDD_RackScrews

LXC Proxmox Ollama Docker Guide - https://youtu.be/lNGNRIJ708k
LXC Proxmox Web Guide - https://digitalspaceport.com/proxmox-lxc-gpu-passthru-setup-guide/

Chapters
0:00 Llama 3.3 Review
1:50 Flippy Bird Extreme
3:42 Armageddon with a twist
7:37 Precision Random Counting
8:50 Precision Static Counting
9:53 Number Comparison
10:21 Creative Meal Planning
12:10 Fitness Coach
15:24 Peppermint Parsing
15:56 Pico De Gato
17:00 Hundred decimals of Pi
17:37 Conclusion

Be sure to
Category
Meta Llama 3.2
Tags
llm, ollama, llama 3.3 70b
Be the first to comment
PC CHIPS UK