اگلا

آٹو پلے

Private AI on a Stick — No Servers, No Surveillance

0 مناظر • 24/05/26
بانٹیں
ایمبیڈ
121gamers
121gamers
14 سبسکرائبرز
14

What if you could carry a fully private, offline AI assistant in your pocket — and run it on ANY computer without installing anything? That's exactly what we're building today.
In this video, I walk you through the Portable AI USB project — an open-source setup that lets you run powerful large language models entirely from a USB drive using Ollama and AnythingLLM. No Wi-Fi needed after setup. No data sent to any server. Everything stays on your drive.

🔧 What's covered in this video:

What the Portable AI USB project is and why it matters
How to set up your USB drive (16GB minimum, 32GB recommended)
Running the install script and selecting your AI model

🧠 AI Models You Can Choose From:

NemoMix Unleashed 12B — Highest quality, uncensored (~7GB)
Dolphin 2.9 Llama 3 8B — Uncensored, versatile (~4.9GB)
Mistral 7B Instruct v0.3 — Strong reasoning (~4.1GB)
Qwen 2.5 7B — Multilingual support (~4.7GB)
Llama 3.2 3B — Lightweight & fast (~2GB)
Phi-3.5 Mini 3.8B — Small but sharp (~2.2GB)
Custom GGUF models from HuggingFace — bring your own!

📦 What you'll need:

A USB drive with 16GB+ free space (exFAT formatted)
A Windows or macOS computer
An internet connection for the initial download only


🔗 Links:
GitHub Repo: https://github.com/jarvesusaram99/Portable-AI-USB
Ollama: https://ollama.com
AnythingLLM: https://anythingllm.com
Find me anywhere: https://www.anubisdarkwatch.com

👍 If this helped you, smash that like button and subscribe for more privacy-first tech builds.
💬 Drop a comment below — which model are you running?
#ai #localai #privacytech #ollama #llm #offlineai #usb #anythingllm #opensource #aitools #portableai #llama3 #techtutorial #nocloud #aiprivacy

مزید دکھائیں
0 تبصرے sort ترتیب دیں
فیس بک کے تبصرے

اگلا

آٹو پلے