Run AI Models (LLMs) from USB Drive | No Filter, Fully Offline💀

Comments · 404

• TE

  @TechJarves · 11 days ago · pinned

  Drop your PC specs below and I'll recommend the best model for you👇

  34

• VI

  @VIDEOAC3D · 10 days ago (edited)

  Careful how &quot;safe&quot; you present local models to the public. &nbsp;I run local models at home too, but FYI, you should first be aware yourself, and then always mention if instructing, the many growing security concerns around local AI--like embedded prompts/training that can be easily integrated and hidden within the model&apos;s weights themselves, and don&apos;t execute anything malicious until after they&apos;ve been launched (the models themselves are tainted internally with malicious instructions). &nbsp;It&apos;s already happened, is nearly undetectable, and is just one of many examples where you can get a false sense of security, by feeling &quot;safe and secure,&quot; after rationalizing it as, &quot;because you&apos;re offline,&quot; when in reality, you may not be as &quot;offline&quot; as you think, and your activity, data, or worse, can be siphoned away silently in the background.<br>Malicious activity can also be integrated into the chat layer. &nbsp;Some launch tools are also capable of sharing chat logs / usage and more, where various AI might still be trained on your private data without your knowledge or consent.<br>AI training data is hard to come by, through legitimate means, which incentivizes illegitimate means, and every nation and every corporation want in...<br>PewDiePie recently proved how difficult it is to get voluntary legitimate data donation submissions, and he has a significant extra-large user base to draw support from. &nbsp;He basically got no one offering anything useful...<br><br>Kudos on the portable method though 👏, I&apos;ll give it a shot for funzies.

  57

• JA

  @JAG.65 · 9 days ago

  Let&apos;s call it SKYNET for now......

  7

• RA

  @RaymonLHall · 5 days ago (edited)

  Here are my specs:<br><br>Flash Drive: PNY 512GB PRO Elite V3 Type-C USB 3.2 Gen 2 Flash Drive <br>Up to 1000MB/s Read, 800MB/s Write<br><br>HP ENVY Laptop 16: <br> <br>Processor: 13th Gen Intel(R) Core(TM) i9-13900H // (2.60 GHz) <br> <br>Installed RAM: 32.0 GB // Speed: 5200 MT/s <br> <br>Graphics card: 8 GB // Multiple GPUs installed <br> <br>Storage: 932 GB // &nbsp;494 GB of 932 GB used <br> <br>Processor: 13th Gen Intel(R) Core(TM) i9-13900H (2.60 GHz) <br> <br>Installed RAM: 32.0 GB (31.7 GB usable) <br> <br>Graphics card: NVIDIA GeForce RTX 4060 Laptop GPU (8 GB) Intel(R) Iris(R) Xe Graphics (128 MB) <br> <br>Storage: 494 GB of 932 GB used <br> <br>System type: 64-bit operating system, x64-based processor

• JA

  @JacanaProductions · 9 days ago

  Yeah, you getting like 0.001 tokens per second!

  11

• DO

  @donnellsowell · 9 days ago (edited)

  So I put the usb drive (with files on it that some indian guy on youtube told me to download) into the computer, and it &quot;just needs to connect to the internet once to get set up?&quot;<br>What could go wrong?

  6

• IO

  @IowaKeith · 10 days ago

  Just because it fits on a USB drive doesn&apos;t mean it&apos;ll run on someone&apos;s pc. &nbsp;The model requires high-end computers to run on

  7

• AI

  @AIsound66 · 4 days ago

  Intel(R) Core(TM) i9-14900HX (2.20 GHz), 32GB Ram, NVIDIA GeForce RTX 4060 Laptop GPU (8 GB)<br>Intel(R) UHD Graphics (128 MB)

  1

• EL

  @ellooku · 7 days ago

  I tried this with my Jan-v3.3-4B Model. To my greatest surprise, this respond and process information way faster than Jan official AI software.

  1

• CL

  @cliveyoung_leo · 10 days ago

  Hello, thank you for this excellent piece of software. It has been extremely helpful, as my Mac Mini has very limited storage capacity.

• AL

  @AlexitoPaucar · 10 days ago

  Integrale to perform web searches and retrieve information from bin, grave, duckgo, etc.

  1

• OR

  @oraorasan · 4 days ago

  999+ missed call from CIA

  2