I was able to run a distilled version of DeepSeek on Linux. I ran it inside a PODMAN container with ROCM support (I have an AMD GPU). It wasn't super fast but for a locally deployed and self hosted option the performance was okay. Apart from that I have deployed Fooocus for image generation in a similar manner. Currently, I am working on deploying Stable Diffusion with either ComfyUI or Automatic1111 inside a PODMAN container with ROCM support.
Helmaar
joined 5 months ago
MODERATOR OF
1
Amazon employees are warning customers about DeepSeek privacy concerns — and pushing Amazon's own AI instead
(www.businessinsider.com)
Gotta Cash 'Em All.
view more: next ›
Maybe you could try Syncthing? It's pretty fast over a local network and can do the job fairly well.