fauntleroy

joined 2 years ago
[–] [email protected] 1 points 4 months ago

Maybe you have to install the proprietary driver including the OpenCL stack. See https://amdgpu-install.readthedocs.io/en/latest/install-installing.html

[–] [email protected] 5 points 4 months ago* (last edited 4 months ago) (1 children)

Habe ich selbst in der Form noch nicht gemacht. Aber anscheinend kann man bei Nextcloud LLMs einbinden, die im OpenAI API-Fornat kommunizieren, bzw. das per Nextcloud-App nachrüsten. Ollama ist zu dem Format kompatibel. Sollte also gehen. Siehe https://docs.nextcloud.com/server/latest/admin_manual/ai/ai_as_a_service.html

Allerdings brauchst du für das lokale Ausführen mit Ollama sehr starke Hardware, insbesondere laufen die Sprachmodelle nur auf einer leistungsstarken GPU wirklich performant. Die ist in Servern typischerweise nicht unbedingt vorhanden. Das komplette DeepSeek Modell ist auch ziemlich groß und braucht dementsprechend viel VRAM / RAM.

Schau dir die Hardware-Empfehlungen von Ollama für die Modelle an, die werden direkt im Github aufgelistet. Wenn deine Hardware reichen könnte, dann probier es einfach aus. Ollama lässt sich auch sehr einfach mittels Docker deployen, das würde ich dir erstmal empfehlen, vor allem, wenn du eh schon Docker nutzen solltest. Damit habe ich (mit anderen Modellen) bisher gute Erfahrungen gemacht. Nextcloud verbindest du dann wie gesagt über die API-Schnittstelle.

[–] [email protected] 2 points 1 year ago* (last edited 1 year ago) (1 children)

Does your CPU has integrated graphics? You can remove your GPU and then you test if the error still occurs to find out if your GPU has damage. You can also test a live system, to exclude issues in your OS or driver configuration

Which OS and GPU do you have in use?

[–] [email protected] 3 points 1 year ago

You can run Memtest, just boot it and check the ram. Some Linux distros have memtest included in their bootable image (e.g. Ubuntu). Otherwise you can create a bootable stick with memtest by yourself.

[–] [email protected] 1 points 1 year ago

I experienced some bugs while gaming on Wayland even with an amd card. My workaround was switching back to X11 for gaming. That said, I didn't even notice that I was using Wayland by default for a long time until Firefox completely switched to Wayland I experienced some heavy artifacts in Firefox (only if it's full screen on my second monitor, but that's a daily thing). And because of that, switching back to X11 isn't a workaround anymore, unfortunately its my new default.

[–] [email protected] 3 points 1 year ago* (last edited 1 year ago)

That's it. I have installed Ubuntu many times connected over Wi-Fi without any problems, except one special case many years ago. In that case, the system had some brand new Wi-Fi adapter, so I had to install the driver over Ethernet. But in almost any case it just should work and you can simply try to get a wireless connection in a live sytem to find out. And as mentioned above, internet connection is not necessary while installing from USB stick with the usual image. Its just recommended to save time and install the latest updates of some components during the initial system installation. But of course, you can do it later and of course you can do it over Wi-Fi (except some very rare special cases as mentioned at the beginning).

[–] [email protected] 5 points 1 year ago

Just to avoid any misunderstandings for the furture: you can run NVIDIA cards in ubuntu, you just have to install their proprietary driver. And on ubuntu, its pretty easy to do so. I used a few different nvidia cards on Ubuntu in the last years and never experienced any issues after installing the recommended driver. Before installing the driver, I got some flickering and artifacts, but with the right driver everything should be fine. And even for amd graphics you can install the proprietary drivers from their website to get out the maximum performance of the GPU. But for amd you can also use the "pre-installed" open-source driver, which has a much better performance in comparison to the open source driver for nvidia cards. Integrated grahipcs are supported out of the box in almost any cases.

[–] [email protected] 1 points 2 years ago

Seit einigen Jahren nur noch Linux. Zum Programmieren und Arbeiten sowieso nur Linux. Privat hatte ich früher parallel Windows installiert, zum Zocken. Aber seit Steam mit Proton nen echt guten Job macht, und ich unter Linux vernünftig zocken kann, gibt es einfach keinen Bedarf mehr für Windows.