afk_strats

Alight.... Well played.

For those of you not on TikTok

Yep. Vulkan is recommended for cross-vendor setups, more commonly where there's integrated graphics.

I actually had ti and xtx variants, so vram was 12+24GB = 36 GB. Vulkan is implemented cross-vendor and running vulkan-based llama.cpp yielded similar (though slightly worse) performance than CUDA on the 3080ti as a point of reference.

I don't have this well documened but, from memory, Llama3.1 8B_k4 could reliably get arund 110 tk/s on CUDA and 100 on Vulkan on the same computer

I used this setup specifically to take advantage of the vastly increased VRAM of having two cards. I was able to use 32B_k4 models which were outside of the VRAM of either card and tracked power and RAM uasage with Lact. Performance seemed pretty great compared to my friend running the same models on a 4x4060ti setup using just CUDA.

If this is interesting to a lot of people, I could put this setup together to answer more questions / do a separate post. I took the setup apart because it physically used more space than what my case could accommodate and I had the 3080ti literally hanging out of a riser.

I was messing with LLMs recently and landed in a situation whereby I was running a 3080 and a 7900xt in the same system. I started with the 3080 so my system had Nvidia drivers already installed. Adding the AMD was 100% plug and play in Bazzite and Ubuntu 24.04.

If you want to use both cards simultaneously, you can! I spent way too much figuring it out. What you have to do is find how to run llama.cpp with Vulkan. Also, don't try doing that in a docker container because Vulkan in docker is broken. ASK ME HOW I KNOW lamo. Performance is actually really good so have fun!

Are you me?

See this monster of a post from u/sp3ctr4l@dbzer0

https://lemmy.dbzer0.com/comment/18288432

To add in about game modding on Linux:

https://github.com/limo-app/limo

https://flathub.org/apps/io.github.limo_app.limo

Limo is a universal mod manager that is linux native.

And I do mean universal. It’ll work with literally any game, you just have to take a bit of extra time to configure things for games that do not yet have a supported preset configuration out of the box… but at this point, that includes most games that are generally reliant on some kind of mod manager type program on Windows, to keep track of 10s or 100s of simultaneous mods.

It works very much along the same lines as something like Mod Organizer 2, though there are some differences, read the wiki.

It sets up a virtual file system that allows mods to be set up outside of the main game directory itself, and will override them such that the mods actually load, but they can be ‘undeployed’ to revert back to vanilla, you can set up different profiles of different mod configurations and deploy/undeploy what you like.

It can also manage load orders, supports formats such as fomod and similar for games like Fallout New Vegas and Skyrim, you can set up tags and category groupings, and it also shows you conflicts between mods down to the specific files, showing you a chain of overwrites to the final file from the final loaded mod.

It doesn’t support things like LOOT, which purport to autogenerate correct load orders… but frankly, thats fine, because shit like that doesn’t even work properly in situations you’d use it in on Windows 90% of the time.

EDIT: Wow, apparently it does support LOOT now, it did not a few updates ago.

…

I have successfully gotten FONV working using Limo to set up uh… there’s a variant of the Viva New Vegas mod setup guide aimed at Steam Deck users, but it tells you to set up Mod Organizer 2 on the Deck… which you can do, but its rather input laggy and there are other inconveniences…

Here it is, Mirelurked Viva New Vegas:

https://ashtonqlb.github.io/mirelurked-vnv/intro.html

I had to alter a few steps from this to get it working with Limo, but they were basically just… set up Limo instead of MO2, and you have to handle NVSE a bit differently, because it literally replaces/overrides the entire main game exe.

…

I have also used Limo to mod Cyberpunk 2077, works with more in depth frameworks like CET, RedExt, etc, as well as using the Decky Framegen plugin to insert FSR 3.1 Upscaling and Framegen into CP77, which gives better quality and fps than the official FSR 2 and 3 implementations that come with the vanilla game and are vanilla supported on a Deck.

You basically just have to launch the vanilla game via the normal launcher first, check the ‘enable mods’ switch, fully load the game…

Then you can set up the Framegen mod, which adds a custom command in steam to the launch parameters… and then you can also setup the ‘skip intro’ mod, which is reliant on both the mod being present, as well as additional command line parameters…

There are a bunch of reddit posts complaining that the FrameGen mod doesn’t allow other additional launch arguments, but they are wrong.

All you have to do is append those additional launch args … at the end of the FrameGen mod’s launch arg. This just doesn’t seem to be explicitly documented anywhere, by anyone… I may have been the first person to figure this out?

Anyway, after that bit of silliness, setting up other mods for CP 77 using Limo is fairly straightforward.

…

… I am doing all this on Bazzite on a Deck, but you could do it on… presumably any linux distro that supports flatpaks and proton (the translation layer that allows Windows games to run on Linux).

There will always be a few ‘weird’ mods that are just totally reliant on a whole bunch of Windows specific things to work, or just cannot be made to work without actually overwriting some core game files in the main, real directory itself…

And, some of these mods will require a windows component dependency, like vc_2017 or vc_2022, you set those up with something like ProtonTricks or SteamTinkerLaunch to modify the proton config per game, instead of trying to install the exe system wide as 99% of the windows oriented mods will tell you to do…

But so far, I have found either my own solutions for these cases, or someone else already has, or someone has just made basically a linux compatible equivalent for such a windows reliant mod.

… You can also just choose to run MO2 on Linux, it will work, its just… buggy, and overlycomplicated, imo, you’ve got to set up a custom wineprefix for the MO2 UI to not do dumbshit, give it thr dependencies it needs, and then you’ve got to do this for each different game you want to mod with MO2.

I found that Limo is sufficiently capable and much less hassle to use once you take the time to understand its differences from MO2.

This is so correct, and upon reflection adds to the bad effect.

The movie was ruined for me when he launches a rocket into a star that looks to be about 1au away and the rocket gets there in like 15 seconds. Dont tell me that ish was warp-capable.

https://duckduckgo.com/duckai/privacy-terms

Currently no HDR and looks like 60hz is the maximum refresh rate

I use an M1 (Pro 14" 8 core 16GB) with Asahi. It's extremely usable. WiFi is solid. Sound is solid. I never considered keyboard to be an issue... Its not. Things like brigtheness buttons still work. I have a tonne of USB devices and none of them had issues. I don't think the fingerprint reader or the built-in camera work but I can test them if that's a sticking point.

I very much like it and it's easy to switch into OSX if you're so inclined. I do for photo work. I know there are alternatives. I'm working on it.

The things I would warn about:

1. in my experience, battery life is worse. Maybe around 1/2 of what OSX gets. With my overall battery health around 80%, I think I'm getting 4 hours in Asahi.

2. this could actually be a skill issue (Linux newb) but I've had trouble installing certain packages in Fedora and Python and I assume it has to do with the M1 being ARM-based

Edit: remembered some things. As of the newest version, gaming is much MUCH better. I think you can do 720p or on medium or 1080p low with decent frames by just using proton on Stream. That's wild to me.

In case you didn't know, Asahi is the Linux distro designed for Apple Silicon Macs. Its based on Fedora with KDE as the desktop so it has a solid backens and a familiar but customizable interface. Its extremely simple to install and is beginner friendly.

Reply if you need more info!

Joe Cocker - You Can Leave Your Hat On (Official Video)

Please try ~~this game~~ Tyrian (see comments for Open Tyrian 2000). It has such great gameplay, upgrades, killer music and graphics. You can play 2 players with one person on keyboard and another on mouse. It's great