surrendertogravity

Really clean! Now you just need to theme that pihole dashboard to Nord too ;)

Yup; hopefully there are some advances in the training space, but I’d guess that having large quantities of VRAM is always going to be necessary in some capacity for training specifically.

Yup; hopefully there are some advances in the training space, but I’d guess that having large quantities of VRAM is always going to be necessary in some capacity for training specifically.

So I’m no expert at running local LLMs, but I did download one (the 7B vicuña model recommended by the LocalLLM subreddit wiki) and try my hand at training a LoRA on some structured data I have.

Based on my experience, the VRAM available to you is going to be way more of a bottleneck than PCIe speeds.

I could barely hold a 7B model in 10 GB of VRAM on my 3080, so 8 GB might be impossible or very tight. IMO to get good results with local models you really have large quantities of VRAM and be using 13B or above models.

Additionally, when you’re training a LoRA the model + training data gets loaded into VRAM. My training dataset wasn’t very large, and even so, I kept running into VRAM constraints with training.

In the end I concluded that in the current state, running a local LLM is an interesting exercise but only great on enthusiast level hardware with loads of VRAM (4090s etc).

Using it to separate work from other uses makes sense to me - I think if I worked from my desktop rather than the company laptop, I’d be more inclined to use the virtual desktops.

Wanting to pin a floating window was always something I wanted on Windows, so I was excited to see that being natively supported by KDE.

Agree on disliking alt-tab because it’s non-deterministic! Cycling through a whole list of apps has always felt clunky to me so I never use it.

I really wish I could load Sway on my desktop… unfortunately I’ve got an Nvidia card and I couldn’t get the live ISO to boot with sway. :<

Very tempting to try it on my laptop though! All the setups I’ve seen using it look really clean.

How far away from your monitor do you sit to see all of the 49”?! It must all be in your peripheral vision, haha. (Edit: oh, I overlooked the ultra wide mention and was picturing a 49” tv type thing, haha. Ultra wide makes more sense!)

I actually went down from two monitors on my desktop to one… nothing wrong with the second monitor now sitting in my closet, but I’m liking the extra space on my desk and it feels more ergonomic to not be swiveling my neck as much.

I purged my comments and deleted my main account on July 1st, which was surprisingly emotional for me. I use Alien Blue on mobile, which still works so far, but now that my main account is logged out, I'll never be able to log another account in because authentication has been broken in Alien Blue for a while.

I'm keeping Alien Blue installed for two reasons: one, for checking on a friend who only posts updates on reddit, and two, I read r/games a couple times a week for headlines and discussion. Lemmy just doesn't have the same level of engagement or discussion as r/games; even though there's a certain brand of insufferable commenters there, the majority of people post thoughtful comments that are more than one or two sentences long and those are the kinds of threads I like reading. Lemmy threads seem to be more shallow; lots of replies to the parent, but very few threads that go more than one or two comments deep.

I've accidentally tried to switch workspaces with the i3 shortcuts when on a windows machine before! that muscle mememory, haha.

when I'm booting Windows on my desktop, I use MS PowerToys to snap windows around which gives me the same feeling of nice organization as tiling but feels more intuitive in the Windows environment for me.

Makes sense! I agree laptops tend to be too small for tiling; I don't really use the tiling part of i3 on my laptop very much - usually only to pop open a terminal window on the side that I close after a few minutes.

Personally, I almost wish Obsidian didn’t expose a folder structure - but the program is flexible enough to enable hiding the file browser, so that works for me.

Since TiddlyWiki doesn’t even mess about with the concept of folders, imo that forces users to dive in and really think about how they’re connecting notes through linking - which helps build a sort of mental roadmap through their notes. Roam and Logseq are similar, I believe.