It's been a fascinating experience so far and I feel like I'm only touching the surface. I'm exploring some of the various memory harnesses to hook into Hermes Agent and see how it learns with extended use.
It's an older version of a heatset insert fixture. I used it to put threaded brass inserts into my 3d prints instead of trying to capture a nut or screwing directly into plastic.
https://www.printables.com/model/609644-stealth-press-1-heat-set-insert-press-legacy
I consolidated my setup a bit. This is my local LLM hosting server. I took a gamble on a Chinese NVLink SXM2 mezzanine board from ebay, it was surprisingly plug and play for my dual 16GB v100s π. I'm also running a Tesla P40 that I repasted with liquid metal that sits at 24C idle π₯Ά.
My favorite smell is also my favorite word; Petrichor. It's the smell of the earth when it rains after an extended dry period.
From Wikipedia "from Ancient Greek ΟΞΟΟΞ± (pΓ©tra) 'rock'; or ΟΞΟΟΞΏΟ (pΓ©tros) 'stone' and αΌ°ΟΟΟ (ikhαΉr) 'ichor', the ethereal fluid that is the blood of the gods in Greek mythology."
"the front fell off?!"
They've been temporarily removed for about a year now lol
I'm actually quite happy with it. It's a 24gb p40 which runs some of the older LLMs quite well. Repasting with liquid metal helped thermals a ton too
It's a Tesla P40 24gb I got off eBay a while ago. Just like AllHailTheSheep suggested, it's a server GPU meant for compute workflows so it relies on forced air from a server rack. I repasted the die with liquid metal and added a 3d printed duct to attach the radial blower to. The thing never cracks 60c under inference which is nice. Idles around 24c
(Edit: I'm mostly using it for LLMs, but it supposedly makes a good CAD card, so I might give that a shot too)
Thank you π₯Ή It's been quite the experience lol
I thankfully snagged this one pretty cheap off eBay. It's actually an 8-gpu mining rig frame that conveniently fit my CEB motherboard lol
My janky homelab lol. Mostly ebay secondhand Enterprise stuff and a Chinese SXM2 mezzanine board to run dual NVLinked 16gb V100s. I also have a TrueNAS Scale mini itx server running upstairs with my "arr" stack and some other useful tools.
I felt the same way for a long time. Growing up, I never saw much reason to plan for a future that seemed perilous at best. Climate change was looming; now we are beginning to feel it. The social contract in the US was starting to fray; now it's coming undone.
9/11, the surge of school shootings, multiple "once in a lifetime" recessions, decades of conflict and rampant anti-intellecualism made it seem silly to even consider something like a 401k when it felt like money would be meaningless by the time I retired; if I can retire at all.
Now, I'm content to let the old structures fall. There's a few good or useful pieces in there, but the system as a whole has shown just how hollow or simply rotten some most of them are. I'm not hoping or advocating for collapse, only that if it were to happen in my lifetime, the little corner of humanity I occupy might have the ability to weather the storm.
Someone said it once, "look for the helpers". In times of strife, there's still good to be found.
Simply stunning π
Ugh, same ππ