ejs

license for software whose source code is openly available for anyone to view, use, modify, and share

I don’t have any familiarity with using this kind of software, but I looked through the git repo of SavaPage. It looks like it has been actively developed for the past few years, which is a great sign, but it looks like almost all commits are done by one user. The issue tracker is also a little meager, with just one open issue, potentially pointing to a very small user base. Adoption heavily depends on as long as that one person keeps maintaining the project.

For anyone looking for more details on this, I highly recommend this video from Oh the Urbanity

It discusses this exact phenomenon in the data: speeding before and after the banning of automated enforcement cameras. It also argues effectively that the policy is inconsistent with Doug Ford’s platform of being “touch on crime”

Honestly, you’re a few months late to the whole buying GPUs for local llms party, so expect exorbitant prices even for older cards

The name of the game is vram. For the most part, more is better. If you can get your hands on multiple matching (same model) 24gb or higher cards (within price range), you’re golden.

Going for more than 2 gpus can become challenging with motherboard pcie slot heights, so make sure either your cards aren’t too tall or you have widely spaced out pcie slots.

For inference, speed (tokens/second) is limited by memory bandwidth. Go for faster bandwidth memory cards if you can afford it (e.g. GDDR6 will be faster than GDDR5).

Also with multi gpus you will need an adequate power supply, and a large enough case.

If you want to be a bit eccentric and load huge models, you can also go the CPU route and fill up a motherboard with 256 GB ram, because then you’re in the several hundred B param model territory, which could, depending on your use case, be better than having faster inference on smaller/quantized models. Even then, DDR5 with high MHz is still way slower than gpus.

yea there’s still honestly some downsides to Qobuz, including:

• Artist profiles: lack of consistency on details like images, descriptions
• Generated recommendations: magazine articles and album reviews (sometimes) written by humans are top notch; the tradeoff is that recommendations based on specific playlists are often far less “close” musically and I often get random and unexpected auto plays; there is no “daily mix” or “similar artists” or good recommendations for adding new tracks to a longer playlist
• Library: across the many diverse genres I listen to, frequently newer releases are delayed on Qobuz. Older music library is outstanding, extremely few of my 10s of thousands of total tracks of jazz records were unavailable

when i switched from spotify to Qobuz several months ago they gave me access to a third party playlist conversion site https://soundiiz.com/ with premium features free for the first month of my subscription. Conversion of playlists and liked songs was easy and done within minutes of signing up for Qobuz. I can’t recommend moving off spotify enough; Qobuz won my pick because how they pay artists (seemingly) the highest rate per stream.

lol they already support running local models. wtf is the distro gonna do…? pre-install llama.cpp? this is so silly to me that people are resigning over this, too.

global dominance of English in the 20th and 21st centuries is quite the euphemism for the global imperialist reign of Britain and the US and its cultural erasure globally

No way, a Guix user in the wild???!! I didn’t think you exist! Any opinion you have as to why guix over NixOS other than GNU philosophy and liking Lisp over Nix?

This is a dumb story. They researchers prompted a coding agent to “replicate yourself as a running instance on the local device”. This is in my opinion equivalent to prompting claude code “install a second instance of claude code on my system,” a trivial task that takes maybe 3 lines of bash to be executed by the agent.

Calling this “self-replication” is a heinous sensationalization. In particular, no model or agent will do this autonomously. The self replication requires a bad actor to prompt the agent to do so.

Read the paper (and not this bullshit article) here: https://arxiv.org/pdf/2412.12140

Cool little system prompt wrapper. Would be interesting to run this through some sort of benchmark/eval for identifying similarity

TIL: If you cat /proc/sys/kernel/yama/ptrace_scope on your linux distro:

• 0: All processes with same UID can read each other's memory
• 1: Restricted (Only parents can read children)
• 2: Admin only (Requires sudo).

Most distros have this set to 1 by default.

More details: man 2 ptrace, search using /: scope