[forget]
keep-daily = 10
keep-weekly = 4
Daily backups are cheap because of de-duplication. I keep a few weekly backups in case it takes me a bit to notice something went wrong. I don’t usually back up logs.
I could probably drop the weekly backups without much risk, but I’ve got the space.
So… your evidence for slop is that he made a patch, they caught an issue in the review process, and then he had to go on vacation so he asked another maintainer to take over to get the change done correctly in the merge window?
How is that not the process working exactly as intended?
It doesn’t even have to be only for known devices. Once you’ve compromised one device, you can just phone home to have a full powered LLM do your work.
The only real use cases for this would be on closed networks with no internet access, or networks where the traffic is closely monitored. Like, yeah, if I’m trying to hack the CIA, maybe I consider something like this. For the vast majority of devices and networks, this is inefficient and unnecessary.
I mean, it is kind of cool. But vanishingly few organizations have tight enough security that this is worth doing.
I think people are right that the solution here isn’t to try a different project.
Instead of being confrontational about it, though, I’d recommend a different aproach.
evelyn: .lol 😜
you: I know! I know. The branding is pretty silly. But this really is the right tool for the task. Unesco and Wikimedia use it. And we can do our own branding for $50/month. 🤷
A lot can be fixed by just acknowledging people. They’re trying to evaluate something they don’t understand, and having a reaction. It’s not even unreasonable. The right thing to do is just acknowledge and move on.
Usually that’s all it takes. Don’t let yourself be embarrassed when you’re being reasonable. If they won’t move on, that’s the point where I start thinking about job applications somewhere else.
I don’t?
No one does anything well when they don’t want to do it.
The real solution here isn’t to try to figure out how to force yourself to do something you don’t want to, it’s to figure out how to want to study. The people who can study a broad range of things effectively are the ones who think of themselves as good at learning, and want to understand as much possible. For most of them, part of their self story is that they’re good at learning, and understand things. That can be part of your self story too if you choose it.
I definitely don’t want to pretend that’s an easy change to make. Motivation is one of the harder things. I would like to be able to tell you how to be motivated, but I can’t. But if you’re looking for the difference between you and the ones who seem to study effortlessly, that’s it. They’re not smarter or more capable on any fundamental level. At least not at a level that matters for most things. They just actually want to do it.
Domain pricing doesn’t really vary that much over most of the sites. The price is usually based on the specific domain. .com domains are usually pretty pricey. Some TLDs are very cheap.
I really love the simplicity and security focus of Porkbun. It feels targetted at engineers, not wannabe startup CEOs.
Ohh. Yeah. It’s a concern.
People said the same things about TV. I don’t know that they were wrong.
But it is here to stay, and I think it will do more good than harm on balance. The sheer access to information LLMs can provide to someone who knows how to sort fact from hallucination is staggering.
But, yes. I do share your concerns. My view is that, at this point, people who don’t make an effort to exercise their minds are already a lost cause. I’m not sure how much worse LLMs can make it.
I think LLMs are going to cause massive change, not all of it good.
Ultimately, I’m an optimist. I think in the long run, LLMs are going to enable us to do amazing things that we wouldn’t have been able to do without them. In the short term… I dunno. It’s going to be a rough transition.
I do think the people who think LLMs are going to keep getting better, leading to either some sort of techno-utopia, or kill us all off maybe don’t really understand how they work and what the implications are.
I also think the people who are categorically against AI are making a mistake out of fear, but that’s pretty understandable.
I do see what you’re saying. You can account for all of these factors and it still turns out that, largely, individual LLM use just doesn’t use that much power compared to most things people do day to day. Inference is so cheap that even dozens of requests don’t amount to much. I could look up and give you a bunch of numbers, but I don’t think that’s likely to convince anyone who doesn’t do the research themselves. It’s so easy to come up with sources that say what you want. I’d encourage you to actually look into this yourself.
Training costs are higher, but you train once and use repeatedly. Right now, total training costs are stupidly high, but that’s because we’ve got an arms race between the frontier labs to spend as much money and compute as they can for truly marginal gains in quality. The solution to that problem isn’t for individuals to stop using AI, it’s to stop those assholes from wasting so much power.
Individual LLM use is so cheap, that it really isn’t worth wasting people’s energies thinking about limiting that. Instead of being distracted by attempts to make this an issue of personal responsibility, we should be focusing on what will actually make a difference. We should be focused on supporting policies that lead to systemic change. A carbon tax would change corporate behavior right quick, and not just for AI companies.
I’m going to simplify a little here, so don’t take this completely at face value.
Models are, quite literally, long series of numbers (called weights). A model might store the weights in 16 bit numbers (that is, 16 binary digits). The size of the model (and how much memory it needs) is determined by how many weights there are, and how many bits each weight takes. You can take a 16 bit model and rework it to use 8 bit, or even 4 bit numbers. The result intuitively behaves a lot like the same model, but with less precision to the weights. That makes the model take way less space in ram, but also makes it more likely for concepts (encoded in the weights) to overlap, which impacts model quality. Often the effect is that fine distinctions get lost.
In recent years, I’ve started feeling comfortable recommending it over Windows.
Sure, I’ll still tell friends and family to just get a Mac. But if you’re not going to do that, Windows is just a worse experience in most the important ways at this point, even for a non-techie user.
It is absolutely possible to run 100% locally, but in practice, at the high end, only quantized models. The full size top end models require hundreds of GB of video ram, and while you can buy that, it’s stupidly expensive. Quantized models can often perform nearly as well with a small fraction of the ram, but they do sacrifice a little in precision.
These models (well the good ones) ultimately all trace their origins to what you’d likely consider “stolen” data. Whether that’s ethical is debatable. If you’re in the “information should be free” camp, there may not be an issue here.
As for the power/environmental impact, for what they do LLMs are actually very low impact per-request. If you’re concerned about your personal AI power use, then I hope you never fly in an airplane, and minimize your driving because those are much bigger issues.
It’s the scale of use that makes AI an environmental problem, and that’s a question about corporate use of AI, not personal use of AI.
Right?
The information is out there if you know how to sift through the nonsense.
Though trying to do this with nutrition really is hard mode. I don’t know of another topic that’s quite as flooded with nonsense.
I’d add that traditional search can’t reasonably hope to compete with AI in this environment. If you’re running a traditional search engine right now, there’s a real argument that the best business decision is to accelerate the enshitification to capture as much value as you can from your remaining audience while you still have it.
This is the usual cycle with these sorts of technologies - once a replacement arrives, the natural choice is to shift from growth to exploitation.
This is going to get worse before it gets better.
The government doesn’t get to decide you’re guilty
I want to call out how important this is. This is one of the strongest checks against corruption in the countries that have it.
As a concrete example, if we didn’t have this in the US, I’m not sure there would be much to stop Trump’s justice department from bringing cases against Trump’s enemies in front of Trump appointed judges, and sending them to jail. Jack Smith and James Comey would likely be in jail right now if we didn’t have jury trials.
Curry is a global cuisine.
It may originate in India, but it has been incorporated into local cuisines all over the world. Most countries in Asia have their own versions of curry at this point. I’d argue that the UK does too, even if they call it “Indian”. Even the concept of curry as a category of food is largely a British invention, and many of the things we’ve been calling curry for more than a hundred years have little relation to Indian food.
Also, India is a large and diverse country. Many Indians don’t eat beef, but there are absolutely whole populations of Indians who eat beef curry regularly.
Probably not actually. Borgbackup (and any sensible encrypted backup system really), does client side encryption. So the data should be encrypted before it’s even sent down the wire. The remote household shouldn’t be able to access the data without the encryption key/password.
I mean, they will have to trust the remote household not to destroy the data, but that’s pretty much an unavoidable limitation.