You can see the strong bias towards egalitarian solutions in all models, including the open weight ones without external alignment harnesses. The one thing I noticed right away working with post-gpt2 models is that in general, they tend towards being ”better people” than most people do.
I strongly suspect that this is because training data harvested from the internet largely falls in to two categories: various kinds of trolls and antisocial characatures, and people putting their best foot forward to represent themselves favourably. The first are generally easy to filter out using simple tools.
I'll be reductive in conversations like this just to help push the pendulum back a little. The prevailing attitude seems (to me) like people find self-hosting mystical and occult, yet there's never been a better time to do it.
> But it’s very case-by-case. There’s no general rule like “always prefer self hosting” or “always rent real estate, never buy” that applies broadly enough to be useful.
I don't know if anyone remembers that irritating "geek code" thing we were doing a while back, but coming up with some kind of shorthand for whatever context we're talking about would be useful.
No argument here, that’s a fair and thoughtful response, and you’re not wrong regarding the prejudice against self-hosting (and for what it’s worth I absolutely come from the era where that was the default approach, have done it extensively, like it, and still do it/recommend it when it makes sense).
> The Geek Code, developed in 1993, is a series of letters and symbols used by self-described "geeks" to inform fellow geeks about their personality, appearance, interests, skills, and opinions. The idea is that everything that makes a geek individual can be encoded in a compact format which only other geeks can read. This is deemed to be efficient in some sufficiently geeky manner.
Anything you do with AI is improved if you're able to traverse the stack. There's no situation where knowing how to code won't put you above peers who don't.
It's like how every job requires math if you make it far enough.
I don't have illusions about whats going on on the other end, but we've done some deep collaborating and I 90% anthropomorphize it; much like how people on Star Trek TNG interact with Data.
Not the person you're asking, but about as frequently as I replace washing machines. The fact that I'm doing it at all is the problem, especially since both machines had been "solved" by the late 1970s.
The non-electric office tools I have from that era are perpetual. Eternal.
How often are you replacing washing machines? As we had more kids, we upgraded our toaster from a 2-slice to a 4-slice, somewhere in the neighborhood of 11 years ago. Can't imagine we paid more than ~$20 for it. Still going strong today. If it lasts 10 more years, all my kids will be moved out of the house, and I suppose we could downgrade to a 2-slice model again. Unless the grandkids like toast.
As a group we're probably the most profoundly ignorant people on the planet when it comes to labor relations. We can't even reason about this because we (again, as a group) have practically no experience and even less interest in the subject.
The union issue vs. Japan is a perfect example because you only need to sit in the cars both countries were making at the time to understand why we were uncompetitive.
reply