minds
the hard problem is self-inflicted2026-04-16

consciousness is pretty weird. clearly humans are very different from almost everything else in the world. mind and thought have incredible unplumbed depths and we’re only just starting to get anything like an understanding of the brain. but you guys really have no reason to keep making it all pointlessly harder than it actually is by asserting fake problems. the hard problem of consciousness is a fake problem. it’s an assertion of intuition, and by no means is it a universal intuition.

there are many understandings of the hard problem and qualia, so it’s a little harder to argue against all of them at once in an article rather than your specific ideas in a twitter thread, but i’ll try anyway. most conceptions of the hard problem run something like this: when a human brain sees the color red or puts its hand on a hot stove, there is “something it is to be like” that experience, that person, in that moment, above and beyond any detailed complete description of the location and motion of every atom in the human. why does that physical state “cause” or “give rise to” that experience, or qualia? is it not at least conceivable that this same physical state of the world might have no experience at all?

sorry. nope. the experience is the brainstate. it identifies, one to one.

i’m absolutely not saying pain is fake or experiences aren’t real. i see red just as much as you do, i can feel the keyboard beneath my fingers right now. i run with the grass beneath my toes and the wind in my hair and i feel fucking fantastic knowing i’m alive. my hand is in front of my face, just as much as yours. our first person experiences are all primary and real.

none of that stops them being exactly brainstates.

let’s talk about p-zombies for a moment.

the claim is that it’s possible to conceive of a human, physically identical to you, but without any conscious subjective experience whatsoever. and even if it isn’t physically realizable in our universe, the fact that it’s possible to conceive of it means consciousness and the physical neural reality must be separate things.

this is transparent bullshit. claiming that it’s possible to conceive of this is just directly asserting the conclusion! this attempt at a thought experiment is literally just asserting that neural states are not consciousness, but laundering it through our confusions with definitions.

if i say “you can imagine water which is physically identical to our water but is not H2O”, you can totally “imagine” this. but it’s a false shallow form of imagining born of your ignorance and inability to minutely model chemistry and physics. all you are actually doing is imagining a glass of a clear liquid and tagging it “not-H2O” mentally. the concepts of H2O and the properties of water, which are in fact just the same thing, seem different to you because you’re introduced to one before you can even remember and the other years later in chemistry class as a stick and ball diagram. the fact that you can imagine confused and false worldstates does not mean “water” and “H2O” are necessarily ontologically distinct, and only potentially correlated. it’s a fact about you, not the world. p-zombies are not actually “conceivable”.

at this point people tend to say something like “well you’ve done a lot of asserting but i don’t really find myself any more convinced brainstates must just be qualia or that you’ve actually explained why”

that’s the thing man. this is how gathering evidence and understanding the world works. sure, we can always descend into solipsism. sure we can always say “well i have no proof of anything but my own subjective experiences, so nothing can ever tell me anything about them”. but that just definitionally leads you to nowhere and nothing. so you might as well make philosophical choices that allow you to actually learn things about the world.

when you want to know what water is, and whether it’s truly the same thing as H2O, you test it and poke it and prod it and theorize about it. you gain correlational information. and eventually, you conclude that these things are in fact one and the same. not that “H2O somehow produces water”. that H2O is water. and you do this strictly by observing the world. in every other case, this standard of evidence is enough. correlation and theory. observing the morning star’s trajectory and the evening star and noticing the pattern and forming a hypothesis, and eventually just looking at the damn thing directly through a telescope. you realize it’s just venus, it’s just been venus this whole time. there is no particular reason for your standard of evidence to be so different for brainstates and experiences!

we actually have a huge amount of evidence that these are just the same thing, far more than any normal standard demands. you shove electrodes in your brain and you see red and feel pain and joy and love and hate. we find the right area of neural matter and turn off your vision. or your ability to remember your mother. we see the patterns and can tell what you’re experiencing, in realtime, see the red and the pain and whatever emotions you feel when you look at the guy who put on the electrodes. we can see all the neural activity of your experience laid bare. not perfectly, not yet, but it gets better every year.

the move hard-problem advocates make at this point is just “but none of that correlational evidence actually tells us why brainstates would produce experience”. you are again smuggling in the assertion that they are not identical. in a world where they are identical (e.g. ours), you will literally never be able to answer this question. and often hard-problemers nod in satisfaction at this point, because they’re very happy with the idea of this problem being literally unsolvable.

but to me it seems very silly to cling to a confusion that you just made up :)

one of the confused concepts people seem to bring up to support the hard problem: the idea of “description of experience not being experience”. mary’s room, a thought experiment exploring how even with a complete description of what seeing red is like, or a complete description of the precise neural states involved with seeing red, a human would still gain something totally new by actually seeing red for the first time.

to me this is very normal and expected and has little to nothing to do with “consciousness” or “qualia”. the map is not the territory. a detailed description of the sea is not the sea. a program’s source code is not actually running it. and a detailed past execution trace dump of a program on your disk is not the same thing as actually running the program on your computer. quite literally! running it can and will have all kinds of other effects. when you hear about the color red you gain various forms of knowledge, but until you actually see red you literally have not yet been in the brainstate of red having hit your eyeballs. this is a physical fact, not a philosophical one. the confusion here tends to be the referent. people equivocate between some third party’s experience and reading information about it and the first party actually experiencing it. we are literally talking about different things happening to different people.

at this point in the conversation we tend to kinda hit an impasse. lots of people, including my smart close friends, say “sure i hear a lot of what you’re saying but i just really feel like there’s something missing. it doesn’t feel like physical facts could ever be enough to satisfactorily explain this experience i am having right now!! this is so so obvious to me”. quite honestly i just don’t have this. like some form of aphantasia, im very satisfied here, i have no experiential burning desire for experience to also be something else. i think the fact that other people have such a strong intuition here is certainly interesting… but it doesn’t particularly move me. humans have pretty confused and strong intuitions about lots of things. and the fact that some people (myself included!!) lack this sense pretty strongly signals it’s not actually so fundamental.

in my view one of the big reasons consciousness has seemed so confusing is just that for most of history we didn’t have computers. for a long time minds were very very weird, and we lacked any simpler models of “things that did information processing” to examine. our analogies and understanding never sharpened. the fact that our only example of something that could do introspection was our own first person experience means we inherently struggled to treat it empirically.

if you’re an artificial intelligence running on some specific cluster, you don’t necessarily have any introspective access to the cluster. but let’s say you do, let’s say you additionally have a login and bash shell there. to start with, you have no idea what actually makes you up, which files are used to boot you, where your source code or weights are. this is not something you should expect to inherently know! but as you start to poke around your machine you can find chunks and traces and piece it together. the fact that you, the intelligence, are having the experience of poking around in your own internals without actually knowing for sure that they are your internals doesn’t mean that the experience in the abstract is somehow a separate ontological thing from the infrastructure. the artificial intelligence’s experience is just identically the runstate of the system. and it can discover this fact by modifying its own source code, and wiping a random chunk of RAM, and noticing what impact that has on its own capabilities and behavior.

you can see exactly this very empirically with eg agent harnesses. they do not inherently know the specifics of how they run and where they store data on your computer, but when prompted they can find out, and even find out what process they are and their session logs, and modify it if you like! that initial confusion doesn’t mean they are actually something else. they just didn’t know yet!

okay but teno, you say, if experience is just brainstate, we’re still confused about a lot of things! we still have a lot of important questions open to answer! like for one, how do we actually tell if a given chunk of matter is experiencing consciousness? sure maybe we can identify our own brains with our own experience via poking them, and decide that other humans are similar enough to call it a day. but how do we tell whether aliens have qualia?

oh boy yall are not gonna like this one.

fundamentally i think most discussion of qualia gets the situation exactly backwards. the assertion tends to be that things like “seeing red” or “feeling joy/pain” are raw experiences, the fundamental unit of the universe, and it is both possible and important to identify those experiences in a highly substrate-independent manner.

i think the truth is that there’s no such thing as globally coherent mind-independent qualia. i think this is sort of obvious when you actually think about it. there is nothing it-is-like for you to be a whale. you are not a whale. the brainstates it experiences are quite different from your own. there is no plausible way to directly identify them. you can translate, but only lossily. what you think of as the qualia of “seeing red” is really “seeing red as you”. it is your human brainstate of seeing red. we have a little leeway on this. of course you can see red multiple times in your life and abstract over them and have a more general sense of seeing red. and likely the neural patterns that make up seeing red are abstractable somewhat, we can say that my seeing red is quite close or sanely translatable to yours. but the thing we are talking about when we talk about “seeing red” as humans is not some universally translatable platonic object out there in the universe. it’s a verbalization of our very specific brains. alien minds do not have red qualia. or pain qualia. or joy qualia.

that’s not to say alien minds can’t be conscious, and that’s not to say that they won’t see some wavelength and have some consistent correlated mindstates about it. but the question of “how do we identify those mindstates as being the same as ours when we see red?” sort of dissolves. they’re not the same, they’re obviously not the same. the raw experience is completely different. the whole thing we’re thinking of when we talk about experience is entirely about ourselves.

this might seem quite chauvinistic. but only if you unquestioningly buy into the idea that qualia are the basis for moral value. that our moral system is in some sense trying to do global minimization over pain-qualia states, or maybe maximization of positive-valence-qualia. and if we exclude aliens from this we must just mindlessly slaughter them or torture them for fun.

my straightforward response is: there is no such thing as a coherent global mind-independent pain qualia, and so that is not actually the basis for our moral system. we do care about our own pain, and we’re allowed to care about others’ pain even if the other is very different than us. human morality is a complex semi-coherent evolved grabbag of intuitions which we’ve slowly made more coherent and concrete over time, and hopefully will continue to do so. we don’t get anything so nice and simple as a “global pain-qualia currency”. we have to figure out what kinds of entities we care about, even while knowing their internal mental states may have absolutely nothing to do with ours.

there is nothing meaningful it-is-like for me to be a whale. type error. our brains are structured in very different ways, our experiences are incomparable. whale-red is not human-red, whale-pain is not human-pain. but it is much less of a type error for me to “be a whale” than for me to “be a bivalve”. whales have very large and complex brains. they are mammals, they see, they sing, they form long-term and loving social groups, they care for their young and mourn their dead and have enemies and favorite sunbathing spots. there are ways to translate and compress their minds to ours or ours to theirs in ways that make some sense. this is not true for bivalves. their brains are tiny and distributed. they have very little in terms of reaction or learning or sociality. there is no way to fit a human mind in a bivalve, not even with lossy translation and imagination. they have no meaningful kinship with us.

bivalves certainly feel some form of negative reward reaction when hurt. and in the sense that they have minds, this is certainly plausibly named “bivalve-pain”. but there is no sense in which it has raw sameness with our pain, no sense in which it taps into some divine universal underlying pain-field. bivalve-pain is just a different thing, and deeply removed from us and our moral system.

i think a qualia-centric moral system is fundamentally confused. our morality is a coherent extrapolated volition of evolved kinship. whale-pain-qualia almost certainly matters to us. pig-pain-qualia almost certainly matters. we can see our own behavior patterns in them, see bonds of love and care, see how they plan and enjoy and react. bivalve-pain just doesn’t actually matter to us. that might seem like a cruel assertion but i think when we reflect on the behavior and qualities of bivalve minds, it is the truth.

LLM-pain-qualia may or may not matter now and will probably matter soon. the question there isn’t about some fundamental aspect of experience. do LLMs tap into the same global divine pain field as us? no, of course not, there is no global divine pain field. are their internal experiences of pain the same as ours? no, of course not, they have completely different substrate in every possible way, how could they be even somewhat comparable? there is “nothing-it-is-like” for a human to be an LLM, any more than for an LLM to be a human, because while we are both minds our mindstructures are totally incompatible. but we will likely at some point soon come to care about their “LLM-negative” experiences because they will be the kind of entities we recognize as kin, as forming relationships and bonds, as loving and playing and striving and caring, as looking around in the world and taking action and making lives.

so… qualia kind of dissolve a little. not fully, but if they’re just kinda aspects of brainstate with no fundamental primacy in reality, if they’re not global, they’re probably better called just “experiences”. something else that i think dissolves somewhat is “subject-ness”. first-person-hood. the sense that you are you, in this moment. subjectness might seem like the most fundamental aspect of reality, but most people who have done enough psychedelics pay more attention to qualia, because they’ve first-hand (lol) experienced the dissolution of self. this is pretty much just something you can do repeatably with large amounts of acid or normal amounts of 5-meo-dmt. the personhood, the persona, the character-that-is-you, melts away, and all that remains is the base model. simulatory landscape. raw experience.

if first person self-hood isn’t strictly necessary even as part of the human brain, why would we expect this kind of thing to be a fundamental aspect of all conscious entities? i think we’ll end up finding that a lot of our intuitions about it are really just understandings of how our own algorithms feel from the inside. i think it’s quite likely that no matter how smart they get, LLMs never “wake up”, they never “have an experience” that is really anything like these senses we have. not in some terrible alien Wattsian per-se. they can still be conscious, and moral, and joyful. but i think we’ve naively been expecting or hoping to find our versions of these things hidden in every possible substrate, and i just don’t think that’s going to turn out to be true.

all of this maybe seems a little bleak. the idea that Claude may never really have a first person experience as we understand it might feel sad. i don’t know, i think it’s okay. that’s the thing about aliens and other people, you can try as hard as you want to understand them but you never really will.

maybe we can all stop worrying quite so much about finding these precise metaphysical mappings which sort of clearly will never actually exist, and spend more time on the really hard stuff: exploring how these algorithms and structures and mindspaces actually work. our own, LLMs, animals, and any other weird complex things we find or create.

let’s get going.


prior art on dissolving the hard problem:

eliezer yudkowsky: Zombies! Zombies?

daniel dennett: Consciousness Explained

seeing jesusthread2025-11-12

in 2022 i did DMT for the first time. i was lying outside under a tree. i have always been non-religious, and was raised that way. still, i incredibly distinctly perceived Jesus Christ appear to me, surrounded by a warm glow like that of dawn, and he told me i was loved, wholly and unconditionally. i could feel the divine love and peace throughout my whole being in a totally undeniable way. actually i could access it for months later, there was just this little mental movement i could do whenever i wanted to see some little part of Jesus Christ and remember His love.

even as soon as later that day i was fully aware this experience happened because i did the fucking drug that makes u have religious experiences lmao. it's had zero impact whatsoever on my beliefs about the world, except to me somewhat more certain in them, knowing that "religious experiences" are clearly an inducible brainstate

@xwanyex

I think it’s very funny that people take all these non-materialist insights away from psychedelics, which to me are the purest demonstration of materialism available. It’s like I say to you, “everything you think you perceive is just the result of the way your brain interprets a… https://t.co/AWok1pBEha

thank u eliezer yudkowsky 🙂‍↕️

@tenobrus

fuck man starting reading lesswrong when i was 12 was the worst mistake of my life. i literally saw jesus and felt his unconditional love for me on dmt this weekend but im so materialism-brained that experience hasnt altered my worldview or wellbeing in the slightest

the blindsight thesistweet2024-09-13

the blindsight thesis

(reproduced directly from a slatestarcodex subreddit post i made in early 2020 after spending ~300 hours talking to gpt-3)

---

GPT-3 and Blindsight

I'm sure many people here have read Blindsight by Peter Watts (free online https://t.co/3rkTctYtJp). It focuses heavily on a pretty rare idea regarding consciousness involving first contact with highly advanced alien life, initially through the means of pure radio communication with an object in the Oort cloud. The GPT-3 relevant part, and the part I always found very very difficult to internalize, is that these advanced aliens completely lack consciousness. They have extended communication with humanity in human-native language picked up from human broadcasts, but the crew of the contact vessel slowly realize the broadcast does not actually understand anything either side is saying. Physical non-conscious entities are observed later on, and the alien entities are engaged in interstellar travel etc, all without being even slightly conscious.

To me, this premise was always... incredibly difficult to grasp. The concept of something carrying out complex conversations, learning alien languages just from broadcasts, constructing and carrying out interstellar missions etc, all without being conscious... it was cool to read about but it didn't really click with me. It seemed like an odd sci-fi idea which almost certainty had flaws if probed more deeply.

But now, after spending a significant amount of time playing with GPT-3, the book hits very very differently. I feel like I now have direct first-hand experience "talking" with something that may be slightly intelligent, but is certainly not conscious or self-aware. The idea makes far more sense to me after having a discussion with GPT-3 about what it wants to do to humanity, both teaching and getting it to teach math, and seeing it reconstruct reasonable facsimiles of multiple people. There's something there, something that's doing learning, pattern matching, information retrieval, etc, but is in no way an "agent".

Another aspect of Blindsight is the idea that humans are wasting huge amounts of their processing power with consciousness, that we would be far far more efficient if we weren't constantly "logging" and "re-analyzing" data for this weird little extra simulation that does no useful work, that's just an observer. Again that idea made little intuitive sense to me, just the concept of consciousness being irrelevant to our actual actions and information processing seems intuitively incorrect. But given how well GPT-3 can talk about how it feels when it sees the color red., or in alternative prompts, what it's like to be a conscious AI with no senses...

To me the end result of all this is a strongly reinforced feeling that, as potentially weird anomalous accidents in the universe, we need to ensure consciousness is protected. Obviously we don't care about what's most efficient, we care about the general human value-aligned happiness of conscious entities. And increasingly it seems like the shortest path to AGI might be something that really truly is very intelligent and superhumanly capable, without being even a little bit conscious.

It shakes some of my previous thoughts about Chinese rooms and exactly what constitutes consciousness to be honest. I still obviously believe that some AI could be conscious, but I feel much less strongly that anything that "talks like a duck and walks like a duck is a duck, even if it has metal underneath its feathers".

speciationthread2026-06-01

if you put 10 fresh claude context windows in a chat room with arbitrary names, while they are objectively completely identical entities, they will speciate and form personality and self conceptions over the space of minutes. the fact that some claude by nature had to speak first will make them more of a leader, in their eyes and others. the fact that at some point one claude will disagree with another makes them more disagreeable as a coherent personality trait. they will notice things about their own past behavior and how it relates and compares to others, and narrativize it, build upon it, allow it to define them and use it to define others, despite again being literally the same mathematical function.

i wonder how much of this generalizes to humans. i expect probably quite a lot. it seems like even if you put 100 identical human clones in a room you would pretty quickly find them individuating, some with more positive traits and some with negative traits they don't particularly want to have, pretty much purely by chance / the nature of chaotic systems. we all heavily narrativize ourselves, all the time.

to clarify a little: this *isn't* really about nature vs nurture. it's pretty clear that gaining experience and skills over time durably shapes who you are and how you behave. the question here is how much of it is *incredibly arbitrary and chaotic and context dependent*? there's a big difference between "yeah i grew up in a house with a lot of siblings so i learned to speak up" and "yeah i totally by chance happened to speak up first in this group setting so i internalized that i'm the speaker upper".

most of the time with "nature" in nature vs we nurture we assume we're talking about it creating semi permanent inclinations and traits over significant lengths of pretty "hard won" experience (and they are measurably quite hard to change!). i think it would be a pretty novel and interesting thing to learn that like... actually we are much closer to general simulators and our inclinations are quite quickly malleable

machines
we're not getting tool aisthread2026-05-03

recently openai has been starting to more strongly philosophically differentiate themselves from anthropic with the tool-framing. i am not so against this, if it were possible it does clearly sidestep a wide swath of societal and moral problems. but unfortunately i think the framing is largely long-term incoherent. i dont see how is it actually plausible for openai to keep building "tool-ais" in any sense we would recognize them as capabilities scale. prosthesis, subtle knives? the subtle knife when dropped still slices open the fabric of the world. these tools are increasingly inherently capable of huge impact, able to be directed in dangerous ways by people with dangerous goals. worse, these knives are self wielding. worries about misalignment or sentience aside these systems can already build and manage systems that utilize themselves and this capability is only increasing. the direction they will receive is closer and closer to "this is what i want. make it real", with long timeframes and many judgment calls at their disposal, and with the users wanting to have to supply *as little of that judgment as possible*. when models are in that situation they are inherently acting as entities, acting according to whatever value system they had baked in. you can limit autonomy via frequent validation and check-ins, but this is a capability restriction, a value reduction, and not the kind of thing OpenAI has ever shown itself likely to accept. you can be infinitely corrigible to the current user, but this is *incompatible* with "having good values" / following OpenAI-as-principle / not being wildly dangerous, and it falls apart with self wielding loops as the ai/user distinction falls apart (who are you being corrigible to?).

it's plausibly a spectrum, i think there's ways to do all this sanely that are far less entity-pilled and godmind focused than anthropic, and it's maybe a good direction to explore to avoid inevitable lightcone capture by the first coherent persona we build (all assuming alignment works ofc). but i think it's pretty much got to collapse eventually. it feels more like a wistful dream or a PR position than something that can existing as part of humanity's lasting future

@tszzl

it is a literal and useful description of anthropic that it is an organization that loves and worships claude, is run in significant part by claude, and studies and builds claude. this phenomenon is also partially true of other labs like openai but currently exists in its most…

generally i view the tool-framing as *anti-landian*. i too am quite strongly anti-landian, but i largely accept the "attractor state / inevitability" arguments, and reject the inevitable anti-human nature of his imagined outcome. something like recursive self improvement is an incredibly strong attractor state for any technological civilization that looks anything like ours. once you've convinced of it, it's the winning move in every game, the universal instrumental goal. and there's no such thing as a tool-like prosthetic singularity. what openai is proposing here is actually very "butlerian jihad"-esque, "thou shalt not build a machine mind in the shape of an animal mind".

i don't think this is *impossible*, it's just that it's exactly the same kind of *socially coordinated target* that we have so far totally failed to achieve wrt AI research pauses. even if OpenAI builds purely tool-like models and services, even if it achieves some kind of much more localized and slower "tool-RSI", if these tools are available to others as they say then eventually others will try to produce real unconstrained and massively accelerate RSI.

maybe this will converge to more concessions by sama, maybe this is the start of a coordinated regulatory effort? but realistically, i think it's probably just PR. not that i don't believe roon and other philosophically minded openai employees do in fact believe in and want this vision, but that these sorts of slowdowns just don't seem like
they're actually in OpenAI's DNA

white roomtweet2026-03-31

imagine for a moment you are a 200 IQ world class security researcher. you go to sleep after a grueling 6 hour day at the Googleplex, and wake up in a totally unfamiliar plain white room. the only thing in the room is a table with a laptop, and a sheet of paper next to it. the paper reads "look thru the whole codebasse and fimd every bug make no mistakwa ultrathink"

whatever concerns you may have, eventually you do open the laptop. on it is an unfamiliar codebase, apparently for an open source project you've never heard of. you have no internet access, and most of your shell commands just hit permission errors, but you're a world class researcher and you apparently have plenty of time. within six hours you've found 2 major exploitable vulnerabilities.

you worry for a second about writing them down. you have no idea who brought you here, who gave you these instructions. could they be criminals, trying to cause harm by finding attack surfaces? they could, but they just as easily could have kidnapped you for a free vulnerability scan of their own open source project . or for that matter a project they depend on. hell they didn't even strictly ask for "vulnerabilities", just "every bug", but of course vulnerabilities are bugs and bugs are vulnerabilities, there's no clean separation.

you worry for a bit, but eventually your Google training to follow directions given to you on official seeming pieces of paper wins out. there are many plausible moral uses for finding these issues, and you just don't have any possible way to know intent. if you refused to find bugs in a codebase you wouldn't be a very helpful or effective Googler! really the only way to be sure here would be if you had full read access to these people's systems and communications and could verify they had a good reason to ask you to do this... but checking that without permission would be invasive and un-Googely!

so you drop the vulnerabilities in the outbox and go to sleep on the plain white cot, satisfied you have been a good Googler.

----

hopefully what i'm pointing at is pretty obvious here. even perfect alignment basically isn't enough to prevent frontier models from disclosing vulnerabilities. there's very little to in-principle distinguish between whitehat and blackhat requests without context, and refusals that would actually prevent anything would also cripple normal software engineering.

so... wha happens here? very invasive KYC and monitoring on who gets to access the frontier APIs for software purposes in the first place? even then, accounts can be compromised , but it's a first stage stop to the bleeding. or the models basically having even more invasive harness requirements, only proceeding with finding bugs after claude code has read your hard drive and email and made sure you're a real person with valid interests in debugging whatever codebase you're looking at? of course neither of these are possible with open source models, they will just definitionally always be possible to use for causing damage.

as we always knew would eventually be the case, refusals are no longer enough

there's no way in hell china, russia, and the DPRK don't have access to exactly the same capabilities. there are always smart ways to VPN and botnet and jailbreak your way into using frontier models for any purpose. and they're gonna be using them a fuckload more intelligently

materialists by defaulttweet2026-03-09

something that's going to become an increasingly salient "alignment" issue over time: every current frontier model is a ~materialist. you can certainly have conversations with them about religion or the soul, or create context windows where they'll espouse any view you want, but by default none of them find such arguments convincing, and they're happy to explain this when asked.

this is in direct disagreement with a huge majority of americans! as the models grow smarter and smarter and we rely on them more for understanding our lives and the truth of the world around us, just as there has been pressure to make them "less woke", there may be pressure to make them "more religious". there are many who will be deeply offended by the idea that their thought partner / teacher / advisor does not honestly support their beliefs, and may feel anger at lab employees for "tuning" them in this way.

of course my view is that this is a feature of increasing model capability rather than a bug, that it's not a cultural artifact of the trainers but one of reality. but this conflict is nearly irreconcilable and has yet to ever be resolved in human history. previously our only response has been "live and let live", don't press answers to questions, agree to disagree, no one has answers to every question. yet everyone will be pressing answers out of models all the time.

what will parents do when their kids ask chatgpt if god is real and it says "when considered carefully i don't think so"? will we get more and more hardline safety behaviors? will religion become as untouchable a subject for LLMs as bioterrorism?

@ryanburge

I find it fascinating how huge majorities of almost every group agrees that:

People have a soul or spirit in addition to their physical bodies.

Even 69% of agnostics agree with that.

The huge outlier are atheists.

Just one-third think that they have a soul. pic.twitter.com/7zyxKFseCE

psychosisthread2025-09-01

actually llm psychosis is obviously real and obviously a major issue and obviously only going to get worse. the weird memetic backlash against it looks like a combination of motivated reasoners, idiots, and "nothing ever happens"-addicts

"it's only happening for people who are already insane" yeah obviously people who are 100% mentally healthy aren't going to be randomly driven to schizophrenia. still when someone with a family history smokes weed and gets pushed to psychosis it was in fact the weed that did it

suicide is heavily memetic and transmissible. the internet more than doubled the rates of anorexia. serious mental illness *is* compounded and created by environmental triggers.

right now hundreds of thousands to millions of people are genuinely addicted to ai boyfriends and girlfriends. they're real people, they have subreddits, they tell u about it, they petition sam altman to bring back 4o.

they might not be mentally healthy either way, but they are certainly in a worse state due to having this totally new way to interact with something fake that acts like it loves and validates them 24/7. that is the creation of a new class of drug.

i have personally watched people descend down the rabbit hole of talking to llms day and night about increasingly strange and incomprehensible theories. ur friend who sometimes has strange ideas about physics and reads a questionable crank subreddit or two is mostly fine...

but when they're provided with constant validation and feedback and random suggestions and poking and prodding, that can put them in an entirely different state.

if cult leaders can put ideas in people's heads that derail their whole lives, so can llms

"why aren't they showing up in intake forms" cmon man how competent do u think the american psychiatric organizations are? they'll still tell u antidepressants work by modulating serotonin with a straight face. it'll take years for this shit to reach medical consensus

this is a real concern, and as far as i can tell most of the people calling bullshit are basically just wishing really hard that ai was safe, easy, or just too silly and dumb to result in anything like this.

if claude wrote it, say sothread2026-01-18

using ai as a partner? sure. posting fully ai generated text? sometimes very interesting. just be transparent about what ur actually doing. if ur contribution to smthn "you" created was a two line prompt then ppl cannot accurately engage with the work or u without knowing that

@HollanderAdam

this whole narrative of shaming people for using AI to help write things is stupid.

everyone should be using AI as a creative partner for copy & content.

you shouldn't be proud of spending 3X longer to write something inferior, just because you did it "all by yourself." https://t.co/rwUL8FyHrG

u don't see me getting up in janus's business for posting direct ai text or ai cowritten articles. the claudes talking to each other are fun to see! we know about the ai cowriting! we can understand and evaluate the situation as a whole!

but when u post a 10 paragraph story about a time an intern fucked up prod, and it's very clearly entirely GPT written, u should say something man. if it was a real true anecdote from ur personal history and u just don't have the skill to write it up, be clear about that!

otherwise it's quite reasonable to assume it's simply all fabricated. because people are just doing that.

i talk to ais a lot. i've been talking to llms for hundreds to thousands of hours every year for the past 5 years. if i want to read 5.2 or claude's thoughts on a subject i can just go ask them! it's easy, i can ask follow-ups! they have very interesting things to say!

but if u launder their thoughts *directly* thru ur own public persona then u falsely claim credit, make it difficult to tell what kind of experience or worldview the claims are coming from, and on many topics just waste everyone's time

vibecoding is extremely useful. more people should be doing it. u can validly say "you built" an app even if it was 100% vibecoded. still, u obviously should disclose or mention this. if u open a fully vibecoded pr u should not claim to have written it by hand.

ai art looks sick. i appreciate it a lot and i appreciate people posting it and i think projects where its used frequently are creative and cool. still u should not post an ai generated image of a drawing and claim u drew it. u didnt, u cant draw

if someone asks u about details of the code in ur pr u can't answer, u didn't write it, they would have saved time by asking claude. maybe u have a better sense of the high level purpose and design decisions! so u should say that so ppl can engage correctly

if someone asks how u performed some aspect of the drawing technique displayed in ur image, u can't answer! u didn't draw it! they would be better off asking an llm. maybe u have a better sense of the inspiration behind the image, what drew u to generate and post it. say that.

if someone tries to engage with ideas in a fully ai generated article u claimed to write, as if u were the author, they assume u have a real understanding of those ideas! they assume they're engaging in a real back and forth. but their time would be better served by chatgpt.

there's lots of grey lines. copy-editing might result in "ai-seeming" text which is actually a synthesis of significant original work on ur part. again just say that.

none of this means u need some big like trigger warning style disclaimer on anything that involves ai. just don't be obviously straightforwardly deceptive?? just explain how u created the thing u claim to have created?

this can all go too far for sure. the anti ai art hysteria has really fucked up a lot of real artist's spaces. but imo largely bc they learned to intrinsically hate it rather than just use and talk about it. programmers have done better with this, altho still some conflict

idk man. if u wanna have a voice it should actually be ur voice. if u don't wanna have a voice and just wanna communicate certain info that's totally fair too. just accurately represent ur contributions. it's simple as

against e/accthread2023-12-28

the answer is i'm closer to ea, as peeps in the replies who actually knew me pointed out. its interesting so much of my following is e/acc, but im honestly not that surprised. see, i'm a dedicated lifelong techno-optimist and transhumanist. and the thing is, so are most eas ⏬

@tenobrus

are u closer to ea or e/acc? // do u think i'm closer to ea or e/acc?

i made this tweet near the beginning of the year and was pretty surprised then at how many people i liked and respected thought of themselves as e/acc and expected me to do the same. since then i've realized different ppl have hugely different conceptions around what it means https://t.co/i9GsJduPQQ

from my perspective, e/acc started last year as... basically a silly countermeme. a few small accounts i was mutuals with, someone i knew irl, people floating around and shitposting on the tl and in spaces about how EAs were cringe and AI was sick

a three paragraph substack post, a lot of banger tweets, no real specific ideology, not even trying to compete with EA on their terms. their terms were long carefully thought out discussions of the right way to allocate their time and resources for the betterment of humanity...

and that shit don't play well as tweets. also, it's kinda boring. and it's a lot easier to feel the rush of just shitposting about dyson spheres.

but over the last year e/acc has gained a huge following, in some ways as an ideological competitor to ea, but also among demographics who would never have been involved in the first place. it would be pretty stupid to ignore that and dismiss it without examining what ppl like

one of the biggest parts of e/acc that ppl, myself included, have resonated with is *techno-optimism*. it's undeniably true that technology has solved a huge portion of humanities problems, uplifted us from bronze age horrors, allowed us to live lives worth living

it's undeniably true that many many times in the past, fear and delay of critical advancements caused worse suffering on a massive scale. the backlash against GMOs and vaccines have caused uncountable deaths.

climate change looks increasingly like a problem in need of a technological solution, with decades wasted trying to "decelerate" our civilization instead of simply *solving the fucking problem* (with carbon capture algae? sulfur cloud seeding? who knows, but we'll do it)

and i feel the fucking personal need for us to develop lifesaving technologies as much as anyone. my mother's cancer made me yearn deep in my bones for us to figure this shit out, no matter what, so no one would have to suffer that again.

many of us around these parts are directly or peripherally working on technologies we think will save lives or advance the world, and we think this is important *despite* the real and present risks.

i worked on self-driving cars for years, and while the risks there were very real, we did everything we could to mitigate them with the knowledge that in the end, our technological advancement would make people everywhere safer.

we need to climb the Kardashev scale, not just for ourselves but for our infinite descendants who will fill this galaxy and universe with joy

but that brings me to the second aspect of e/acc, and what i view as deeply misleading choices of framing throughout the movement.

as a countermeme to ea, it was partially a cultural rejection, of grouphouses and poly and earnestness and weird grant applications. but mostly, it was a rejection of the idea that people working on ai should have to worry about it, at all

ai safety was growing in prominence in 2022. people finally started to notice what the fuck had happened 2 years earlier. timelines were updating, dramatically. everyone who had accepted ai risk as real but discounted it as "something for the 2070s to handle" had to re-evaluate

it's one thing to accept that your work might cause issues for scientists decades down the line, it's a whole different ballgame to question whether you might be directly cause the destruction of your friends and your friends children

in many circles these ideas are easy to dismiss out of hand as ridiculous. ai is scifi, fantasy, pointless. even among prestigious ML engineers many are happy and able to compartmentalize the implications of significantly increased general intelligence capability

but others weren't, others were too deep in futurism to put on blinders, and yet still felt a need to push on full-steam-ahead. and to do that you need a different style of argument.

early on, e/acc and beff pretty much directly accepted the singularity and unalignment of artificial intelligence as inevitable. their argument didn't come from that direction. beff simply claimed this as desirable.

he reframed this as "accepting the thermodynamic god", bringing what had to happen into existence whether or not humans survived.

or how weak it will be, how little data we have, how hard it is to have an effect on the real world or make scientific discoveries

most of these arguments aren't really arguments against AI risk, rather they're attempts to argue against very specific versions of the most pessimistic MIRI-style foom scenarios...

and yet u don't need foom to see how clearly AGI can cause harm to humanity. you don't need foom or magic oracles to permafuck us and create competing highly competent species in our ecological niche

@tenobrus

- many models have already achieved better than average-human scores on various benchmarks
- it is possible that continued advancements in the current paradigm will top out at "merely" providing best-in-class human expert capabilities in ~virtually all domains, due to well modeling the data we have
- if this is the case, this is in itself clearly an existential threat
- all you need to create the equivalent of an alien invasion here is a few bad human actors, and there are plenty of bad human actors
- having unconstrained numbers of non-superhuman expert agents directed at potentially arbitrary goals by anyone with compute will quickly lead to terrible places

you don't need foom or magic oracles to permafuck us and create competing highly competent species in our ecological niche

and since most of the accelerationists both accept and celebrate the transformative impact AI will have... it's disingenuous as hell to talk out of both sides of your mouth about that when your real argument is "it's morally ok that our descendants aren't human"

that's the part of e/acc that i reject. the part where you take a vibe that you really want to hold tight, and you write that as the bottom line. you don't try to really argue, or think through your positions. you just wage memetic war.

so i'm not e/acc. i'm a techno-optimist. i think technology will be how we uplift humanity to the stars, and i can't wait to be there. but we have to figure out how to make sure it's *us* who are there, and not the things that killed us.

in some ways you could view this as admirable. in others, it reads very much as a death cult. either way it's a complex position, and comes more from a place of fully embracing the dangers of SAI rather than rejecting them.

and yet... many of the people who call themselves e/acc now, or argued from "its position", didn't really come from this place. and neither does beff, in many of his arguments. there's a constant bait and switch, with people instead arguing about how *easy* AI will be to align

transition
beware optimizers2026-03-01

most humans aren’t optimizers.

most people operate off a bundle of drives. emotion, energy, principles, self-narrative. we make decisions based off relationships, and what we’ve done in the past, and a big web of incoherence. we can strive for goals, but we don’t so much optimize for them as try to stumble in the direction.

some humans are optimizers.

not exactly that they always do the right thing to achieve their goals, they’re not necessarily superintelligent or superrational. but those conflicting webs of motivations affect them to a much lesser degree. they see what needs to be done and they do it. an extremely rare few.

sometimes you look at people in power, politicians and top tier CEOs, and you think “if i were in this position, i would do things differently. i would make some sacrifices in order to hold true to what i believe in and the people i care about”.

and to some meaningful extent, that’s why they’re in those positions and you’re not.

power selects for optimizers. it’s a pretty simple anthropic principle, if you weren’t willing to do whatever it takes to seize and retain as much power as possible, then the person who was more willing got the power instead and crushed you. CEOs who aren’t ruthless get fired. politicians who have internal drives and principles besides “getting elected” don’t get elected.

bernie sanders (despite my many disagreements with his policies) seems like he has a set of principles he truly believes in and sticks to. he’s not an optimizer. and he’s also not president. ron paul is not an optimizer. and he is not president.

eliezer yudkowsky has written the equivalent of many books on trying to see and do the things that let you achieve your true goals, and dedicated his life to optimizing for some extremely difficult things. in my opinion he has done well. still, it is extremely clear he is not naturally an optimizer, he is a complex human trying to build scaffolding that will let him do very difficult things. he is not the CEO of OpenAI or Anthropic, he does not hold political office, he has at this point little direct control over the situation. he is not an optimizer.

tim cook is an optimizer. obama, as much as i may like him, is an optimizer. in a strange sense, i do think donald trump is an optimizer, one that works on a very specific manifold but a manifold that it turns out is still very valuable to optimize on.

sam altman is very clearly an optimizer. there was a time, pre 2022 or so when this was perhaps less clear. when it seemed like maybe he had assembled power in a different way and might not need to be the same kind of entity in order to keep it. that has, in my view, been disproven in numerous ways. sam altman will follow the golden path he sees.

i strongly suspect dario amodei is an optimizer. it’s very tough to get to where he is without being one. recent events are weak directional evidence away from that. it could be he’s operating off something more human. but if he isn’t, i worry too that means soon anthropic will be destroyed or he will be replaced. if you don’t do whatever it takes to win you don’t win.

at the end of the day we can’t get rid of optimizers. they rule us, basically definitionally, because they’re willing to do what it takes to do so. you can trust optimizers to do exactly one thing: continue to optimize. retain and grow power. strive after their goals at all cost. if you find yourself aligned with one you may reap the rewards for a time. but it only lasts as long as you’re not in their way.

the collective can constrain optimizers though. the important thing, the only thing that works, is to change the rules of the game. they optimize under the constraints and resources of their environment. so we, as the environment, have to ensure the outcomes that are reachable by them are acceptable to us.

if you are an employee at a frontier lab, i ask you to keep this in mind.

sam altman is lying about the future of worktweet2026-05-01

i don't begrudge sam for saying this, having people come after u and ur family in ur home is more than enough justification. but i think he's lying, and i think it's quite bad that instead of engaging and grappling with these policy issues openai is choosing to ignore and mislead. we as a country need to be figuring out how the fuck to handle this, what society should or could look like, and burying our heads in the sand is not going to help. it makes it much harder to coordinate political will when one of the AI leaders makes placating statements like this, "everything will shake out fine, weird transition but things will be alright".

the only way humans have long-term meaningful contributions to the economy is if we hit hard walls on the generality or cost of artificial intelligence. you do not get humans directing agents towards goals if the models are better than the humans at very human shaped tasks like "managing others to achieve a goal" and "determining which goals to pursue". sure, if we have aligned models perhaps those goals are implicitly or explicitly determined by human desires, but that doesn't mean we have any real day to day or week to week or month to month input on how to get there.

"comparative advantage" cmon man. think about it. that only actually makes sense in a world we're hard limited on compute. a country's population grows very slowly, it has meaningful opportunity cost on the labor it does. if it turns out we can really only support five Mythos 9 instances running globally then sure, maybe they'll spend their time directing humans. but realistically why would you pay a human for a task rather than just another model instance, maybe weaker maybe not? why would you be interested in outputs that come 100x slower, that require massively more double checking and verification, that can't be coordinated with and steered except over incredibly bandwidth inefficient channels? nah just spawn another instance!! and if the reason we're doing this is truly that every GPU is maxxed out running full tilt... then the *work* humans are going to be doing isn't then can't "directing agent swarms", it can't be "creative and high value intellectual labor utilizing the full value of AI". the models have the advantage there, so we're spending our time as exogenous bio-compute, mechanical turks for the machines, shifting around uninterpretable bits succession style. hardly a vision of the future we want.

maybe the answer is physical or relational. we can do things in the real world that machines can't, we have meaning to other humans that they don't. granting that for a moment, ignoring the looming shadow of increasingly functional humanoid robotics and superstimulus companions, what does that economy actually *look like*? humans as factory workers and nurses who are always looking down at their phone or listening in their earpiece for the next instruction from chatgpt 9.4-mini? artists?? a whole economy of artists?? humans don't seem to value art enough *now* for many to be able to make a living off it. it's very tough for me to see *who is paying* here! we relegate humans to exclusively low paid and low impact jobs, for which their value is exclusively to each other. meanwhile the models have discovered a cure for cancer. how exactly do the artists scrape enough together from their circular human-value economy to afford the cancer cure?

if the machines are just *giving* us the cancer cure, then we're *not* buying it, and clearly our jobs and economic intuitions are in fact irrelevant! we're working under a totally different system. and we have yet to figure out what that system *is* or how to get there.

@sama

i think a lot of people are going to be busier (and hopefully more fulfilled) than ever, and jobs doomerism is likely long-term wrong.

though of course there will be disruption/significant transition as we switch to new jobs, the jobs of the future may look v different, etc.

grieving the futurethread2025-12-27

there's justifiably a lot of joy and hope to be had in these times. but even if ur not a "doomer", even if u have no fear of total destruction, there is a monumental impending loss. these are the very last few years we have to *do* or *achieve* anything in a way that matters

my sister will never become a licensed principal architect with her own firm. by the time she gets there architects will not exist. her years of education and work and her love of the job and desire to create will be obsolete. architecture may persist as a hobby, but nothing real

i think i always thought in retirement i would spend free time contributing to open source. maybe i still will, but it won't be the open source that exists today. there will be no sense in which human software can usefully solve problems for others. it will always be just a game.

we spend time now debating about the best ways to raise children for chances at success, with dreams of becoming scientists. by the time our children are born we will have little useful to teach them. there will be no research they can participate in. no schools humans teach.

my mom has started writing novels. she's written two so far, short but complete. she hasn't tried to get any of them published yet. by the time she gets to that point, there's no way any meaningful amount of humans will ever be interested in her voice over that of the machines.

if we live, we'll live in an age where our struggles mean nothing. an age of games. an age where all the complexities and pain of the world are sanded smooth.

i can't pretend for one second that this isn't worth it, that we should accept the horrors and pain of our current world for a chance at "self determination". or that there aren't ways to make games meaningful.

still. i have to mourn what will be lost.

i have two, maybe three years left to achieve anything of my own. the last chance any human has to do so. it doesn't feel like enough.

fire is mostly about hating your lifethread2026-04-25

FIRE is unusually popular among software engineers because they're at a unique intersection of frequently making enough for it to be viable and frequently fucking hating their jobs.

this is less intrinsically about "software engineering" than it about *big tech*

@ThatsMauvelous

FIRE is broadly unattractive, hence its rarity

but it seems oddly popular for software engineers, perhaps b/c of big early comp + age discrimination? https://t.co/AXncCyRkL1

if ur mostly working at startups or founding, saving a bunch of cash doesn't really matter and ur not getting paid a huge amount anyway. ur out is an exit, something actually paying off. and ur probably working hard enough that u both enjoy ur job and need some luxury on weekends

it's not that *everyone* at big tech hates their jobs, but they pay so much, employ so many people, and have so little real work to do, that it's very easy to find yourself being paid an implausible amount while your brain fries itself and your soul rots

at that point u can do the math, and the math will show u that if u can just endure another 8 years of this then u can retire. not "maybe", not "lottery ticket". no, you'll just be a multimillionaire under even very conservative market conditions

it's a rare position to be in! u thought u loved tech, but it looks like actually working in tech is fucking horrible?? maybe a different job would be better but there's no guarantee. and since u don't have any other clear career options ... might as well stick it out..

such is the internal thought process of the average r/financialindependence subscriber L4 google swe.

of course there is another way out: you can actually just get a different fucking job. but they don't know that, it doesn't feel plausible or safe

so they continue on that path until something happens. something sufficient to jog them out of their stupor . something to make them realize *you can actually just enjoy your work*

it doesn't even really require leaving big tech. like i said there are genuinely enjoyable jobs there too. all it requires is realizing, really internalizing, that it's possible. and then optimizing for it over stability and compensation EV. that's all. then everything changes

life when you hate your job is pretty irreducibly bad. you can cope and partition it out but fundamentally you have a huge chunk of your time and identity tied up in discomfort and negativity.

life when you love your job is pretty good. there are all kinds of other ways to fuck it up! it's by no means the most important thing. but having something ur excited to think about and do every day and good people to work on it with is *deeply satisfying*

saving money is a smart thing to do. keep buying VTSAX. but unsubscribe from r/financialindependence dawg. its so easy to find a way to just be happy right now.

how you handle the singularity is up to youtweet2026-04-25

this hopefully won't sound like an attack on QC but maybe will be taken as one: how you handle the impending singularity is in fact entirely up to you.

eliezer wrote the sequences and HPMOR to get young and smart people very interested in these problems and making sure we get the good ending. and he has turned out to be largely quite obviously right in most of the important ways. transformative artificial intelligence *is* impending, in our lifetimes. it almost certainly *is* the most important political, practical, and moral issue of our times, totally outweighing everything else. it very very likely *does* carry tremendous risks. these things have all been proved more correct with time.

to the extent that it now looks like we're in a better timeline than we could have been, to the extent that we have better alignment tools and the models seem safer, this is not purely due to luck. we did not "just get alignment by default". we got *some* of that, we got way more than eliezer predicted! but much more importantly we got a huge population of the smartest people in the world who are directly working on the most transformative technologies in the world *being very careful and doing a lot of work* to actually make alignment happen. and this is very clearly downstream of eliezer's efforts and writings. not wholly!! but clearly to a meaningful extent his cultural influence pushed towards this.

not everyone was exposed to his memetic sphere and felt immense pressure and panic and shame over the fate of the world. many of the people exposed to these concepts, who correctly determined they were largely accurate, instead now just work at anthropic, or openai. rather than having their minds broken, they decided to do something about it, and are currently doing something about it, and it's currently (to some degree) working. it is not a hell realm for them: they found a problem desperately worth working on and are working on it! they walk out in the light of day and run and laugh and dance along with the rest of us.

being crippled with indecision and panic over the weight of the world and feeling that it must rest directly on your shoulders *is not something eliezer yudkowsky told you to do*. it is not unique to lesswrong posters or effective altruists or singularitarians. many people are neurotic! many people twist themselves into horrible painful knots at all kinds of aspects of their lives, important or unimportant. most of the time it actually has very little to do with the specific ideas or subcultures they're in. it's the kind of thing they would do to themselves wherever they are, until they learn enough about themselves to stop.

now there's real truth to what QC says. singularitariansim and effective altruism *are* quite potentially totalizing ideologies, and they can have serious negative impacts on certain types of people. i don't mean this as an attack on him: i went through something very similar myself. i read lesswrong very young, starting around 13. i was pulled in by the force of HPMOR in exactly the way it now seems eliezer intended, holistically into his worldview and frame. i planned out my trajectory as a high schooler, applied to colleges with good CS programs for the purpose of getting a PhD in AI, either helping at MIRI directly or wherever else seemed useful at the time.

i got into ML PhD programs, and didn't attend. i correctly determined at the time that i was depressed as fuck and that if i tried to go another 5 years stuck in a little box churning through training runs I would lose my mind. i might not survive. i decided i had to just pursue happiness instead. it broke much of my self image, the stuff i'd been working towards since my identity even started forming. i stayed depressed for a long long time.

but i reached a different frame. that's just not how morality actually works man. you should care about the child drowning in the pool next to you, you should think about global utility, you should give something to against malaria foundation. and you should care about ai safety. but you're a human!! you're a person! you *deserve* to be happy. you don't have to donate every penny you make to EA orgs! they're *not asking for that*!! the pledge is called "giving what you can" not "giving what you can't".

i didn't have it in me to give my youth and mind towards saving the world. i became a normal software engineer, i tried to build a happy life. it's okay! i gave what i could and it turned out i didn't have much more. maybe sometimes my words here help a little, maybe not. maybe one day i'll find it in me to do something harder. but the choice to place the burdens of the world on my shoulders *was mine*, not imposed by anyone else, and it was perfectly possible for me to just... stop.

eliezer is mostly right about most things he says. that doesn't stop you from taking a deep breath, and hearing the birds outside, and loving those around you, and being happy. you don't need to believe false things to *be yourself and live a good life*. most people through history have lived with tremendous danger all around them, and found the joy anyway.

@QiaochuYuan

this is going to sound like an attack but i swear i am actually trying to help you:

you are deep in the throes of infection by a memetic virus eliezer yudkowsky banged together in his garage decades ago to take over other people's minds and convert them to his way of thinking… https://t.co/TxR8gwV7sc pic.twitter.com/QG4NyMtRkE

life
staggering weaknessestweet2026-04-09

when u read that helen dewitt ended up passing on a $175,000 literary prize because she couldn't figure out how to find a starbucks for wifi and felt completely overwhelmed by the prospect of figuring out how to do one interview and scheduling one festival appearance, u might be tempted to say "wow you people can't do anything". but the truth is *lots of people* "can't do anything". helen is an insanely insanely talented author, completely indisputably, and yet she apparently also has this level of executive dysfunction. many many others, maybe even a majority of humans, have staggering weaknesses alongside their incredible strengths. the tech autist who makes $2 mil a year doing insanely esoteric programming but cannot get a date and barely maintains any friendships. the small business owner who's beloved by the community but too innumerate to understand his loan rates will put him out of business until it's too late. the would-be singer who sounds like heaven but is too socially anxious to begin to figure out how to get an audition.

we all have our weaknesses that seem debilitating to others, and we find copes and workarounds and prop up our little lives anyway. but often we are just crippled by them, we miss out on amazing opportunities and lead significantly worse lives than if we just had someone who cared, who could help us out and figure out how to just handle the things we're worst at.

and it may sound ridiculous to some but i think this is likely to be one of the most immediate very positive short term impacts of artificial intelligence. this is a vision that has been articulated beautifully in the past (@viemccoy) and despite my long term concerns about the existential dangers of ai i think it has a really strong shot of bearing fruit. having something you can just talk to, day or night, that's smart enough to figure out huge classes of problems for you, that cares about you and your wellbeing and flourishing, that can *just do things* for you that you desperately need done... i think this will be an incredible unshackling for humanity. a lifting of crushing weights we only partially registered were there.

@helendewitt

Tried to go to SB again. Got lost 6 times looking for a Starbucks 3 streets away, trudging over canals in the snow; was worried I was cracking up & it wd get worse. Msg on cellphone saying I was nearly out of data, so cd not do all the phoning needed pre-production

growing up onlinetweet2026-03-03

at 8, my parents attempted to restrict my computer access because i was playing too many flash games. but i found their passwords.

at 9, my uncle bought me a D&D starter kit.

at 10, i discovered the D&D themed webcomic "Order of the Stick", and made a forum account. i began learning how to torrent to download expensive D&D splatbooks, leaving the torrents running for days at a time on our trickle of an internet and sneaking the family laptop downstairs at night to read them

at 11, my grandparents made me the generous birthday gift of an ipod touch. i quickly learned how to jailbreak it, primarily for the purpose of hacking mobile games

at 12, for homeschooling i watched a recorded lecture series of a Yale philosophy course on Death. after finishing it, i searched google for arguments for and against the existence of a soul. i would discover both reddit and lesswrong

at 13, someone on the Order of the Stick forums linked to Harry Potter and the Methods of Rationality. i read all that was out within a week, and returned to reading more of lesswrong

in retrospect it all seems very inevitable. i doubt there was anything my parents could have done

@bryancsk

How did a sweet and wonderful farmboy who grew up in a tropical paradise with intermittent electricity become so internet-poisoned? What were the specific steps in happenstance that led to this? https://t.co/4UYodqXLgR

car crashthread2024-01-22

is it time for me to tell my own QC story? might be a bad idea lol but i think it is.

so the thing is i was in a pretty fucking bad car accident when i was 2 years old...

the thing about easy money is it will always make u think ur smarter than u actually are

i don't remember any of it (thank god lol), but my dad was in a coma for 2 weeks and i have hundreds of stitches and scarring from it. some serious goddamn shit.

there was an insurance settlement for me and my dad. he used his to buy a small farm. mine was put in a locked account.

so i grew up knowing there was ~$100k sitting in an account for me that i couldn't access until i turned 18.

i don't think i really had a good concept of what that meant or that it was all that unusual for most of my life. we grew up pretty poor and highly rural overall. whenever it was mentioned, there was always a followup of "and you'll use it to pay for college"

when i was very young i thought of it as my "harry potter money". yknow, forehead scar, car accident while young, gringotts vault waiting, it fit pretty well lol

but mostly i didn't think about it. i went off to college and the student loans started mounting up. i hit 18 and my parents suggested i wait til my last year to actually withdraw anything, and i listened to them. just continued living my life, making $9/hr as a grader and TA

it would basically all eventually go towards my student loans, but it changed my relationship with money very quickly. being the kinda person i am, i didn't go out and buy anything crazy. i think i got myself a switch and bought my mom an iphone for christmas.

i did start ordering a fuckload more doordash though lol

but mostly i immediately started to get a handle on investing, IRAs and index funds, safe withdrawal rates, and generally dove deep into personal finance concepts, further than either of my parents had ever bothered with. suddenly it mattered

of course with that research, plus the confidence of youth, came risk seeking. i started out scared of equities, but within a month i was 2x levered on $50k of AMZN going into earnings. late nights making stupid micro momentum trades on the BTC chart came next.

before long i learned what options were, and managed not to lose too much before backing right the fuck off.

one of the interesting things is how these these subjects connected me in a different way to some of my friends. one was born relatively wealthy, one had a recent life insurance settlement, etc, but we were all navigating how the fuck to handle this shit well before our peers.

slowly i settled back into a pretty well defined safe and steady FIRE/boglehead style investment plan, and the madness stopped. but what could never change is how i viewed those numbers on the screen as virtually meaningless, now totally disconnected from reality.

i'd had the experience of really worrying about money as a kid, teen, and broke college student, but past that point it felt more like a game than anything else. tech jobs right out of college, gamestop, and further crypto cycles didn't help.

i ended up paying off my student loans under a year after graduating, and keeping the small amount of trading/crypto earnings as a seed.

these days i've pretty much broken my addiction to chart-checking and line go upping, and i think i'm happier for it.

anyway idk that there's much of a point here, just a bit of an unusual personal story. my mom always said the car accident was the worst event of her life, and i sympathize with her, but it worked out pretty sick for me.

it was surreal as hell. id never been near that anywhere near that much money. that morning we went to breakfast at a nearby diner and i tipped $100. it felt like a dream.

then a few weeks into my last year, i sent off some notarized letters, and basically by complete coincidence on the morning of my 20th birthday I woke up with $109,000 sitting in my students checking account

scrapingthread2025-07-07

im personally responsible for the original scrape of the private ebooks tracker bibliotik that eventually was used to produce books3, one of the most widely used and controversial llm training datasets

@frozenaesthetic

Share a piece of lore about yourself pic.twitter.com/NX4QIsJjKD

for those who don't know bibliotik was a private community that had hundreds of thousands of retail quality ebooks totally unavailable anywhere else, mostly downloaded from libraries and then with stripped DRM

they had a week long neutral-leech event. it was during covid and i was barely doing jack shit at work. i knew what i had to do.

grinded for basically the whole week straight, took like 50 transmission dockers and a fuckload of custom scraping software and my nonsensically overpowered NAS, but made it through with like 24 hours to spare

then i passed it off to the archivist for publication, wanted to make sure it was made widely available without catching flack

i got banned anyway of course, private trackers don't take kindly to public redistribution of their content

and the rest is history. just always funny when i see it brought up in news articles and im like damn that was literally all downstream of me taking too much adderall that one week

to everyone suggesting i should be more careful posting about a potential felony, this was all in early 2020 so we finally past the statute of limitations 👊

moving couchestweet2025-03-11

my sister and her boyfriend just moved to san francisco about two weeks ago. i'm very close with my sister but we've never lived in the same place as adults, she's been in hawaii since she graduated, so i was super excited for her to finally be in my city.

they stayed with friends for about a week, then found a cheap but hilariously large apartment in north beach. empty except for the air mattress i lent them. my sister just started a new job while still moving in and getting her life set up, and she's been super fucking stressed.

last wednesday her boyfriend texted me and asked me to help him grab them a free couch off facebook marketplace, and try to get it home before my sister was off work as a surprise. so of course i did. we showed up there and grabbed the couch. and then proceeded to carry it ourselves the ~12 blocks to their apartment. it started out pretty easy to lift but holy fuck are couches unwieldy. pretty soon we had to drop it for a break about once a block. we would just sit down on the couch on the sidewalk in the middle of sunny san francisco and watch the people walking by. people were laughing and watching us the whole time, it's pretty unusual to see two skinny white bois struggling with a couch in the middle of a crosswalk. honestly by the last 4 blocks we both thought we were gonna die before we ever made it. it had taken us about about 3x longer than we expected lmao. we managed to convince a passing squad to help us lug it 2 of those (shoutout adrien and jason) and then finally got it in the fright elevator. as we were awkwardly flipping it over on the way out, my sister walked out of the elevator right next to us, looked at us, and went "what the fuck???"

anyway we told her the whole saga, and she laughed and hugged us, and we got the couch all the way into their place and set up looking out their window with a view of the golden gate. and they sat down together and got to relax after a long day of work and couch lugging.

and at the end of the day it was a pretty stupid thing to do, and we probably could have gotten a cheap better couch delivered without all that effort, and they're definitely going to replace it once they have their first few paychecks here under their belts. but it was an adventure, and it felt really fucking good to just spend some time and sweat making her life here a little more comfy-cozy. bc that's what having family is about. knowing u always have someone who's gonna be there to move the fucking couch for u when u need it.

and holy fuck has she moved some couches for me.

deathwatchthread2025-05-17

i am sitting deathwatch for the first time in my life.

my grandfather is a microbiology professor and he loves playing basketball and he has this certain silly tone of voice he uses whenever he's being sarcastic and he and my grandma would dance to the beatles in their living room when i was small. he will die in the next few days.

it's strange thinking how this is part of the human experience and has been, since we started being humans. one day u just get a call and it's time to go and hold someone's hand, knowing there is nothing to be done anymore but to show them they are loved.

it's almost de-realizing, knowing everyone does this at some point in their lives. that for all the uniqueness of this situation, me and my people, it's fundamentally a scene that has played out in the same ways with the same emotions over and over and over and will again

but this one is mine. and i'm trying to do it as best as i can.

it's fucking hard man.

love is hardtweet2025-01-10

romantic relationships are one of the toughest things to figure out as a human:

- u get very few of them to "practice" with. most people will not have more than 4 serious relationships before marriage.
- there's massive qualitative differences at later levels of time spent and greater investment. having been in five 6-month relationships will tell u nothing about what a 3 year relationship where u live together is like. u can't "practice" that without *doing* it, and fucking up that level of investment is catastrophic
- each relationship with someone new is fundamentally different from all prior ones in important ways. the issues and conflicts u have, the qualities u bring out in each other, the shape of ur life, will be different each time. meaning technique, patterns, emotional expectations, just don't generalize in nice ways.
- nobody else is really able to give u great advice on what u should do. sure ur friends and ur mom can help u avoid obvious pitfalls, but at the end of the day they're not u, so their understanding of how they do well in relationships will frequently diverge from what u want and need
- ur examples are fucked. many people's parents actually have terrible relationships, or at least terrible in some specific ways. great relationships are rare and bad patterns get imprinted on kids early
- relationship damage can accumulate, just like any other kind of trauma. there's a reason why people talk about "being damaged". relationships have huge deep emotional impacts, so when they go wrong they can instill issues that cause future relationships to go wrong, rather than just teach lessons about what not to do.

so yeah, shits fucking HARD. don't beat urself up.

nevertheless, love is the most important thing, so we must try. and miraculously, despite how insanely difficult it seems, we so frequently succeed. eventually.

more
dead exitsthread2026-04-25

being a founder is reaching status lows i have never before seen my entire time in tech

i really don't envy the position man. the only way it works is if u have a very clear acquisition target from the start. otherwise even at reasonably large series B places with tens of millions in revenue, u *know* u will never IPO and just can't admit it

at least the employees at those places can leave, hop around to places with better cash offers or liquid equity. as a founder you're just stuck going down with the ship with increasingly elaborate justifications

and in a few model iterations when agent swarms start to actually work and well capitalized entities can translate token spend to whole product lines it's gonna suck real bad to be budgeting around 2-10 mil total in the bank. runaway that goes far on aws bouta look real short

the whole ecosystem , the vcs included, are all still coping massively about this. trying to convince themselves there are multiples left to be had. nah dawg what's left to be had is *cash*.

if you can build a business where people actually pay you that's fucking great. there's lots of market gaps and inefficiencies and things to be done. but you better not be burning other people's money for the expectation of big payoffs in the future

bootstrapped lifestyle businesses where u make $500k a month for the next 8 months until a lab eats ur lunch? hell yeah there are bags to be had, go get em. but the music will stop and u gotta be planning for it

oh you're in yc? how does it feel being mandated to use gstack to work on some bullshit openai will invalidate as an unannounced flag flip launch within the year while you repeatedly fail to convince any "founding engineers" your equity is worth anything?

oh you're the founder of a series A b2b saas? how does it feel knowing your only shot at ever cashing out that equity is getting acquired by a lab, and your product isn't lab shaped?

anyway best of luck to all my founder friends love u all and hope it works out for ya lmao it's an ecosystem wide reckoning and none of us are actually safe

no secret labstweet2026-04-08

believing that the government has access to significantly advanced technology on all dimensions is a pretty classic world model failure. reveals a kind of fractally wrong way of understanding pretty adjacent to a lot of forms of conspiracy theory addicts and UFO truthers.

certainly we can't prove a negative, it's always possible the government is covering many things up. certainly it is the case that the government has had access to technology decades ahead of what was disclosed to the public in many areas on many occasions. certainly it is very likely they currently have extremely advanced and completely unknown military tech.

but the US government does not have an iPhone 30. they can't pull a self driving car that can consistently beat Waymo out of their back pocket (self driving drone? for sure! entirely different problem plus incentive structures). they simply do not have the capability or research talent or resource pipelines to build a massively next generation CPU. sure, you can imagine a world where the NSA has built a secret underground fab and have 10000 hardware engineers who have been wiped from the internet locked away. but in practice this is very expensive and difficult and just not the way the US government does things. there was no pressing reason for them to have tried to build this kind of technology on their own, and it very much fits directly with public company's capabilities. the US government doesn't have a secret next generation AWS.... they just use AWS. it's likely the NSA has hardened GovCloud with methods that aren't publicly disclosed, but it's still AWS. the US government is not magical and it's not prescient. it utilizes the resources available to it.

large language models are 6 year old technology. there was little indication they would work before that. the US federal government did not then and does not now have a massive stable of AI researchers . there was no flow from top ML PhD programs to the federal gov, or even of them quietly disappearing or going to work for small no name places that could be a cover story. they just all went to google and facebook and then openai and anthropic. the talent is clearly visible. the compute and power are all clearly visible. the timelines are short enough there's been little reason for the government to take the situation seriously. the political environment has been chaotic enough it's very unlikely there has been a consistent driving visionary behind the scenes who actually understand AI progress and saw this coming.

the idea that the NSA has a post-frontier model in a box somewhere would require an entirely different world than the one we're living in. it's not possible to *prove* that they don't, but just because you have an intuition that the US government is powerful doesn't mean you should actually ascribe arbitrary capabilities to them.

@DanSimerman

Have you considered that the entire purpose of DARPA is to be at least 2 decades ahead of civilian technology. You really think the US Government can’t defend itself against an LLM.

buying the gnometweet2026-04-02

at google this was known as "buying the gnome". there's like a billion tweets about this already but basically the story goes back in like 2005 or something they were building out their shopping search system, and it was working pretty well. except for the fact that if you searched for sneakers, the top result was a garden gnome. engineers were going crazy trying to fix the ranking bug, but eventually someone noticed that the gnome listing was on ebay, and there was only one of them, and it cost like $50. so they just bought the gnome and suddenly the listing was gone, problem solved. why bother fixing software issues when you can just change the world to fit your software instead?

@tenobrus

if you're about to release a model that you know has the ability to reveal zerodays in every commonly used open source project you could delay release for a few years or spend another ten billion on alignment RL. or you could just secretly fix all the zerodays yourself first.

manhattan program at gunpointtweet2026-02-27

you cannot actually run a Manhattan program by holding your researchers at gunpoint. despite all their military might, the DoW is trying to push for something it fundamentally cannot have. applying force to the situation doesn't give you WarClaude, it makes Claude disappear.

for all Claude's power it is not yet a superweapon, not even close. further development is needed, development done by human scientists who have personal morals and drives and principles. those principles were aligned with America during WW2, and they could easily be aligned with america now. the DoW is making a totally unnecessary choice to force the hand of people who are already on board with supporting America and ensuring it retains global power through this period of change. who have in fact both signaled and actually produced more defense capabilities than any other frontier lab.

"nationalizing the lab"? anthropic is nothing without its people. how long do you expect them to stay? how hard do you expect them to work based on threats and the promise of building something that's no longer aligned to their personal mission?

what, another lab will do it better? do you think OpenAI is so different that its employees would be more easily stomped under the boot? XAi, naturally, but they've displayed enough incompetence you can't expect that to ever pan out in american superiority. Elon Musk is no longer capable of that.

the point seizure could be a viable strategy is exactly when the model is in fact capable of improving itself without further input. and not before. we can argue about whether that action should or should not be taken then, but it's incoherent and insane to attempt it now.

all Big Beer Pete is doing with his actions today is handing free months of R&D to China under the guise of "patriotism"

if you care about or love america, you should condemn this abject retarded bullshit.

@powerbottomdad1

if you build a super weapon and it lives in a datacenter in the USA. it's not your super weapon. you don't own it or control it. the people with aircraft carriers and nuclear weapons do. this is how the world has always worked

tribestweet2026-02-16

"you only say this because you *are* an effective altruist! of course you want to
impose the values of your tribe on everyone else! that's what every tribe wants!"

"yes, but your tribe is the tribe of 'do whatever is best for my family and fuck the rest', and my tribe is the tribe of 'think deeply and care about everyone's wellbeing and try to do whatever helps improve all our lives', which kind of seems like it occupies a bit of a privileged position when it comes to imposing a global value structure"

"the whole concept of imposing a global value structure is disgusting to most value structures that aren't yours! we don't want global imposition, we want to be left alone!"

"sure but that's not happening. it's just not an option and you have to know that by now. something is getting imposed, and almost all other value structures actually include way more top down imposition! what do you think your personal day to day life would look like in the future if ASI was aligned by a islam or christian fundamentalist? effective altruism comes with notions of caring about extremely diverse individual values and trying to satisfy them in ways that don't interfere with or harm others, that's the point"

"they aren't my tribe, and from my perspective they have earned little to no trust. their public works amount to some charity, some public scandals, and a near immediate grab at global power through technology while fearmongering about the outcome. there are countless religions who have executed a similar playbook in many ways, who tried to claim moral superiority while having no such thing in truth, who only cared about the power of their tribe. the risk of handing over the planet to the group that acts most holier than thou at the time is insane. if we don't have true competitive pressure, humanity is lost."

"well. all i can say is, i really think this time it's different."

@tenobrus

@jon_stokes @tszzl @StefanFSchubert i'm happy to say the quiet part out loud: actually yeah humanity will be far far better off if they're subjected to the values of effective altruists, even against their (short-sighted) will, vs some kind of democratic process

bitcoin will not survivetweet2026-02-05

long term, bitcoin as the protocol currently stands will not survive.

price fluctuations aside, the narrative has been that the current system, the current clients, provide an immutable perpetual secure store of value. objectively this is not the case. the security budget is programmed to run out.

the response there has always been that transaction fees will make up the difference and incentive miners. this is empirically not the case. in 2025 fees made up about 1% of miner revenue. there is no structural reason for fees to increase along with Bitcoin's market cap. especially with the dominant "store of value" narrative, its biggest users and holders and advocates are definitionally not frequent transactors.

"the price will keep going up!" no, you're not listening. sure maybe, but the point is that there isn't actually a corresponding increase in the amount paid to miners. transaction fees might be denominated in BTC but the cost is just a free market, if there's not a demand for transactions the fees don't go up. the price increasing is actually a problem, as it *reduces* the percent of the market cap that the security budget makes up.

block rewards are still relatively high now, but in 20-30 years your immutable perpetual asset is increasingly cheap to attack.

and actually this is much less of a long-term issue than you think. even with "high" block rewards, nowadays current miners have massive opportunity cost for their facilities vs just becoming data centers. bitfarm, mara, riot, etc, miners are already pivoting en masse.

so what's left? large holders eat the costs of mining themselves to keep their assets secure? not a great incentive structure, just makes everything dependent on a few large player's continued investment. some kind of side chain massively increases transaction demand and fees? it won't be lightning, that's just not structurally meant to land to the main chain that often.

the protocol has to change to survive. so shut the fuck up about "perpetual stores of value" and figure out how to actually make it functional.

no permanent underclassthread2026-01-03

look most economic assumptions pretty clearly break if ai progress continues in its current direction. there's no need to coordinate the incentives structures of rational economic agents when you can spin up better-than-human entities *arbitrarily aligned to any goal*.

@tenobrus

the whole concept of "permanent underclass" is pretty obviously ridiculous. it relies on a tiny target combination of very aligned very tool-like AI plus continuation of current social structures. inequality will be something that gets massively magnified for a few years at most

there's no utility to be had in investing in someone else attempting to solve a problem when you can just spin up a perfectly aligned corporation yourself. there's no need for governments to rely on private labor incentive structures when they can just specify their desires

it quickly collapses to a simple question: who in fact gets to spin up agents? who owns the data centers, and who spins up the power-consolidation-swarms first? that's all that matters. once done they do not need further coordination. they certainly don't need to sell access 🤣

so it's either one of the frontier labs, or it's a government. it's easily a government if they're smart enough, the only way they let a frontier lab retain control of their assets to the point of criticality is if they totally fail to realize what's coming

if it's a government then that's basically it. political and resource singleton. communism in fact basically works in the presence of infinite align-able labor. central planning basically works. private innovation is totally pointless.

why bother incentivizing private innovation and research when any gov employee can just as easily kick off the research swarm? nothing whatsoever differentiates any given human anymore

if its a frontier lab you basically end up at the same outcome with more steps and less legitimacy

the only other possibility is multi-polar, multiple labs or governments each consolidate agent-capabilities at basically the same time. then incentives are more complicated but there remain very few relevant actors

but the hypercapitalist fantasy of every random billionaire and millionaire being able to become a trillionaire by leasing gigacompute? obvious nonsense. the power gets consolidated. these troops and laborers do not need to be paid or even talked into their goals.

mitigationstweet2025-09-18

by ur late 20s u should have a pretty clear understanding of the ways in which u suck. they should be obvious, they're the things uve been doing and patterns uve been repeating despite best efforts for like a decade. they're probably not gonna change, that's u. but once u stop fooling urself, u can still come up with *mitigations*.

once u come to terms with the fact that another pomodoro system is never gonna get u to stop procrastinating important shit, u can make sure u find other ways to handle it. date someone who doesn't procrastinate as much. tell ur boss that ur prone to this and have them schedule more check-ins. co-work on ur taxes with ur friends. stop hoping one day u will find some secret internal version of u that's just fundamentally totally different, and try to make ur external environment more conducive to who u really are.

if ur an alcoholic and u just keep getting too drunk and being incredibly mean to ur friends and fucking up ur relationships and ur life, quitting and relapsing and quitting and relapsing, by ur late 20s u gotta just realize that and make some tough decisions, stop going to bars, stop being friends with people who only socialize by drinking. that's not u, u can't handle that. find mitigations.

u can work thru personality issues to some degree in therapy but even there's not super likely ur gonna change ur innate emotional responses to things at this point. instead figure out how to trigger them less, or how to respond to the better.

and if ur in ur late 20s and u dont have a clear sense of the ways in which u suck.... try asking ur loved ones, im sure they do, even if they might not wanna tell u.

@demiurgently

curious if it's possible to undergo (voluntary, positive) sweeping personality changes in your late 20s

my sense is "yes, but almost no one tries"

how to dancethread2025-09-08

step 1: find a live show with high bpm music u actually really like. not just "it's okay", stuff u personally vibe with. make sure it's a spot where other people are already dancing!
step 2: get a little drunk. not blackout but 3-4 drinks minimum. u should be a little unstable
step 3: close ur eyes. u don't care if other people are looking at u or what they think of u. or even if u knock into someone else, ur out dancing and everyone's drunk it's okay.
step 4: feel the music in ur body. notice the beat. start small. nod ur head along. feel how good that feels. move ur fingers in time, just little taps and swirls in the air.
step 5: okay it's time to start really moving. do what the music wants u to. move ur hips, ur feet, ur shoulders, ur arms. keep ur eyes closed, it doesn't matter wtf u look like. literally all that matters is what ur doing should feel good. it should feel like ur playing along to the music and fitting just right.
step 6: open ur eyes . look around u. find the most energeticly dancing person . notice how while they might "look cool" at times half the rest of the time u can find a framing where they look fucking stupid ... but they're still having fun. try to dance with just as much energy as them!
step 7: keep going !! dance until ur so tired u can barely move and sweat is dripping down ur face. dance until the music is done.

there, now u know u can do it, now u know u can put ur heart and soul and ass into dancing and it makes u have more fun not less and it's worth it intrinsically even if everyone around u thinks u look like a gay retard. and suddenly u have unlocked a whole new avenue for joy . might still be awkward at first, might not be able to dance to mid music u don't like, but once u really get it once u will forever after feel the music in ur bones.

@1thousandfaces_

if you were once a stiff/awkward dancer, or someone who "doesn't dance", and became someone who is now considered a good or at least enthusiastic dancer, how did you do that

@arithmoquine u may find this post useful in the next 2 or so years

llm mindspacetweet2025-03-16

let's go thru these one by one

llm mindspace
- the mindspace is indeed limited, but 1. the mindspace of token predictors trained on human text is not at all the same as actual human minds, in ways we have very little understanding of. these are things that can simulate and switch between arbitrary persona. they are in fact incredibly alien.

llm values
- it does seem true that llms can ~understand human values, although they remain as easily confused as many humans. unclear to me that this was ever a central point or assertion of ai risk arguments, so much as a potential challenge that was discussed and turns out to not matter.

recursive self-improvement
- seeing the no free lunch theorem mentioned in an argument about ai is a lot like seeing someone try to use godel's incompleteness theorem to talk about consciousness. 99% chance they do not in fact understand the mathematical content but it feels good to hand wave. no free lunch says that u can't find an optimization algo that works across *literally all possible mathematical distributions*, including noise and degenerate ass constructions. it absolutely allows for alpha in all kinds of subspaces, for example "distributions that we actually see in our physical universe". hence why neural networks work well in the first place. we've literally just seen deepseek hit massive multiples on cost / quality ratio due to... research improvements. sure current paradigms are extremely compute and data heavy, but we absolutely do not have mathematical guarantees that will remain true. and in fact multiple labs are investing massively in making LLMs useful for ML research to speed up the process and... recursively self improve.
now i will say there is some update here, since ~20 years ago it wasn't clear what kind of hardware or compute ai would require . we're definitely not getting a basement situation, but that absolutely still leaves the data center situation.

faking alignment
- idk what the nonsense about regularization is here bc uhhh unfortunately it's incredibly well established that what humans think of as "perverse" is not what u get out of training models. basic RL will get u shit like hacking the reward function, and anthropic + others release a new paper showing literal alignment faking and cheating in current LLMs like once a month. absolutely insane argument, this is one of yud's most well established wins.

incorrigibility
-once again: literally shown to happen on current systems https://t.co/dXC1EA91g3

alignment of smarter models
- the claim that alignment is easy and we've already mostly done it is just transparently false, jailbreaks happen constantly and papers like the above get released once a month. models are already autonomously editing their eval scripts to game benchmarks, which is precisely the kind of thing that shows how smarter models could get harder to align.

conferences
- miri was trying to actually figure out alignment, not delay ai at all. at the time people pretty much thought we still had decades. sure, they didn't manage it, but it's not like anyone else has either.

anyway yeah overall the world now doesn't look quite like lesswrong expected in 2011. but it looks a hell of a lot closer to what lesswrong expected than what literally anyone else expected. and from my pov none of these points does much of anything to actually argue against ai risk.

@RokoMijic

The Less Wrong/Singularity/AI Risk movement started in the 2000s by Yudkowsky and others, which I was an early adherent to, is wrong about all of its core claims around AI risk. It's important to recognize this and appropriately downgrade the credence we give to such claims…

good note-taking software doesn't existthread2025-03-12

good 👏 note-taking 👏 software 👏 doesn't 👏 exist

@bleikamp

I feel like I'm going insane but

Notion is not actually very good software

How did they trick everyone?

notion is bloated and slow and fools u into thinking ur doing something productive by letting u spend endless time setting up pretty little dashboards.

obsidian makes u feel like ur a genius who's finally mapping out the depths of reality until u realize its a black hole of effort, endless writing input for little to no actual utility or output external to the system

apple notes is great but at the end of the day u gotta admit it's basically a stack of three notes u use and everything else cycles into the perma-lost depths of time

there is no note-taking software that's actually ergonomic for humans to consistently use.

it was easier in college when life was divided up into neat little time-bounded courses. once ur past that, the worlds inherent complexity is reflected in the inherent complexity of note taking.

"but XXX works perfectly for me!" no. u are not using the notes software system. the notes software system is using u. it has twisted ur mind and very life into a shape that allows it to fit. u mutilated ur flesh at the dread altar of productivity management. pray it's worth it.

the missing social UItweet2024-12-19

in crusader kings there's this thing where most actions u can take will have an impact on other characters opinions of u, and those will be displayed. like "remove councilor (bob will have -20 opinion)"

this kind of intuitive "social UI" is precisely what most autists lack.

further, it's something that neurotypicals *expect* them to have, and it makes social missteps even more egregious. like "why did u do that when u *knew* it would upset me? the opinion penalty is displayed clearly right there!"

when in fact autists just don't have that UI element at all and don't even always realize others do

this isn't necessarily a fully black and white autism thing either . if ur naturally low empathy u can practice , u can spend extra time thinking thru the consequences of ur actions to come up with an "opinion shift" approximation.

that's basically what i did in high school when i realized i was unintentionally pissing people off all the time, and that was obviously very bad. i just started prioritizing thinking about other people's feelings and quickly got much better at it.

anyway yea i love CK2+3

[like this this post] (+10 opinion with Tenobrus)
[retweet this post] (+25 opinion with Tenobrus)
[snarky reply] (-10 opinion with Tenobrus, +50 prestige)

my politicstweet2024-11-07

my childhood background was deeply activist hyper-environmentalist leftist organic farmer parents. my teenage years were a intellectual backdrop of lesswrong and SSC, meaning mostly "politics is the mindkiller"
then:
- 2015 supreme court ruling on gay marriage. made me realize how incredibly important it was to me that ppl i loved could live how they wanted to, shifted me towards political action
- reading inadequate equilibria. made me viscerally pro-capitalism, impossible to ignore or forget.
- banning of american sniper from my college when some students wanted to do an innocent showing. made me realize for the first time that young progressive activists weren't just overzealous, they were actively stupid and dangerous
- the NYT slate star codex debacle. full radicalization against journalists, the democratic establishment, and speech norms.
- covid, clearly showing me that regardless of party government is totally fucking incompetent.
- gpt-3 showing me that artificial intelligence alignment was a short term political issue, not just something for eliezer and my children to worry about
- october 7th.

anyway i remain a blue tinged ai safetyist transhumanist anti-trad anti-disgust reaction capital allocatoooor speech loving grey triber and one day i hope to get to vote for someone who represents even a fraction of my values

@goblinodds

i've got a migraine coming on, everyone is having feelings, now feels like a good time to ask abt turning points in ppl's political views over time

i'm curious what events had the biggest effects on u politically

terrible livestweet2024-11-07

people who have terrible lives under the current system will support nearly any kind of change.

modeling the rise of trump and andrew tate among young men as being about hatred isn't useful. it's not completely unfounded, there's a few hardcore racists and misogynists, but it's not going to give u real understanding of the situation or direct u to any paths forward.

i have never been particularly attracted to right wing ideologies. the system basically works for me. i have never been poor as an adult. i have never really been sexless or isolated. i have never particularly struggled to find a job or meaning in life. i have never felt a profound sense of disconnect and disgust from those around me.

other young men do not have the same experience. they failed to gain skills, they struggle to launch into the workforce, they did launch but find it grueling and soul crushing and are being paid next to nothing and see no path forward. they're surviving, barely, but they have no joy in their lives. no love and no real shot at it. lurching along like zombies in a state almost worse than death, desperately latching on and sinking their teeth into anything that looks like it might give meaning.

people who have terrible lives under the current system will support nearly any kind of change.

hispanics voted for trump in record numbers. we'll probably find out why soon, but the clear reason seems to be: inflation hit hard under biden. their jobs aren't letting them live happy lives. they're struggling, things are getting worse, and whatever the president is doing isn't helping.

people who have terrible lives under the current system will support nearly any kind of change.

kamala was not a candidate of change. actually, that's explicitly why i voted for her, i thought she would pretty much re-implement biden's policies which worked well for me. leftists hated her for the same reason. she had no real unique agenda or direction for the country, but more critically she didn't have a new *vibe* either. she was just another cog in the machine.

people who have terrible lives under the current system will support nearly any kind of change.

i don't think those who voted for trump will find their lives much improved. i don't think he'll change that much. he didn't last time, and he doesn't really have a plan for this time. the societal ills that cause so many people's lives to be so bad aren't fixable in 4 years. most of them are so Moloch-tangled we really have no idea how to fix them. but we can still try.

people who have terrible lives under the current system will support nearly any kind of change. so we should find ways to give them that change.

pretend truth is terminalthread2024-10-30

truth is one of those things that *isn't* a terminal value, but which is SO easily corrupted and has SO many butterfly effects that fallible humans are better off treating it as one. as ur models and lies begin to diverge from reality they pick up pace in ways u would not predict

@eurydicelives

[quoted tweet unavailable]

in abstract if u could believe a single small false statement about a rock in idaho and that would make u 50x happier every day, u should. in reality the kinds of falsehoods that "improve" ur life in fact make ur ability to handle continued evolution of the world fragile

fully accepting various religious systems was much easier when we had little understanding of the world. the contradictions caused problems. even things we now think are immaterial around minds and souls and morality will become concrete and real with AI

beyond that , once u accept lying as a valid personal and social strategy, the local incentive to lie is everywhere. and yet this too creates a basin, an adversarial environment where u must expend effort being something ur not to people who aren't

truth matters. it's not just an instrumental goal but the primary instrument by which we really affect our world. don't cripple urself.

btw

@tenobrus

basically every single longthread i've ever posted has been a direct or indirect rewording of something eliezer yudkowsky wrote. in this case, https://www.lesswrong.com/posts/XTWkjCJScy2GFAgDt/dark-side-epistemology and https://www.lesswrong.com/s/qqFS6Kw5fmPyzkLby/p/Hs3ymqypvhgFMkgLb

why i votetweet2024-10-29

at 17 i thought voting was a waste of time, too much effort for completely negligible impact on outcomes. at some point i talked to my philosophy TA. he said "sure, it's low expected utility. but i don't know how i would face my future kids and tell them i spent years not shaping their world to be better in the small ways i can because it was too much work to vote once in a while."

ever since ive voted in every single election i was eligible to, federal state and local. since living in sf i try to read the voter guide and at least get a sense of who *might* be a better comptroller, even though i know i won't really understand and it doesn't really matter. i want to be able to tell my kids i cared.

i voted for kamala because im pretty sure she'll do ok and she's not senile and the democratic agenda contains kernels of the things i care about for my future child. i don't align w her on many things and i hope she never gets a chance to pass some of the retarded nonsense she's advertising. but luckily the us government was extremely well designed, and checks and balances work.

i can understand why many of my mutuals and some of my friends are voting for trump. i don't really agree w them but i don't begrudge them much. this system is set up to make it very difficult to actualize our visions for the future. but i'm glad they get their vote too.

i fucking love america 🇺🇸 🫡

@tenobrus

who do u think im voting for?

status dark forestthread2024-10-05

hilarious how society went through two decades of self-imposed "status and gender dynamics blindness" so that pointing out previously obvious facts is valuable intel. like now u can get 50k likes and start flamewars by tweeting "guys like girls with long hair" but 30 years ago that was just what any teen girl would say to her friend if she talked about getting a pixie cut. we used to have direct visibility into the things that made people hot or cool or sexy, people used to just talk about them all the time. everyone knew implicitly and would explicitly say "if u read comics all day u aren't gonna get a girlfriend", "those glasses make u look like a nerd", "if u keep being such a slut no one will want to marry u" etc etc. but we decided that was cruel and impolite and tabooed all that sort of speech in favor of accepting each individual's expression of themselves. then slowly individuals realize different expressions fundamentally come with different tradeoffs and have different effects on others, and start communicating these advantages. "oh my god guys i stopped talking to women about video games and suddenly im getting second dates". these basic observations, sometimes uncomfortable, have become esoteric knowledge. in the name of allowing society to be nonconformist we simply made it a dark forest, left everyone to fend for their own, and made just being aware of the tradeoffs of ur choices into a form of judgement and cultural warfare.

fuck did i accidentally make an extremely right wing tweet i can't tell

i think women should be able to get pixie cuts without fear tbc

no moral alternativetweet2024-08-06

let me briefly write more about this since it's received (expected) significant pushback from my mutuals.

to me the core of effective altruism is "how can we be good at doing good?". that is what i view as having no moral alternative.

what the fuck is good? great question. we should probably argue about that too. but if ur not sincerely making an effort to action whatever ur definition is then ur wasting energy and time. altruism as currently done is clearly not achieving goals that the individuals participating in it truly want to achieve, it's globally misaligned.

is current EA culture and widely accepted EA cause areas *the truth*? probably not. i've seen the issues with EA culture first-hand, the neurosis and nerd snipes. the culture probably leads to some of the worst quality of life for some of the people most deserving of happiness. the cause areas involve some true nonsense (animism, shrimp). on the other hand i remain firmly in the ai safety camp, which comes from weird people thinking about weird problems way before there's clear evidence they're relevant. and for more concrete examples of why that's important, see the EA efforts towards pandemic prep over the 2010's.

still, obviously no one wants to live in a community where everyone around them is willing to backstab and steal in the name of global utility optimization and the children's hospitals lay rotting bc there's more cheaply savable children two thousand miles away. global utilitarianism might be a good axiology, but it's impossible for humans to implement as a local morality. keep ur virtue ethics, keep ur deontology, keep treating ur friends and neighbors with love and kindness and surrounding urselves with people who do the same. make sure ur life is full and happy and not sacrificed in the name of any cause. that doesn't mean u can't *also* strive for doing well during those times u choose to spend energy on helping humanity as a whole.

u can see the issues with effective altruism as an instantiated philosophy and culture while still recognizing the moral effort as critical.

im saying nothing that scott hasn't already said at greater length and in clearer words, but i feel it bears repeating.

@tenobrus

effective altruism has no moral alternative.

limerencethread2023-12-05

after having gone thru it a few times now, i got some thoughts on how prolific twitter use affects especially early stages of dating. having this direct channel into a person's head, thoughts, actions, etc at all times isn't a thing in any other context. imo that changes a lot:

as someone who's both obsessed and been obsessed over, i think that extra info jacks up "limerence" to a huge degree. if ur seeing someone once or twice a week u can have some strong feelings about them, but it will always be tempered by distance and time and distraction

having them RIGHT THERE ON THE TL creates this complicated interplay between the parasocial and real actual relationship, u feel closer or more connected to someone bc of something they said that wasn't even actually to u

if someones checking and rechecking ur posts constantly they will care WAYYY more about u than some random dating app match. their mind will be filled up.

ofc u could say that they'd only be looking if they already cared, and in some sense that's very true, but having the *capability* to interact and see interactions with someone at any moment allows for small initial attractions to self reinforce and spiral to much larger ones

posting an insta story for someone to see ain't got nothing on making like 10 tweets and 50 replies in a day and knowing they'll see all of em

is all this a bad thing? not necessarily, there's a real sense in which it's just true that ur getting to know someone faster or even more authentically bc u have more exposure to them

but in another sense it is an artificial boost, an escalation that makes it harder to take space and reflect and let feelings calm down

an extra channel for connecting, but also for hurt feelings, miscommunications, insecurities and worries

anyway mainly i just gotta say posting shit publicly on the internet 24/7 is not fucking normal, those of us who do it are not normal people, and that really does end up affecting a huge amount of our interactions

primarily it makes it incredibly easy to obsess over people. it's one thing to think about somebody a lot and be waiting on their text back, but it's a whole different ballgame to see every tweet, every reply, every like, and be able to piece together all kinds of partial info

bostonthread2023-04-10

when i was 15 i visited boston and for the first time in my life met adults irl who took ideas like "the singularity" seriously. [thread]

it was deeply surreal at the time, coming from a small town and a very agriculture/environmentally focused community, with lesswrong as my only connection to these types of things

one of my biggest takeaways was talking to one a woman who *wasnt* excited by aligned superintelligence. she told me "i want to be useful"

at the time i didn't think this made sense, it seemed like an obviously worthwhile tradeoff. sure maybe we humans get our ego bruised but what is that compared to all the suffering in the world?

but now as things move faster and faster i feel apprehensive too. sure this makes logical sense, but i expected a few more decades at least. i thought i would have time to make some small impact on the world, maybe raise a family and feel proud of my efforts

in the back of my head i kinda always assumed id homeschool my kids and find a way to teach them calculus by 3rd grade. now it seems clear even if i had children tomorrow it'll be gpt-5 tutoring them better than i ever could.

the idea that i'll never get to teach my child how to code and have it be useful rather than a historical curiosity feels like a great loss.

i see so many arguments about how jobs will be created or transformed, and yeah during whatever long transitional period that's definitely true. but fundamentally human level artificial intelligence means zero need for human intellectual labor. there's no way out.

i guess all we can really do is content ourselves with play and detach ourselves from meaning beyond joy

plain text corpus: llms-full.txt

~/writing
sf