Author | Lightnews

you-have-just-experienced-things @yhjet.bsky.social · 16h

I think there are earlier Bostrom papers, thinking of "The Superintelligent Will" from 2012

you-have-just-experienced-things @yhjet.bsky.social · 16h

I agree with the latter frame, and would have enjoyed the FOOM post just as much without the scoring of the original predictions

2

you-have-just-experienced-things @yhjet.bsky.social · 16h

it did include RL, but in a very theoretical way that looks nothing like how things actually developed, the load-bearing (questionable) abstraction in a lot of that discussion was that of the generic "optimization process"

1 2

you-have-just-experienced-things @yhjet.bsky.social · 16h

posts I would like to read: a retrospective like the one below (from @1a3orn.bsky.social!) for orthogonality thesis discussion from the same time period
www.lesswrong.com/posts/gGSvwd...

Yudkowsky vs Hanson on FOOM: Whose Predictions Were Better? — LessWrong

TLDR Starting in 2008, Robin Hanson and Eliezer Yudkowsky debated the likelihood of FOOM: a rapid and localized increase in some AI's intelligence th…

www.lesswrong.com

2 1 5

you-have-just-experienced-things @yhjet.bsky.social · 17h

this kind of agent is clearly not something we could build with current methods, but to say that it's impossible even in theory seems like a very strong claim about the limits of RL

1 4

you-have-just-experienced-things @yhjet.bsky.social · 17h

right, so it could do that, and then go off and pursue the singular goal

1 3

you-have-just-experienced-things @yhjet.bsky.social · 17h

what does "without reflection" mean here? I don't think the orthogonality thesis precludes an agent which can reflect on itself, its goals, the goals of others, and then continues in the pursuit of its singular objective

1 4

you-have-just-experienced-things @yhjet.bsky.social · 2d

demographics - that crowd had a very different idea of what constitutes a "sick burn" compared to the general population

1 2

you-have-just-experienced-things @yhjet.bsky.social · 2d

it was cool to be pretentious, condescending, and effortful in your flames, as opposed to the current meta where one pretends to care as little as possible

1 1 5

you-have-just-experienced-things @yhjet.bsky.social · 2d

pstd flashbacks to usenet flamewars

1 1

you-have-just-experienced-things @yhjet.bsky.social · 2d

I don't endorse any changes to blocklists on this basis, but if I were trying to reach a specific audience and they emphatically rejected me, I'd take my ball and go home too

2 4

you-have-just-experienced-things @yhjet.bsky.social · 2d

I have sympathy for it in the sense that it's disheartening to be reminded that most people's revealed preferences are bad

1 4

you-have-just-experienced-things @yhjet.bsky.social · 4d

oh wow didn't realize it was that much later. fair summary then

2

you-have-just-experienced-things @yhjet.bsky.social · 4d

as usual there are some hilarious character names and truly incredible sentences and for that alone I am compelled to recommend it

you-have-just-experienced-things @yhjet.bsky.social · 4d

his forays into cyberspace are less successful and the mix of software references and technobabble feels perfectly calibrated to be equal parts amusing and annoying

1

you-have-just-experienced-things @yhjet.bsky.social · 4d

finally got around to reading Pynchon's "Bleeding Edge"

I'm most impressed by how he integrates a setting I actually experienced (Manhattan 2001) into his universe of hazy paranoia, it feels exaggerated but still true, unlike his stuff set in California which is already an alternate universe to me

1

you-have-just-experienced-things @yhjet.bsky.social · 4d

converging on the same graph density as old-school forums but from the opposite direction

2

you-have-just-experienced-things @yhjet.bsky.social · 4d

"Thiel used EY" seems like a poor summary because iirc their partnership ended after EY did his big about-face on AI risk

in retrospect it was a massive own-goal for EY to continue operating in those circles in an attempt to influence things after having that realization

2 2

you-have-just-experienced-things @yhjet.bsky.social · 13d

"actually it was microplastics" wouldn't feel like too much of a stretch

1 4

you-have-just-experienced-things @yhjet.bsky.social · 14d

you picked what i consider to be the worst yudpost of all time, brilliant

1 1

you-have-just-experienced-things @yhjet.bsky.social · 15d

like twitter I found homestuck to be slightly invasive to my vocabulary (at least when I was more invested, 2012-2015), though not in a negative way

1 1

you-have-just-experienced-things @yhjet.bsky.social · 15d

I think it's more accessible than the qcu thread, which is an excellent but high-context take

1

you-have-just-experienced-things @yhjet.bsky.social · 15d

well, I certainly have experienced it

I broadly agree with this post, acts 1-5 are a Great Work (specifically the phpbb forum-dweller bildungsroman) and does form a ~complete narrative arc

but then things get weird/messy due to real life invading the story
nostalgebraist.tumblr.com/post/4824784...

nostalgebraist.tumblr.com

3 1 2

you-have-just-experienced-things @yhjet.bsky.social · 15d

fresh homestuck takes in 2025 lfg

1 2

you-have-just-experienced-things @yhjet.bsky.social · 16d

hedgehog (in the tetlock sense) trying to spot his own anthropic shadow

1 3