• 0 Posts
  • 49 Comments
Joined 1 year ago
cake
Cake day: July 3rd, 2023

help-circle






  • I know this shouldnā€™t be surprising, but I still cannot believe people really bounce questions off LLMs like theyā€™re talking to a real person. https://ai.stackexchange.com/questions/47183/are-llms-unlikely-to-be-useful-to-generate-any-scientific-discovery

    I have just read this paper: Ziwei Xu, Sanjay Jain, Mohan Kankanhalli, ā€œHallucination is Inevitable: An Innate Limitation of Large Language Modelsā€, submitted on 22 Jan 2024.

    It says there is a ground truth ideal function that gives every possible true output/fact to any given input/question, and no matter how you train your model, there is always space for misapproximations coming from missing data to formulate, and the more complex the data, the larger the space for the model to hallucinate.

    Then he immediately follows up with:

    Then I started to discuss with o1. [ . . . ] It says yes.

    Then I asked o1 [ . . . ], to which o1 says yes [ . . . ]. Then it says [ . . . ].

    Then I asked o1 [ . . . ], to which it says yes too.

    Iā€™m not a teacher but I feel like my brain would explode if a student asked me to answer a question they arrived at after an LLM misled them on like 10 of their previous questions.




  • I feel like the Internet Archive is a prime target for techfashy groups. Both for the amount of culture you can destroy, and because backed up webpages often make people with an ego the size of the sun look stupid.

    Also, I canā€™t remember but didnā€™t Yudkowsky or someone else pretty plainly admit to taking a bunch of money during the FTX scandal? I swear he let slip that the funds were mostly dried up. I donā€™t think it was ever deleted, but thatā€™s the sort of thing you might want to delete and could get really angry about being backed up in the Internet Archive. I think Siskind has edited a couple articles until all the fashy points were rounded off and that could fall in a similar boat. Maybe not him specifically, but thereā€™s content like that that people would rather not be remembered and the Internet Archive falling apart would be good news to them.

    Also (again), it scares me a little that their servers are on public tours. Like itā€™d take one crazy person to do serious damage to it. I donā€™t know but Iā€™m hoping their >100PB of storage is including backups, even if itā€™s not 3-2-1. Iā€™m only mildly paranoid about it lol.







  • Every time I see these crypto games, I can only think of the online uwu pit bosses shown in that one Folding Ideas video who were driving workers to slave away for less than the minimum wage in the Phillipines. Just permanently burned-in mental imagery.

    This is a cool channel by the way. Iā€™m stealing this description from someone in the YouTube comments, but he has a creative ā€œglitchcore SFM aestheticā€ that I kind of like and his speaking cadence reminds me of Primer. His style works strangely well for ripping into NFT games. This video felt like looking into a funhouse mirror dimension where every genre of game is somehow even worse than the worst games Iā€™ve ever seen.

    Also, the Dr. Disrespect-Chewbacca mask guy doing NFT lootbox openings is something I canā€™t unsee. Thatā€™s honestly so much funnier that heā€™s still doing it after the Dr. Disrespect sexting minors scandal.