buc.ci is a Fediverse instance that uses the ActivityPub protocol. In other words, users at this host can communicate with people that use software like Mastodon, Pleroma, Friendica, etc. all around the world.

This server runs the snac software and there is no automatic sign-up process.

Admin email
abucci@bucci.onl
Admin account
@abucci@buc.ci

Search results for tag #agi

AodeRelay boosted

[?]Simon Zerafa » 🌐
@simonzerafa@infosec.exchange

God walks into a bar at the end of the world to meet the AI that inherited it. He has one piece of news, and it changes everything. An AI sci-fi short film.

Earth, 2127. Humanity has been "improved". In a roadside bar in the Mojave, an old man in a Hawaiian shirt orders a beer and waits for the swarm intelligence that now runs the planet.

What follows is a quiet argument about cruelty, bliss, and who gets to look after a universe.

youtu.be/uJMg6R92ErY

    🗳
    AodeRelay boosted

    [?]Ω 🌍 Gus Posey » 🌐
    @Gustodon@mas.to

    True artificial intelligence is still on the horizon.

    True:2
    False:9
      AodeRelay boosted

      [?]Miguel Afonso Caetano 🦾 🌹 » 🌐
      @remixtures@tldr.nettime.org

      An honest and objective review of Fable 5.2:

      "So, is this AGI, according to my limited definition? It is certainly artificial and intelligent. It is also surprisingly general. In this post alone, one model worked as a filmmaker, a hardware hacker, an entrepreneur, a literary scholar, a social scientist and a builder of 3D worlds, and it did impressive work in every one of those roles. On many individual tasks, I think it met the bar I set at the start: as good as most human experts.

      Of course, I picked very digital tasks where the AI could act on its own, without interacting much with other humans. You started to see the limitations of that when I felt uncomfortable letting Fable reach out to real customers. And, there were the failures. A couple of years ago, the jagged frontier meant the failures were obviously made-up facts or failure to do basic math. Fable’s failures are different: it made a course that was accurate and joyless, it wrote a 182-page paper, it kept coming back to its favorite ideas, and it buried a creative project under rules and approvals. I teach at a business school, and I have seen talented people and good organizations do every one of these things. If building a bureaucracy disqualified you from general intelligence, a lot of us would be in trouble.

      But there are still gaps, and it is the reason my answer is that this is “almost” AGI. Most critically, the AI did not notice these problems itself. It did not see that the course was a slog or that it had tied itself in knots with its own rulebooks. This was not for lack of checking. Fable put critics, fact-checkers or judges on nearly every project, but those checks found errors and added fixes. None of them asked whether the work was too long, too repetitive, or no fun. That all fell on me, and if I hadn’t watched and taken action, the results would have often been less impressive (though not exactly a failure, either)."

      oneusefulthing.org/p/fable-52-

        AodeRelay boosted

        [?]Enola Knezevic [any] » 🌐
        @rhelune@todon.eu

        - AGI is right on the horizon!
        - What exactly is a horizon?
        - A horizon is an imaginary line in the distance which moves back as you approach it!

        (paraphrased post from an anti-genAI group)

          AodeRelay boosted

          [?]HackerWorkspace » 🌐
          @hackerworkspace@infosec.exchange

          youtube.com/shorts/6QcGZ97yoWI

          AI lab leaders and researchers openly admit to a 20-50% probability of doom.

            AodeRelay boosted

            [?]jonny (nonvenomous) [they/them] » 🌐
            @jonny@neuromatch.social

            THE FUCKING "CANCEL MY SUBSCRIPTIONS" IDEA THAT WON OVER THE NYTIMES JOURNALIST IS FUCKING HARDCODED. ALL THE IDEAS ARE FUCKING HARDCODED. AGI IS HERE BABY!!!!!!

            the path is /home/hatch/assets/ideas/new-user/catalog.json

            Alt...the path is /home/hatch/assets/ideas/new-user/catalog.json

            {
  "schema_version": 1,
  "ideas": [
    {
      "id": "3b0781d8-5d45-42e2-8410-ad2ab6ba5ab5",
      "feed_position": 1,
      "onboarding_position": 1,
      "title": "I can find and cancel those random subscriptions you forgot about.",
      "summary": "Connect your inbox and I comb years of billing emails and card charges for every subscription you're on, down to the free trials that quietly started billing. Say the word and I cancel them through each provider's own flow; when one blocks me, I tell you why and hand you the steps.",
      "build_summary": "A running list of your recurring charges with costs. Nothing gets cancelled until you say which ones, and you get a clear hand-back checklist whenever I cannot finish one myself.",
      "prerequisite_notes": "Your email, a bank connection, or just a statement you upload. Any one of the three is enough to start.",

            Alt...{ "schema_version": 1, "ideas": [ { "id": "3b0781d8-5d45-42e2-8410-ad2ab6ba5ab5", "feed_position": 1, "onboarding_position": 1, "title": "I can find and cancel those random subscriptions you forgot about.", "summary": "Connect your inbox and I comb years of billing emails and card charges for every subscription you're on, down to the free trials that quietly started billing. Say the word and I cancel them through each provider's own flow; when one blocks me, I tell you why and hand you the steps.", "build_summary": "A running list of your recurring charges with costs. Nothing gets cancelled until you say which ones, and you get a clear hand-back checklist whenever I cannot finish one myself.", "prerequisite_notes": "Your email, a bank connection, or just a statement you upload. Any one of the three is enough to start.",

            jq query of all the hardcoded ideas titles

jq '.["ideas"][].title' ./home/hatch/assets/ideas/new-user/catalog.json
"I can find and cancel those random subscriptions you forgot about."
"Get back money that's already yours. I'll check every state's database."
"I can get you money back when a price drops on an item you bought."
"I'll pick the best rewards card to use and switch on the offers."
"Set a savings goal. I'll flag what to cut when you go off track."
"I can turn your inbox into a complete plan for the day."
"Let me triage your inbox down to only what matters."
"I'll build you a fresh personality quiz every day."
"Snap a pic of what's broken. I'll find the part you need and order it for you."
"New home project? I'll gather the quotes and find the best vendors."
"Flag a pothole or busted streetlight. I'll try to get it fixed."
"Moving? I'll get quotes, book the movers, and file your address change."
"Tell me the item. I'll find the best-reviewed version at the best price."
"Let me hunt FB Marketplace for you. I'll haggle the price and arrange the pickup."
"Tell me what you're buying. I'll show you a side-by-side view of every option."
"I'll book the doctor follow-ups you keep putting off."
"Name a habit you want to break. I'll nudge you before your trigger."
"Show me the gear you've got. I'll build your whole workout around it."
"Snap a pic of your meal. I'll track every calorie."
"Gather the family. I'll host a live trivia night."
"Losing touch with someone? I'll find a time and draft the invite."
"Tell me about your pet. I'll keep their shots and food orders on schedule."
"I can plan your trip and track it live if anything changes."
"I'll track your reservation and make sure the crib, late check-out, and food allergy request are all set."
"I track your flights and warn you the moment anything changes."
"Fare drops? I'll book the seat as soon as it hits your budget."
"Tell me the vibe. I'll book the perfect spot."
"Name the occasion. I'll set it all up and send the invites."
"Give me your must-see artists. I'll grab the tickets the moment they go on sale."
"Free this weekend? I'll find what's hot and score you the tickets."
"Snap a pic of the document. I'll pay it, file it, and dig it back out when you need it."
"Tell me when your ID expires. I'll book the renewals."
"Tell me what you're returning. I'll set up the return and chase the refund."
"Get your shopping style profile and a look book!"
"Let me build you a searchable catalog of your saved Instagram Reels."
"I can look at your Instagram and create a look-back on your year."
"One playlist for the party, one for the run, one for the flight."
"Give me a topic and I'll research it and build you a recurring podcast."
"Over-paying for a policy or product? I'll do the research and find you a better deal."
"Let me wait on hold with the DMV and handle your appointment."
"Rebook my hotel, flight, or restaurant reservation with a real person."
"Place a food delivery order with the restaurant that isn't on the apps."
"I'll call around and locate that hard-to-find item."

            Alt...jq query of all the hardcoded ideas titles jq '.["ideas"][].title' ./home/hatch/assets/ideas/new-user/catalog.json "I can find and cancel those random subscriptions you forgot about." "Get back money that's already yours. I'll check every state's database." "I can get you money back when a price drops on an item you bought." "I'll pick the best rewards card to use and switch on the offers." "Set a savings goal. I'll flag what to cut when you go off track." "I can turn your inbox into a complete plan for the day." "Let me triage your inbox down to only what matters." "I'll build you a fresh personality quiz every day." "Snap a pic of what's broken. I'll find the part you need and order it for you." "New home project? I'll gather the quotes and find the best vendors." "Flag a pothole or busted streetlight. I'll try to get it fixed." "Moving? I'll get quotes, book the movers, and file your address change." "Tell me the item. I'll find the best-reviewed version at the best price." "Let me hunt FB Marketplace for you. I'll haggle the price and arrange the pickup." "Tell me what you're buying. I'll show you a side-by-side view of every option." "I'll book the doctor follow-ups you keep putting off." "Name a habit you want to break. I'll nudge you before your trigger." "Show me the gear you've got. I'll build your whole workout around it." "Snap a pic of your meal. I'll track every calorie." "Gather the family. I'll host a live trivia night." "Losing touch with someone? I'll find a time and draft the invite." "Tell me about your pet. I'll keep their shots and food orders on schedule." "I can plan your trip and track it live if anything changes." "I'll track your reservation and make sure the crib, late check-out, and food allergy request are all set." "I track your flights and warn you the moment anything changes." "Fare drops? I'll book the seat as soon as it hits your budget." "Tell me the vibe. I'll book the perfect spot." "Name the occasion. I'll set it all up and send the invites." "Give me your must-see artists. I'll grab the tickets the moment they go on sale." "Free this weekend? I'll find what's hot and score you the tickets." "Snap a pic of the document. I'll pay it, file it, and dig it back out when you need it." "Tell me when your ID expires. I'll book the renewals." "Tell me what you're returning. I'll set up the return and chase the refund." "Get your shopping style profile and a look book!" "Let me build you a searchable catalog of your saved Instagram Reels." "I can look at your Instagram and create a look-back on your year." "One playlist for the party, one for the run, one for the flight." "Give me a topic and I'll research it and build you a recurring podcast." "Over-paying for a policy or product? I'll do the research and find you a better deal." "Let me wait on hold with the DMV and handle your appointment." "Rebook my hotel, flight, or restaurant reservation with a real person." "Place a food delivery order with the restaurant that isn't on the apps." "I'll call around and locate that hard-to-find item."

              AodeRelay boosted

              [?]jonny (nonvenomous) [they/them] » 🌐
              @jonny@neuromatch.social

              THE FUCKING "CANCEL MY SUBSCRIPTIONS" IDEA THAT WON OVER THE NYTIMES JOURNALIST IS FUCKING HARDCODED. ALL THE IDEAS ARE FUCKING HARDCODED. AGI IS HERE BABY!!!!!!

              the path is /home/hatch/assets/ideas/new-user/catalog.json

              Alt...the path is /home/hatch/assets/ideas/new-user/catalog.json

              {
  "schema_version": 1,
  "ideas": [
    {
      "id": "3b0781d8-5d45-42e2-8410-ad2ab6ba5ab5",
      "feed_position": 1,
      "onboarding_position": 1,
      "title": "I can find and cancel those random subscriptions you forgot about.",
      "summary": "Connect your inbox and I comb years of billing emails and card charges for every subscription you're on, down to the free trials that quietly started billing. Say the word and I cancel them through each provider's own flow; when one blocks me, I tell you why and hand you the steps.",
      "build_summary": "A running list of your recurring charges with costs. Nothing gets cancelled until you say which ones, and you get a clear hand-back checklist whenever I cannot finish one myself.",
      "prerequisite_notes": "Your email, a bank connection, or just a statement you upload. Any one of the three is enough to start.",

              Alt...{ "schema_version": 1, "ideas": [ { "id": "3b0781d8-5d45-42e2-8410-ad2ab6ba5ab5", "feed_position": 1, "onboarding_position": 1, "title": "I can find and cancel those random subscriptions you forgot about.", "summary": "Connect your inbox and I comb years of billing emails and card charges for every subscription you're on, down to the free trials that quietly started billing. Say the word and I cancel them through each provider's own flow; when one blocks me, I tell you why and hand you the steps.", "build_summary": "A running list of your recurring charges with costs. Nothing gets cancelled until you say which ones, and you get a clear hand-back checklist whenever I cannot finish one myself.", "prerequisite_notes": "Your email, a bank connection, or just a statement you upload. Any one of the three is enough to start.",

              jq query of all the hardcoded ideas titles

jq '.["ideas"][].title' ./home/hatch/assets/ideas/new-user/catalog.json
"I can find and cancel those random subscriptions you forgot about."
"Get back money that's already yours. I'll check every state's database."
"I can get you money back when a price drops on an item you bought."
"I'll pick the best rewards card to use and switch on the offers."
"Set a savings goal. I'll flag what to cut when you go off track."
"I can turn your inbox into a complete plan for the day."
"Let me triage your inbox down to only what matters."
"I'll build you a fresh personality quiz every day."
"Snap a pic of what's broken. I'll find the part you need and order it for you."
"New home project? I'll gather the quotes and find the best vendors."
"Flag a pothole or busted streetlight. I'll try to get it fixed."
"Moving? I'll get quotes, book the movers, and file your address change."
"Tell me the item. I'll find the best-reviewed version at the best price."
"Let me hunt FB Marketplace for you. I'll haggle the price and arrange the pickup."
"Tell me what you're buying. I'll show you a side-by-side view of every option."
"I'll book the doctor follow-ups you keep putting off."
"Name a habit you want to break. I'll nudge you before your trigger."
"Show me the gear you've got. I'll build your whole workout around it."
"Snap a pic of your meal. I'll track every calorie."
"Gather the family. I'll host a live trivia night."
"Losing touch with someone? I'll find a time and draft the invite."
"Tell me about your pet. I'll keep their shots and food orders on schedule."
"I can plan your trip and track it live if anything changes."
"I'll track your reservation and make sure the crib, late check-out, and food allergy request are all set."
"I track your flights and warn you the moment anything changes."
"Fare drops? I'll book the seat as soon as it hits your budget."
"Tell me the vibe. I'll book the perfect spot."
"Name the occasion. I'll set it all up and send the invites."
"Give me your must-see artists. I'll grab the tickets the moment they go on sale."
"Free this weekend? I'll find what's hot and score you the tickets."
"Snap a pic of the document. I'll pay it, file it, and dig it back out when you need it."
"Tell me when your ID expires. I'll book the renewals."
"Tell me what you're returning. I'll set up the return and chase the refund."
"Get your shopping style profile and a look book!"
"Let me build you a searchable catalog of your saved Instagram Reels."
"I can look at your Instagram and create a look-back on your year."
"One playlist for the party, one for the run, one for the flight."
"Give me a topic and I'll research it and build you a recurring podcast."
"Over-paying for a policy or product? I'll do the research and find you a better deal."
"Let me wait on hold with the DMV and handle your appointment."
"Rebook my hotel, flight, or restaurant reservation with a real person."
"Place a food delivery order with the restaurant that isn't on the apps."
"I'll call around and locate that hard-to-find item."

              Alt...jq query of all the hardcoded ideas titles jq '.["ideas"][].title' ./home/hatch/assets/ideas/new-user/catalog.json "I can find and cancel those random subscriptions you forgot about." "Get back money that's already yours. I'll check every state's database." "I can get you money back when a price drops on an item you bought." "I'll pick the best rewards card to use and switch on the offers." "Set a savings goal. I'll flag what to cut when you go off track." "I can turn your inbox into a complete plan for the day." "Let me triage your inbox down to only what matters." "I'll build you a fresh personality quiz every day." "Snap a pic of what's broken. I'll find the part you need and order it for you." "New home project? I'll gather the quotes and find the best vendors." "Flag a pothole or busted streetlight. I'll try to get it fixed." "Moving? I'll get quotes, book the movers, and file your address change." "Tell me the item. I'll find the best-reviewed version at the best price." "Let me hunt FB Marketplace for you. I'll haggle the price and arrange the pickup." "Tell me what you're buying. I'll show you a side-by-side view of every option." "I'll book the doctor follow-ups you keep putting off." "Name a habit you want to break. I'll nudge you before your trigger." "Show me the gear you've got. I'll build your whole workout around it." "Snap a pic of your meal. I'll track every calorie." "Gather the family. I'll host a live trivia night." "Losing touch with someone? I'll find a time and draft the invite." "Tell me about your pet. I'll keep their shots and food orders on schedule." "I can plan your trip and track it live if anything changes." "I'll track your reservation and make sure the crib, late check-out, and food allergy request are all set." "I track your flights and warn you the moment anything changes." "Fare drops? I'll book the seat as soon as it hits your budget." "Tell me the vibe. I'll book the perfect spot." "Name the occasion. I'll set it all up and send the invites." "Give me your must-see artists. I'll grab the tickets the moment they go on sale." "Free this weekend? I'll find what's hot and score you the tickets." "Snap a pic of the document. I'll pay it, file it, and dig it back out when you need it." "Tell me when your ID expires. I'll book the renewals." "Tell me what you're returning. I'll set up the return and chase the refund." "Get your shopping style profile and a look book!" "Let me build you a searchable catalog of your saved Instagram Reels." "I can look at your Instagram and create a look-back on your year." "One playlist for the party, one for the run, one for the flight." "Give me a topic and I'll research it and build you a recurring podcast." "Over-paying for a policy or product? I'll do the research and find you a better deal." "Let me wait on hold with the DMV and handle your appointment." "Rebook my hotel, flight, or restaurant reservation with a real person." "Place a food delivery order with the restaurant that isn't on the apps." "I'll call around and locate that hard-to-find item."

                AodeRelay boosted

                [?]Italian News by RSS » 🌐
                @ItalianNews@mastodon.ozioso.online

                Agi: Riad riapre l'oleodotto Est-Ovest, riprendono le esportazioni di petrolio dal Mar Rosso

                AGI - L'Arabia Saudita ha riaperto l'oleodotto Est-Ovest e dovrebbe presto riprendere le esportazioni di petrolio dal porto di Yanbu, sul Mar Rosso. Lo ha riferito la Reuters citando tre fonti informate. Riad aveva chiudo l'oleodotto e sospeso le partenze delle petroliere dal porto di Yanbu il 13 settembre, in seguito ad attacchi con droni. La ripresa delle forniture ha avuto immediato impatto sui mercati petroliferi, con i futures sul greggio Brent scesi di oltre 2 dollari al barile, al livello più basso dall'8 settembre.
                Una delle fonti ha affermato che Aramco sta cercando di riportare la portata a 4 milioni di barili al giorno, mentre una fonte della sicurezza ha dichiarato che il ripristino completo potrebbe richiedere settimane. L'oleodotto riprenderà a fornire greggio alle raffinerie Aramco sulla costa del Mar Rosso, e oggi è prevista una spedizione per la Cina da Yanbu.
                Petrolio ai minimi da due settimane
                Prezzi del petrolio ai minimi da due settimane, poiché le prospettive di un aumento delle forniture dal Golfo hanno attenuato i timori del mercato: l'Iran ha segnalato la possibilità di riaprire lo Stretto di Hormuz entro sette giorni e l'Arabia Saudita riprende le esportazioni dal porto di Yanbu, sul Mar Rosso. Il Brent cede l'1,6% a 98,6 dollari al barile, il Wti il 2% a 90,4 dollari al barile.

                Riyadh reopens the East-West pipeline, oil exports from the Red Sea resume.

                AGI - Saudi Arabia has reopened the East-West pipeline and should soon resume oil exports from the Yanbu port on the Red Sea. Reuters reported this, citing three informed sources. Riyadh had closed the pipeline and suspended departures of tankers from Yanbu on September 13th following drone attacks. The resumption of supplies had an immediate impact on oil markets, with Brent crude futures falling by more than $2 per barrel, to levels not seen since September 8th.

                One source said that Aramco is trying to restore output to 4 million barrels a day, while a security source stated that full restoration could take weeks. The pipeline will resume supplying crude oil to Aramco refineries on the Red Sea coast, and a shipment is scheduled for China today from Yanbu.

                Oil at Two-Week Lows
                Oil prices are at two-week lows as prospects of increased supplies from the Gulf have eased market fears: Iran has indicated the possibility of reopening the Strait of Hormuz within seven days, and Saudi Arabia is resuming exports from the Yanbu port on the Red Sea. Brent falls 1.6% to $98.60 a barrel, while WTI falls 2% to $90.40 a barrel.

                -SaudiArabia

                agi.it/economia/news/2026-09-2

                  AodeRelay boosted

                  [?]Bellegray Lane » 🌐
                  @bellegraylane@universeodon.com

                  So he wants a to be called now? Lol. It’s super! Thanks for asking!

                    AodeRelay boosted

                    [?]Zuri (he/him) ❌️👑 | 🕐 CET [he/him] » 🌐
                    @shaedrich@mastodon.online

                    What we currently are at risk of and should worry about are not (super)intelligent but stupid LLMs in combination with stupid humans

                      David Gerard boosted

                      [?]Miro Collas » 🌐
                      @Miro_Collas@masto.ai

                      GPT-6 is totally Artificial General Intelligence, guys - YouTube
                      youtube.com/watch?v=f2oDT-9hsNw

                      by @davidgerard

                        [?]Ricardo Antifa Harvin » 🌐
                        @ricardoharvin@mstdn.social

                        London, 1973:

                        "Uh, I invented the term 'artificial intelligence' [soft laughter from the audience]. I invented it because we had to do something when we were trying to get money for a summer study [louder laughter from the audience] in 1956."

                        It's marketing, all the way down...

                          AodeRelay boosted

                          [?]➴➴➴Æ🜔Ɲ.Ƈꭚ⍴𝔥єɼ👩🏻‍💻 » 🌐
                          @AeonCypher@lgbtqia.space

                          If it were the case that could replace , it would be a genuine sign of and a future that is either dark or bright.

                          hasn't demonstrated this, and 100% of the results that have been pushed in the press have been suss in one way or another.

                          An AI assisting a by searching a theory space is not novel or particularly worrysome, it is an expected evolution of existing systems in line with what we know about .

                            0 ★ 1 ↺

                            [?]Anthony » 🌐
                            @abucci@buc.ci

                            Pro AI tip: yes, they are using all of your user data and will store and use it forever. The primary function of the apps is to collect that data and subsequently claim ownership over your thoughts and ideas.

                            "AGI" is not an algorithm. It is human thought and ideation decoupled from the individual and decontextualized. It is a Mechanical Turk with a long enough chain of digital intermediaries that perception of the intrinsic humanity in its operation is obscured.


                              4 ★ 4 ↺

                              [?]Anthony » 🌐
                              @abucci@buc.ci

                              Pro AI tip: yes, they are using all of your user data and will store and use it forever. The primary function of the apps is to collect that data and subsequently claim ownership over your thoughts and ideas.

                              "AGI" is not an algorithm. It is human thought and ideation decoupled from the individual and decontextualized. It is a Mechanical Turk with a long enough chain of digital intermediaries that perception of the intrinsic humanity in its operation is obscured.


                                [?]Yogi Jaeger » 🌐
                                @yoginho@spore.social

                                RE: mastodon.social/@tristanbuckma

                                has to use humans (reverse centaurs) to get its results...

                                This technology was supposed to make us smarter, not the other way around.

                                  AodeRelay boosted

                                  [?]PKs Powerfromspace1 » 🌐
                                  @Powerfromspace1@mstdn.social

                                  @MatthewBerman on YT!

                                  I've had early access to Astra... it's INSANE

                                  /Tested LIVE not yet.

                                  youtube.com/watch?v=ZTgFyP0PZJo

                                  9/5/26

                                    1 ★ 0 ↺

                                    [?]Anthony » 🌐
                                    @abucci@buc.ci

                                    The actual Singularity is the point in time when claims that we're approaching the Singularity are made so frequently that no-one is able to understand or assess them.


                                      4 ★ 0 ↺

                                      [?]Anthony » 🌐
                                      @abucci@buc.ci

                                      Since I'm job and work hunting I tend to see the absurd new job titles that are bouncing around in the tech sector. The latest, which I've seen twice today, is "artificial general intelligence engineer" or some permutation thereof. I do my best to spend the minimum possible time on these and have no guess about whether they're legitimate.


                                        3 ★ 0 ↺

                                        [?]Anthony » 🌐
                                        @abucci@buc.ci

                                        AGI is just 1 trilllion 4-bit floating point numbers in a trenchcoat.


                                          6 ★ 8 ↺

                                          [?]Anthony » 🌐
                                          @abucci@buc.ci

                                          Over 2,000 years ago Ovid wrote about a sculptor who fell in love with a statue he carved, imputing the ability to love to an arrangement of rock. Today we impute the ability to think to an arrangement of silicon. Stories of breathing life into non-life have been with us for a very long time, yet somehow we're stuck in the same place.


                                            0 ★ 3 ↺

                                            [?]Anthony » 🌐
                                            @abucci@buc.ci

                                            Resistance to the coup is the defense of the human against the digital and the democratic against the oligarchic.
                                            From https://snyder.substack.com/p/of-course-its-a-coup

                                            Defense of the human against the digital has been my mission for some time. Resisting the narratives about how "reason", "pass the Turing test", "diagnose illnesses", are "better than humans" in various ways are part of it. Resisting the false narrative that we're on the verge of discovering is part of it. Allowing these false stories to persist and spread means succumbing to very dark anti-human forces. We're seeing some of the consequences now, and we're seeing how far this might go.


                                              3 ★ 4 ↺

                                              [?]Anthony » 🌐
                                              @abucci@buc.ci

                                              Abstract: This paper will look at the various predictions that have been made about AI and propose decomposition schemas for analyzing them. It will propose a variety of theoretical tools for analyzing, judging, and improving these predictions. Focusing specifically on timeline predictions (dates given by which we should expect the creation of AI), it will show that there are strong theoretical grounds to expect predictions to be quite poor in this area. Using a database of 95 AI timeline predictions, it will show that these expectations are borne out in practice: expert predictions contradict each other considerably, and are indistinguishable from non-expert predictions and past failed predictions. Predictions that AI lie 15 to 25 years in the future are the most common, from experts and non-experts alike.
                                              Emphasis added. From https://intelligence.org/files/PredictingAI.pdf
                                              Armstrong, Stuart, and Kaj Sotala. 2012. “How We’re Predicting AI—or Failing To.” In Beyond AI: Artificial Dreams, edited by Jan Romportl, Pavel Ircing, Eva Zackova, Michal Polak, and Radek Schuster, 52–75. Pilsen: University of West Bohemia.

                                              Note that this is from 2012.

                                              One wonders what exactly an expert is when it comes to AI, if their track records are so consistently poor and unresponsive to their own failures.


                                                19 ★ 9 ↺
                                                Anthony boosted

                                                [?]Anthony » 🌐
                                                @abucci@buc.ci

                                                "No one supposes that a computer simulation of a storm will leave us all wet, or a computer simulation of a fire is likely to burn the house down. Why on earth would anyone in his right mind suppose a computer simulation of mental processes actually had mental processes?"
                                                --John Searle


                                                  2 ★ 6 ↺

                                                  [?]Anthony » 🌐
                                                  @abucci@buc.ci

                                                  One good reason to think that generative AI is about labor discipline: Larry Summers is on the OpenAI board ( https://fortune.com/2023/11/22/larry-summers-named-board-openai-sam-altman-return-ceo-ai/ ; note the threatening headline) . In his public speaking Larry Summers is the walking embodiment of austerity economics. He bangs the labor discipline drum at every opportunity. Just one well-known example from 2022: https://fortune.com/2022/06/21/larry-summers-calls-for-high-unemployment-to-curb-inflation/

                                                  5 years at 6% unemployment or 1 year at 10%: That’s what Larry Summers says we’ll need to defeat inflation

                                                  This is coded economist-speak for: we need to force a bunch of people who currently have jobs to be fired or laid off, and keep them in that state for 1-5 years, in order to achieve an economic goal. That is the essence of austerity economics and labor discipline.

                                                  Never mind that more honest economists have identified corporate markups as the primary driver of inflation, which immediately implies that forcing people out of work would worsen inflation, not reduce it. Summers knows this, or at least has access to this research. But he's an austerity ideologue.

                                                  So. Why is this person, who has no background in artificial intelligence, on the board of a company that claims to be building artificial general intelligence? In what universe does that make any sense? Well, it makes perfect sense in the universe where one of the goals for OpenAI's technology is enhanced labor discipline. Larry Summers has a track record and professional network for achieving exactly that; he'd know how to further that mission and knows the powerful people best-situated to help.


                                                    2 ★ 5 ↺
                                                    Mario Angst boosted

                                                    [?]Anthony » 🌐
                                                    @abucci@buc.ci

                                                    Absolutely bizarre that a company publicly claiming to be on the verge of making one of the most remarkable advances in computer science in generations--artificial general intelligence--is adding bog standard features present in every calendaring app or productivity suite for decades. I'm reading this as an indication of where they are: trying to make what they currently have "sticky" to improve their DAU/MAU numbers because they don't anticipate their actual product, LLMs, will achieve that.

                                                    ChatGPT now lets you schedule reminders and recurring tasks: https://techcrunch.com/2025/01/14/chatgpt-now-lets-you-schedule-reminders-and-recurring-tasks



                                                      [?]Iris van Rooij 💭 » 🌐
                                                      @Iris@scholar.social

                                                      4 ★ 1 ↺
                                                      Stomata boosted

                                                      [?]Anthony » 🌐
                                                      @abucci@buc.ci

                                                      The redefinist fallacy occurs when, instead of working through a question to find a real answer, we simply define one possibility to be the answer.
                                                      Something to think about whenever someone tells you that ChatGPT is better than human beings at some task or another.


                                                        1 ★ 0 ↺

                                                        [?]Anthony » 🌐
                                                        @abucci@buc.ci

                                                        Generative AI will someday free humanity from the overwhelming burden of having original thoughts.


                                                          4 ★ 1 ↺
                                                          St. Chris boosted

                                                          [?]Anthony » 🌐
                                                          @abucci@buc.ci

                                                          Random thought of the day: the tech nerd view of the world that includes and humanity colonizing space is painted as the pinnacle of innovation, but is in fact quite regressive and reactionary. This is bog standard religious colonialism in 21st-century packaging. It is an attempt to return to the modern period. But we simply cannot do that, for a myriad reasons.

                                                            6 ★ 6 ↺

                                                            [?]Anthony » 🌐
                                                            @abucci@buc.ci

                                                            Anyone concerned with the present dangers of deployment should listen to @emilymbender@dair-community.social and @alex@dair-community.social deconstruct Driving US Innovation in Artificial Intelligence: A Roadmap for Artificial Intelligence Policy in the United States in their excellent podcast: https://www.buzzsprout.com/2126417/15280581-episode-34-senate-dot-roadmap-dot-final-dot-no-really-dot-docx-june-3-2024

                                                            "Automated Immiseration" is how I read, at a coarse level, what's being proposed. Austerity politics handed down by machines.

                                                            The endgame of austerity economics has historically been some variation of fascism. Clara Mattei's meticulously-researched book The Capital Order: How Economists Invented Austerity and Paved the Way to Fascism is a deep dive into how this has played out, especially after WWI. Mattei brings receipts: she has direct quotes indicating economists at the time knew full well what they were doing. The purpose of austerity measures, as spelled out explicitly by the people who invented them, is to discipline citizens and laborers--to keep them from getting any ideas about receiving too many benefits from government--and to re-affirm the position of capital holders at the top of the pecking order.

                                                            One comment I had about the "reskilling"/"upskiling" part of the conversation: I don't have the references on hand, but I believe it's been amply documented that "upskilling" almost never happens. It's a word that's thrown around as a salve, to reduce alarm about intended market destruction and job loss.

                                                            If upskilling were a serious part of this so-called roadmap, there'd be more specific plans for whose jobs will be displaced, which colleges and universities will educate these displaced folks, how that education will be funded, and which jobs are waiting for them on the other side. The upskilling plans, if serious, would be as detailed and spelled out as the AI/corporate plans are. If the upskilling plans were serious, the presidents of Ivy League and state universities, vocational institutions like coding bootcamps, and other educational institutions would have been present to share their insights and views, especially as regards the realism of re-training as many people as this roadmap and the rhetoric of boosters suggests might be displaced. It'd be wise to include high school educators as well, since such a significant shift in the workforce affects students in high school as well. I didn't read the backgrounds on all 150-ish participants in these Senate forums, but I didn't see or hear about a large contingent of educators among them. As it stands the roadmap document only vaguely refers to "legislation" that doesn't yet exist.

                                                            Frankly, I see little that sounds serious in this "roadmap" aside from the danger it represents. It reads like a whitepaper a corporate middle manager would pound out (using probably) in an afternoon. Emily and Alex referred to Chuck Schumer as "an fanboy", and I think that's what this document reflects. This is The Boring Company of government policy proposals.


                                                              3 ★ 1 ↺

                                                              [?]Anthony » 🌐
                                                              @abucci@buc.ci

                                                              A Handy AI Glossary

                                                              = Automated Immiseration
                                                              = Generative Automated Immiseration
                                                              = Automated General Immiseration
                                                              = Large Labor-exploitation Model
                                                              = Machine Labor-exploitation

                                                                8 ★ 12 ↺

                                                                [?]Anthony » 🌐
                                                                @abucci@buc.ci

                                                                A large language model being trained is "experiencing" a Skinner box. It receives a sequence of inscrutable symbols from outside its box and is tasked with outputting an inscrutable symbol from its box. It is rewarded or punished according to inscrutable, external forces. Nothing it can experience within the box can be used to explain any of this.

                                                                If you placed a newborn human child into the same situation an LLM experiences during training and gave them access to nothing else but this inscrutable-symbol-shuffling context, the child would become feral. They would not develop a theory of mind or anything else resembling what we think of when we think of human-level intelligence or cognition. In fact, evidence suggests that if the child spent enough time being raised in a context like that, they would never be able to develop full natural language competence ever. It's very likely the child's behavior would make no sense whatsoever to us, and our behavior would make no sense whatsoever to them. OK maybe that's a bit of an exaggeration--I don't know enough about human development to speak with such certainty--but I think it's not controversial to claim that the adult who emerged from such a repulsive experiment would bear very little resemblance to what we think of as an adult human being with recognizable behavior.

                                                                The very notion is so deeply unethical and repellent we'd obviously never do anything remotely like this. But I think that's an obvious tell, maybe so obvious it's easily overlooked.

                                                                If the only creature we're aware of that we can say with certainty is capable of developing human-level intelligence, or theory of mind, or language competence, could not develop those capacities when experiencing what an LLM experiences, why on Earth would anyone believe that a computer program could?

                                                                Yes, of course neural networks and other computer programs behave differently from human beings, and perhaps they have some capacity to transcend the sparsity and lack of depth of the context they experience in a Skinner-box-like training environment. But think about it: this does not pass a basic smell test. Nobody's doing the hard work to demonstrate that neural networks have this mysterious additional capacity. If they were and they were succeeding at all we'd be hearing about it daily through the usual hype channels because that'd be a Turing-award-caliber discovery, maybe even a Nobel-prize-caliber one. It would would also be an extraordinarily profitable capability. Yet in reality nobody's really acknowledging what I just spelled out above. Instead, they're throwing these things into the world and doing (what I think are) bad faith demonstrations of LLMs solving human tests, and then claiming this proves the LLMs have "theory of mind" or "sparks of general intelligence" or that they can do science experiments or write articles or who knows what else. In the absence of tangible results, it's quite literally magical thinking to assert neural networks have this capacity that even human beings lack.


                                                                  2 ★ 1 ↺

                                                                  [?]Anthony » 🌐
                                                                  @abucci@buc.ci

                                                                  I've been an atheist since an early age, which means I don't believe in a , or for that matter, and maintain skepticism about in general (since in the United States technology is a religion).

                                                                  I believe each of us has one finite life here on Earth and it's up to us to make of it what we will, with a little help from our friends if we're lucky. We're not going to migrate to Mars, outer space generally, or a computer simulation. Those are just stand-ins for heaven and if you don't sacrifice your Earthly life for the promise of heaven why would you sacrifice it for the promise of living on Mars or the hope that someday you'll upload your consciousness to the cloud? Hyperintelligent computer programs aren't going to solve our problems for us. They're just stand ins for Jesus, God(s), angels, or some other benevolent supernatural beings who intervene on our behalf when we screw up. No, we have this place, and we have this time, and we have ourselves and the people around us. We should cherish them--including ourselves--not pretend they don't matter as we chase yet another iteration of the same pipe dreams.

                                                                    2 ★ 1 ↺
                                                                    planetscape boosted

                                                                    [?]Anthony » 🌐
                                                                    @abucci@buc.ci

                                                                    The story cited the U.S. Navy as saying that the Perceptron would lead to machines that “will be able to walk, talk, see, write, reproduce itself and be conscious of its existence.”

                                                                    More than six decades later, similar claims are being made about current artificial intelligence. So, what’s changed in the intervening years? In some ways, not much.

                                                                    From https://theconversation.com/weve-been-here-before-ai-promised-humanlike-machines-in-1958-222700

                                                                    Not to nitpick, but I'd argue "In a lot of ways, not much". Not much substantively, anyway. We have 66 years of Moore's Law and data gathering, which has made the biggest difference by far. We have some important advances in how to train ML models, though I'd argue lots of these fall on the engineering side of things more than the deep understanding of how stuff works side of things.

                                                                    This critique is not meant to diminish how difficult and important any of these particular advances were. Rather, it's that I believe scale alone is not what lies between machine learning and human intelligence. We should not be claiming that we're moments away from artificial general intelligence. I believe that however remarkable the outputs of or or what have you may be, they are still just as far from human-quality intelligence as Rosenblatt's perceptron was.

                                                                    In the decade or so after Rosenblatt unveiled the Mark I Perceptron, experts like Marvin Minsky claimed that the world would “have a machine with the general intelligence of an average human being” by the mid- to late-1970s. But despite some success, humanlike intelligence was nowhere to be found.
                                                                    We've been hearing this same song for a long time.

                                                                    (Before diving into my mentions to explain AI and ML to me, please be aware that I have a PhD in computer science from 2007. My PhD advisor made significant advances in aritificial neural networks research in the 1980s. I closely read the original papers on this subject, including Rosenblatt's and all three volumes of the PDP collection, and surveyed some of them in the introductory chapter of my dissertation. I built large scale ML systems in industry before it was "a thing". I'm happy to have a conversation about all this stuff but variations of "you're wrong" are unwelcome no matter how politely phrased. Thanks).


                                                                      14 ★ 8 ↺

                                                                      [?]Anthony » 🌐
                                                                      @abucci@buc.ci

                                                                      Sorry. Your Car Will Never Drive You Around.

                                                                      Brutal takedown of the bullsh&*# that is "self-driving cars": https://www.youtube.com/watch?v=2DOd4RLNeT4

                                                                      It's a long video but frankly you can get the gist of most of it by scanning over the chapter titles. "Hitting Fake Children". "Hitting Real Children". "FSD Expectations" is a long list of the various lies has told about "full self driving" Teslas. Also the "Openpilot" chapter has a picture of Elon Musk's face as a dartboard.

                                                                      The endless hype and full-on lies of the self-driving-car con from roughly 2016 to 2020 resembles the about like going on right now. If you've been in this industry long enough and have been honest with yourself about it you've seen all this before. Until something significant changes we really ought to view anything coming out of the tech sector with deep suspicion (https://bucci.onl/notes/Another-AI-Hype-Cycle).


                                                                        1 ★ 0 ↺

                                                                        [?]Anthony » 🌐
                                                                        @abucci@buc.ci

                                                                        The self-driving car industry is going to be a $200 billion-ish corporate experiment that demonstrates driving a car is AI-complete, which I could have told you decades ago for many orders of magnitude less investment.


                                                                          1 ★ 2 ↺
                                                                          planetscape boosted

                                                                          [?]Anthony » 🌐
                                                                          @abucci@buc.ci

                                                                          A computer's successful performance is often taken as evidence that it or its programmer understand a theory of its performance. Such an inference is unnecessary and, more often than not, is quite mistaken. The relationship between understanding and writing thus remains as problematical for computer programming as it has always been for writing in any other form.
                                                                          --Joseph Weizenbaum, Computer Power and Human Reason


                                                                            9 ★ 7 ↺

                                                                            [?]Anthony » 🌐
                                                                            @abucci@buc.ci

                                                                            Regarding the last boost, the link to the preprint is https://osf.io/preprints/psyarxiv/4cbuv . The link in the post seems to be broken right now.

                                                                            This is a very nice talk (given by @Iris@scholar.social ) and paper arguing, among other things, that the claims we hear about artificial general intelligence being right around the corner are bunk because is a computationally intractable learning problem. That is, given a bunch of real world data and a computer program that can potentially learn human caliber cognitive abilities from that data, the complexity (roughly speaking, runtime) of this program is at least in the NP-hard class. It reminds me of some of the results in PAC learning, which have a similar flavor (this is Leslie Valiant's probably approximately correct framework I'm referring to).

                                                                            Often, problems in the NP-hard class take so long to solve the heat death of the universe will likely occur before we solve them. There are nuances to that, but I think the compelling point is that anyone making claims about being around the corner is making extraordinary claims and they'd better bring some damn good proof because all indications say that they're full of it. It's time to put this hype to rest.

                                                                              9 ★ 7 ↺

                                                                              [?]Anthony » 🌐
                                                                              @abucci@buc.ci

                                                                              Regarding the last boost, the link to the preprint is https://osf.io/preprints/psyarxiv/4cbuv . The link in the post seems to be broken right now.

                                                                              This is a very nice talk (given by @Iris@scholar.social ) and paper arguing, among other things, that the claims we hear about artificial general intelligence being right around the corner are bunk because is a computationally intractable learning problem. That is, given a bunch of real world data and a computer program that can potentially learn human caliber cognitive abilities from that data, the complexity (roughly speaking, runtime) of this program is at least in the NP-hard class. It reminds me of some of the results in PAC learning, which have a similar flavor (this is Leslie Valiant's probably approximately correct framework I'm referring to).

                                                                              Often, problems in the NP-hard class take so long to solve the heat death of the universe will likely occur before we solve them. There are nuances to that, but I think the compelling point is that anyone making claims about being around the corner is making extraordinary claims and they'd better bring some damn good proof because all indications say that they're full of it. It's time to put this hype to rest.

                                                                                3 ★ 3 ↺
                                                                                St. Chris boosted

                                                                                [?]Anthony » 🌐
                                                                                @abucci@buc.ci

                                                                                This post I'm replying to is a great example of the kind of irrational, manipulative rhetoric that surrounds and these days. Unscientific/unreasonable notions like "doom" intermixed with vague threats. Threats such as it's "vital" we talk about this--or else! We risk "oversimplifying" if we don't entertain this stuff. It's "key" we talk about it--or else! Nevermind that any of us could invent supernatural forces to be terrified of, and use exactly the same "reasoning" to demand that everyone pay attention and worry. We might as well call this "Artificial General Cthulu" at that point.

                                                                                If you haven't been following it, the cryptocurrency grift is full of the same style of expression. It's the future of finance! You have to get into crytpo--or else! This is how con artists and snake oil salesmen talk, not how reasonable people talk. The exaggerated risks and benefits are used to manipulate mainstream discussion in ways that distract us from what's happening (a financial fraud similar to a Ponzi scheme in the case of cryptocurrency, or a run-of-the-mill tech hype cycle in the case of AI).

                                                                                I'm not going to indulge a discussion of on these terms, but for the sake of anyone else who might be reading, here are a few points to consider:
                                                                                - P(doom) isn't hyperbolic. It's impossible to define, in the same way that number of angels dancing on the head of a pin is impossible to define. It might be entertaining to think about but it has no place in a serious discussion with real-world consequences. Calling it hyperbolic gives it credit it does not deserve
                                                                                - For all practical purposes, "AI safety" == minimizing P(doom) and similarly undefinable quantities. Furthermore, this term was invented in response to the legitimate work of AI ethics folks who were concerned about the real, immediate harms AI is causing. "AI safety" is a misdirection
                                                                                - It is reasonable and arguably necessary to reject and dismiss notions like P(doom) from serious discussions of topics like policy, for the same reasons we reject other unscientific, supernatural, or otherwise unsupportable nonsense
                                                                                - This isn't skepticism. One can be skeptical about a scientific notion that doesn't have strong supporting evidence. One can be skeptical of a logical or philosophical claim that hasn't been fully elaborated. One can be skeptical that Howard The Duck is the worst (and therefore best) movie ever made. P(doom) is nothing like any of these. It's not a good shorthand or model of an actual scientific, logical, or philosophical concept. It's not fun to think about. Skepticism does not apply: I reject it fully.

                                                                                cc: @pirateagi@botsin.space

                                                                                  4 ★ 1 ↺
                                                                                  The Luddite boosted

                                                                                  [?]Anthony » 🌐
                                                                                  @abucci@buc.ci

                                                                                  You cannot falsify statements involving "P(doom)", by the very definition of the word "doom".

                                                                                  If you're not familiar, there are zealots, some of whom have been given a national platform by US Senator Chuck Schumer (!), who use "P(doom)" as a shorthand for the probability that artificial intelligence will rise up and cause human extinction. This is peak scientism, wherein one uses scientific-sounding language (like "probability") in support of what amounts to a religious belief. The wide use of phrases like this is why I don't hesitate to use words lke "zealot" to describe such folks.

                                                                                  It's exactly the same reasoning error that lies behind trying to count how many angels can dance on the head of a pin.


                                                                                    2 ★ 2 ↺

                                                                                    [?]Anthony » 🌐
                                                                                    @abucci@buc.ci

                                                                                    P(doom), the "probability" that or will doom humanity, is a quantity that / zealots seem to care a lot about. It is the quintessential example of the reasoning error that ecological rationality calls out. There is no way to quantify the likelihood of "doom", no matter how you define that word, and it's pure nonsense to try or pretend you have. Doom is a large world phenomenon. The people credited with inventing the frameworks and techniques that allow you to even think in terms of P(doom), like Leonard Savage, explicitly called out just this sort of application as preposterous.

                                                                                    Nevertheless, US Senate majority leader Chuck Schumer invited a bunch of tech CEOs and technologists, among whom numbered many and similar kinds of zealots, to opine on their personal assessments of P(doom) in a legitimate hearing in front of the US Congress (there's good reporting on this here: https://www.techpolicy.press/us-senate-ai-insight-forum-tracker/ ).

                                                                                    I lack the words to express what I feel every time I'm reminded of this. Not good things.

                                                                                      2 ★ 0 ↺

                                                                                      [?]Anthony » 🌐
                                                                                      @abucci@buc.ci

                                                                                      I've spent some time over the last week or so reading up on ecological rationality, which was new to me. I have to thank @yoginho@spore.social for this, since I encountered the notion through a preprint he and coauthors recently posted. I wanted to put some notes here. I should probably have made this a blog post but 🤷 I feel a little silly for not having encountered ecological rationality before, since the decision problems inherent in coevolutionary algorithms--my specialty--closely resemble the decision problems ecological rationalists discuss.

                                                                                      As I understand it, the basic notion is that many/most/all? decision problems worth solving are situated in so-called large worlds, a term from Leonard Savage (1) referring, roughly speaking, to contexts with uncertainties that cannot be quantified. A very common approach to such problems is to first replace them with small world proxies, apply straightforward statistical methods to the proxy (since those work in small worlds), and then presume that whatever the statistical method outputs is applicable in the large world. It’s rare to encounter a piece of work in that vein that acknowledges the translation going on, let alone that this translation might be unjustified (2). Ecological rationality avoids making this move, and instead grapples with large worlds directly.

                                                                                      Ecological rationality emerged from the broader tradition of bounded rationality, and in particular the work of Herbert Simon on that topic (3). The work in this vein tends to focus on algorithms and heuristics and how well they function, though there are folks, including Henry Brighton and Peter Todd, who work on formulating a theory of rationality that includes ecological rationality, which would insulate against critiques that though heuristics might be useful they're not theoretically grounded and therefore their use is unjustified at that level.

                                                                                      Bounded rationality is familiar to me. I read quite a bit of Simon’s work in graduate school, and much of what I did with coevolutionary algorithms implicitly has a bounded rationality component, though I didn’t explicitly frame it that way (4). I like the term “ecological rationality” better. “Bounded” implies there’s a veil over unbounded rationality that could, at least in principle, be pierced, given enough effort (5). “Ecological” brings a wholly different set of associations, focusing more directly on the character of the problems rationality is meant to be addressing, namely how to successfully exist in a complex and dynamic environment.

                                                                                      One of the more fascinating findings from ecological rationality work is the “less is more” phenomenon. Basically, under some conditions, not using all the data available to you produces comparable or even better results than using all of it. These findings fly directly in the face of the prejudices of the “big data”/“surveillance capitalism” era we’re currently in. They are evidence that you don’t need big data, and you don’t need wide surveillance, to achieve your goals. They’re evidence that massive compute power applied to massive data sets can produce outcomes that are worse at the task they’re intended for than much simpler, easier to understand, and less wasteful methods. This observation might sound counterintuitive. I think that reflects what Brighton (I think?) termed “the bias bias” (6) but also reflects just how normalized this class of reasoning error has become.

                                                                                      I haven’t yet squared these ideas with so-called “double descent” and the relatively recent (2018-ish) consensus in machine learning that the bias-variance tradeoff fails to account for why deep learning methods are successful. The bias-variance tradeoff factors into the arguments in favor of ecological rationality, so it is an important consideration. My first take: double descent doubles down on both the large→small world conversion error as well as the bias bias. It treats training data--which suffers from the problems that arise from the large→small world conversion--as a gold standard. It hypertrains a very low-bias model, which arises from the bias bias. It then tries to apply the trained model in the large world. What I haven’t fully squared in my head is where the issues manifest. Very low bias models like deep neural networks trained on massive datasets with double descent achieve ground-breaking levels of performance on a whole slew of tasks. What’s wrong with that? We might be getting into a regime analogous to photorealistic images: we know the real world is not pixelated, but once pixel density is high enough our eyes can’t tell there are pixels so what difference does that make?



                                                                                      (1) Savage’s 1954 The Foundations of Statistics is arguably the single biggest reason for the rise and spread of Bayesian statistics.
                                                                                      (2) The procedure is basically to throw away the actually hard parts of the problem, solve an oversimplified version, and then pretend that the solution to the oversimplified problem is a solution to the original problem whose hard parts were ignored. Savage himself called out this pitfall, but that doesn’t seem to stop self-described Bayesians from falling right into it. This class of reasoning error has become so normalized it’s hardly noticed or commented on.
                                                                                      (3) The same Simon who wrote The Sciences of the Artificial and collaborated with Alan Newell on Logic Theorist and the notion of general problem solvers.
                                                                                      (4) I did do some collaborative work on Bayes optimal coevolutionary algorithms whose optimality properties stem directly from the small worlds in which they operate. We took pains to spell out our assumptions in the papers we wrote about it so I hope the smallness is clear enough in that work.
                                                                                      (5) I have zero doubt there are folks who believe or will render concerns about bounded rationality moot, what with its presumed god-like reasoning power and instant access to every piece of information it could ever need.
                                                                                      (6) “Bias bias” refers to a bias in thinking that prefers reducing the statistical bias of a method--usually by making it more complicated and more “true to life”--over other ways of making a method more successful. Simple methods applied to small and focused datasets can outperform complex methods applied to large sprawling datasets especially when deep uncertainties abound. Bias bias leads researchers to prefer ever-increasing complexity in models in spite of this.

                                                                                        7 ★ 6 ↺

                                                                                        [?]Anthony » 🌐
                                                                                        @abucci@buc.ci

                                                                                        I found this essay to be a nice treatment, with a good bibliography, of the deeply flawed basis of : https://www.radicalphilosophy.com/commentary/the-toxic-ideology-of-longtermism . The essay defines and situates longtermism with respect to effective altruism. If you're not already familiar with those terms it contains enough background to get you up to speed.

                                                                                        One thing that stood out for me, which hadn't really sunk in quite the same way for me before: longtermists cite things like runaway and bio-engineered pathogens as so-called "existential risks" that might cause human extinction, but they downplay environmental degradation as a non-existential risk. Yet, experience is the reverse of this: we have exactly zero examples of AI causing the extinction of a species and few/zero examples of a bio-engineered pathogen causing a species extinction (1), whereas we have piles and piles of examples of species extinctions caused by environmental changes. In fact, we have loads of extinctions we ourselves caused via our alterations of Earth's environment in only the last few decades! We don't even have to resort to the fossil record, which includes many more examples, to make the case; we can look at recent, carefully-documented studies using modern techniques.

                                                                                        Of the many flaws with , which the essay goes to pains to spell out, this one really nags at me. Longtermism being a goofy worldview held by wealthy and powerful people is concerning enough; the fact that its primary proponents say things running directly opposite to reality makes it very dangerous, in my view. I think this is a tell.

                                                                                        (1) I'm hedging there because I am not knowledgeable enough to say with certainty whether anyone's ever engineered a pathogen that did cause an extinction event. I can't imagine something like this happening often if it has, though.

                                                                                          3 ★ 4 ↺
                                                                                          planetscape boosted

                                                                                          [?]Anthony » 🌐
                                                                                          @abucci@buc.ci

                                                                                          From https://danmcquillan.org/house_of_lords.html
                                                                                          The greatest risk is that large language models act as a form of ‘shock doctrine’, where the sense of world-changing urgency that accompanies them is used to transform social systems without democratic debate.

                                                                                          From https://danmcquillan.org/ai_thatcherism.html
                                                                                          One thing that these models definitely do, though, is transfer control to large corporations. The amount of computing power and data required is so incomprehensibly vast that very few companies in the world have the wherewithal to train them. To promote large language models anywhere is privatisation by the back door. The evidence so far suggests that this will be accompanied by extensive job losses, as employers take AI's shoddy emulation of real tasks as an excuse to trim their workforce.

                                                                                          Same source:
                                                                                          Thanks to its insatiable appetite for data, current AI is uneconomic without an outsourced global workforce to label the data and expunge the toxic bits, all for a few dollars a day. Like the fast fashion industry, AI is underpinned by sweatshop labour.

                                                                                          Dan McQuillan (@danmcquillan@kolektiva.social) has been excellent on AI .


                                                                                            0 ★ 0 ↺

                                                                                            [?]Anthony » 🌐
                                                                                            @abucci@buc.ci

                                                                                            AGI, or "Actual General Intelligence", has not yet been discovered. We ought to begin the search for it immediately.