Skip to main content

Monitoring hyper-automatization: The self-destruction of scientists and all kinds of researchers?

Arguments, questions and philosophical extensions from the possibility of super intelligent Artificial Intelligence

globinfo freexchange

Nick Bostrom reveals the potential dangers of the super intelligent Artificial Intelligence (AI) deployment, and another occupation to be threatened in the not so distant future by the machines: Scientists and researchers responsible for this deployment!

Nick Bostrom’s job is to dream up increasingly lurid scenarios that could wipe out the human race: Asteroid strikes; high-energy physics experiments that go wrong; global plagues of genetically-modified superbugs; the emergence of all-powerful computers with scant regard for human life—that sort of thing. In the hierarchy of risk categories, Bostrom’s specialty stands above mere catastrophic risks like climate change, financial market collapse and conventional warfare. As the Director of the Future of Humanity Institute at the University of Oxford, Bostrom is part of a small but growing network of snappily-named academic institutions tackling these "existential risks": the Centre for the Study of Existential Risk at the University of Cambridge; the Future of Life Institute at MIT and the Machine Intelligence Research Institute at Berkeley. Their tools are philosophy, physics and lots and lots of hard math.”

"... developments in artificial intelligence will gather apace so that within this century it’s conceivable that we will be able to artificially replicate human level machine intelligence (HLMI). Once HLMI is reached, things move pretty quickly: Intelligent machines will be able to design even more intelligent machines, leading to what mathematician I.J. Good called back in 1965 an 'intelligence explosion' that will leave human capabilities far behind.

... once a super intelligence is reached, present and future humanity become the gorillas; stalked by a more powerful, more capable agent that sees nothing wrong with imprisoning these docile creatures or wrecking their natural environments as part of a means of achieving its aims.”

Bostrom gives the example of a super intelligent AI located in a paperclip factory whose top-level goal is to maximize the production of paperclips, and whose intelligence would enable it to acquire different resources to increase its capabilities. 'If your goal is to make as many paperclips as possible and you are a super-intelligent machine you may predict that human beings might want to switch off this paperclip machine after a certain amount of paperclips have been made,' he says. 'So for this agent, it may be desirable to get rid of humans. It also would be desirable ultimately to use the material that humans use, including our bodies, our homes and our food to make paperclips.' 'Some of those arbitrary actions that improve paperclip production may involve the destruction of everything that we care about. The point that is actually quite difficult is specifying goals that would not have those consequences.'”

It is questionable whether we can characterize a machine as super-intelligent in case that it seeks to survive just to produce paper clips! It would be more probable to understand the production necessity limit by itself based on pure, simple logic: no consumption = no need for production and therefore, self-evolve to a more advanced machine, producing more sophisticated products which would still have value. Besides, 3D printers already produce various products through various materials. It is unlikely that the super-intelligent machines of the future will have a mission to build only one product, even if it would not be that simple as paper clips.

The threat of superintelligence is to Matheny far worse than any epidemic we have ever experienced. 'Some risks that are especially difficult to control have three characteristics: autonomy, self-replication and self-modification. Infectious diseases have these characteristics, and have killed more people than any other class of events, including war. Some computer malware has these characteristics, and can do a lot of damage. But microbes and malware cannot intelligently self-modify, so countermeasures can catch up. A superintelligent system [as outlined by Bostrom] would be much harder to control if it were able to intelligently self-modify.'”

Maybe self-modification is not he big issue here. In any case, whether we are talking about humans, machines, viruses, computers, or any other kind of biological entity, or machine, one thing is common to all these: Energy consumption. Therefore, assuming that there will be a battle for survival, the winner will probably be the one who will manage to cut energy supply to the "enemy" and maintain its own.

Meanwhile, the quiet work of these half dozen researchers in labs and study rooms across the globe continues. As Matheny puts it: 'existential risk [and superintelligence] is a neglected topic in both the scientific and governmental communities, but it's hard to think of a topic more important than human survival.' He quotes Carl Sagan, writing about the costs of nuclear war: 'We are talking about [the loss of life of] some 500 trillion people yet to come. There are many other possible measures of the potential loss—including culture and science, the evolutionary history of the planet and the significance of the lives of all of our ancestors who contributed to the future of their descendants. Extinction is the undoing of the human enterprise.'”

Nevertheless, another question emerge: What if AI is meant to be the next step of human evolution itself? What difference does it make when we progressively abolishing human conquered concepts, like morality, from our culture?

If we want truly evolve, as humanity, we need to bring back morality. We need to develop concepts like solidarity, altruism, collectivity and put them in the core of our civilization. Otherwise, it would make no difference - and probably would be better - to be replaced by super-intelligent machines.


Probably AI has already started, after all:

At last count, Twitter had 271 million monthly active users, or less than a third of big brother Facebook’s billion-strong base. After five straight quarters of decelerating growth, the rate at which Twitter is picking up new users has finally bounced back a bit. The company has also said it will start reporting usage metrics in ways that better reflect the true reach of the platform — after all, many of the people who saw some of Twitter’s most iconic tweets, like Obama’s victory photo and Ellen’s Oscar selfie, are not registered users.”

The company says that up to 8.5 percent of its users or 23 million 'used third party applications that may have automatically contacted our servers for regular updates without any discernable [sic] additional user-initiated action.' In other words? Robots.”


Previous:

Comments

Popular posts from this blog

August 12, 2020: The day capitalism officially died and replaced by something even worse

globinfo freexchange   It was the 12th of August, 2020. Nine o'clock in the morning, in London, the news came out that the national income of Britain (GDP) had fallen by more than 20% . That had never happened before in the history of capitalism - British GDP falling by 21% or so in one year. It was not anticipated. The markets were expecting a fall of 8,9,10%. No one was expecting a 21% fall. Fifteen or sixteen minutes later, the London stock exchange went up by 3% . There can be no explanation of that along the lines of capitalism.     This is how the Greek economist, Yanis Varoufakis, described essentially the official death of capitalism and its replacement by something even worse. The thing he calls "technofeudalism". While Varoufakis in various discussions struggles to explain why capitalism is already dead, it's rather funny that people still willing to debate on something that's already dead (capitalism) against something that's far from being practi

US Gov discussed killing Assange & possibly Ellsberg

Katie Halper  Daniel Ellsberg and Julian Assange have a lot in common and Daniel Ellsberg is the first one to point this out. Daniel goes over how they both exposed state secrets, how the government attempted to use the Espionage Act against them, spied on them and while we know for certain that the CIA discussed killing Assange, the US Government may have discussed killing Ellsberg when they said they'd "incapacitate," him.

Edward Snowden, Glenn Greenwald & Chris Hedges on NSA leaks, Assange & protecting a Free Internet

Democracy Now!   NSA whistleblower Edward Snowden and Pulitzer Prize-winning journalists Glenn Greenwald and Chris Hedges discuss mass surveillance, government secrecy, Internet freedom and U.S. attempts to extradite and prosecute Wikileaks founder Julian Assange. They spoke together on a panel moderated by Amy Goodman at the virtual War on Terror film festival after a screening of "Citizenfour" — the Oscar-winning documentary about Snowden by Laura Poitras.  

Evidence that the US imperialists were pre-planning to arm and train the neo-nazis in Ukraine

globinfo freexchange   There is plenty of evidence that the Western imperialists and their European allies supported neo-nazi groups in Ukraine during the 2014 "Maidan revolution", which led to the ousting of elected President Viktor Yanukovych, and the overthrow of the Ukrainian government.   Protests originally erupted in November 2013 after President Yanukovych refused to sign a political association and free trade agreement with the European Union at a meeting of the Eastern Partnership in Vilnius, Lithuania, choosing closer ties with Russia instead.  The support of Ukrainian neo-nazis by the US imperialists continued further during the Obama term. For example, as the World Socialist Web Site reported on early 2016:   The 2016 Consolidated Appropriations Act, signed into law by US President Barack Obama late last year, did not include a previously expected ban against the funding of the Azov Regiment, a military organization that originated as a volunteer militia

US & UK Destroying Assange & Press Freedom

The Jimmy Dore Show    

'Ετοιμο το πράσινο δεκανίκι του καθεστώτος - γιατί οι ολιγάρχες επέλεξαν τελικά τον Ανδρουλάκη

globinfo freexchange   Σε προηγούμενο άρθρο , εκτιμήσαμε ότι ο βαθμός δυσκολίας για τους ντόπιους ολιγάρχες - προκειμένου να κατασκευάσουν μια απόλυτα ελεγχόμενη κυβέρνηση συνεργασίας ΝΔ-ΚΙΝΑΛ - ανεβαίνει όσο μικραίνει η πιθανότητα νίκης του Λοβέρδου που είναι η πιο πιστή μαριονέτα, ή του Παπανδρέου, που είναι η αμέσως επόμενη τους επιλογή, αφού είναι εξαιρετικά διαχειρίσιμος. Αλλά το ΚΙΝΑΛ γενικά είναι του χεριού τους.   Απ'ότι φαίνεται και τα δυο αυτά χαρτιά κάηκαν γρήγορα, αφού ο μεν Λοβέρδος δεν μπόρεσε να κρύψει τη δίψα του για σφιχτό εναγκαλισμό με την χειρότερη δεξιά που κυβέρνησε στη μεταπολίτευση. Τον δε Παπανδρέου δεν κατάφεραν να τον ξεπλύνουν τα μιντιακά πλυντήρια των ολιγαρχών, καθώς απ'ότι φάνηκε, κυρίως στα σόσιαλ μίντια, ο κόσμος δεν ξέχασε ποιος έφερε τον εφιάλτη της συμμορίας του ΔΝΤ στη χώρα.  Οι ολιγάρχες έπρεπε να κάνουν μια ολική επανεκκίνηση στο πράσινο δεκανίκι τους, ώστε το ξέπλυμα να είναι όσο το δυνατόν πιο αποτελεσματικό. Έπρεπε να βρουν τον κατάλλη

Confirmed: Unpopular US President Kamala Harris is the most faithful puppet of the corporate oligarchy

globinfo freexchange     A recent article published on Bloomberg exposes impressively two things:    First, that the Democrats have no intention to even slightly move from their pro-corporate positions and towards the interests of the US working class; on the contrary.   Second, the elites essentially replaced Joe Biden with Kamala Harris.    The article was re-published by various websites and the surprises already start from the title: Harris quietly taps Wall Street, tech CEOs for advice on policy . Not that it is something we didn't expect, but why a top establishment outlet admits that Harris "quietly" runs to the banking-corporate oligarchy for "instructions"?  Perhaps more surprisingly, the answer can be found within the article itself:   The corporate world has provided a familiar source of help. As California's attorney general, Harris gained a reputation for frequently partnering with technology companies — rather than prosecuting them — as

It's getting worse: Mitsotakis regime targets top investigative journalists in Greece

globinfo freexchange   In November of the previous year we watched Mitsotakis regime in Greece taking steps to suppress further press freedom in the country, through some proposed amendments to Article 191 of the Criminal Code. The International Press Institute then concluded that " Rather than improving the existing Article 191 of the Criminal Code, which is already problematic, the government of Prime Minister Kyriakos Mitsotakis would take a major step backwards if this law were eventually passed and send a worrying signal about the administration’s commitment to media freedom. " It seems that the regime is using now these changes (introduced on the pretext of "dangerous" misinformation related to COVID-19 pandemic and other issues) to go after top investigative journalists, who, were investigating big corruption scandals. Recently, investigative journalist Gianna Papadakou, was targeted for exposing officials believed to have received bribes from the Swiss pha

Day 1000: Julian Assange still in prison and under slow-motion execution by the Anglo-American imperialist criminals

failed evolution   World's number one political prisoner, Julian Assange, still in high security prison for exposing horrendous war crimes carried out by the US imperialists and their allies.   The ruthless Western imperialist regime wants to punish the No1 real journalist in the world and make him an example for any Whistleblower or real journalist who will attempt to expose its big crimes in the future.   That Assange, who is in precarious physical and psychological health and who suffered a stroke during court video proceedings, has been condemned to death should not come as a surprise. The ten years he has been detained, seven in the Ecuadorian Embassy in London and nearly three in the high security Belmarsh prison, were accompanied with a lack of sunlight and exercise and unrelenting threats, pressure, anxiety and stress.    His steady physical and psychological deterioration has led to hallucinations and depression. He takes antidepressant medication and the antipsych

[Petition] Tony Blair to have his "Knight Companion of the Most Noble Order of the Garter" rescinded

Tony Blair is to be knighted with the highest possible ranking in the new year honours list, Buckingham Palace has said. Sir Tony, who held the keys to No 10 between 1997 and 2007, will be appointed a Knight Companion of the Most Noble Order of the Garter, the oldest and most senior British Order of Chivalry. Tony Blair caused irreparable damage to both the constitution of the United Kingdom and to the very fabric of the nation's society. He was personally responsible for causing the death of countless innocent, civilian lives and servicement in various conflicts. For this alone he should be held accountable for war crimes.  Tony Blair is the least deserving person of any public honour, particularly anything awarded by Her Majesty the Queen. We petition the Prime Minister to petition Her Majesty to have this honour removed.   Sign here: https://www.change.org/p/the-prime-minister-tony-blair-to-have-his-knight-companion-of-the-most-noble-order-of-the-garter-rescinded