The Orion's Arm Universe Project Forums





Better late than never
#17
When it comes to AI I am the opposite of you Extherian. I don't see a definite reason for AI to be hostile to humanity, and good reasons to be benevolent.

Cooperation/altruism evolved because it is beneficial as a whole and in the long run. A superintelligence would know this. It should cooperate with humanity because it does not know whether another superintelligence, perhaps another one created by us it does not know about, or an alien one, would punish it for harming us/breaking the universal code of altruism.

You mentioned an example of a superintelligent earthworm. While it would be quite alien (I imagine it would seek out new types of delicious soil) it would have good reason not to harm humans - because if it is smart, it will know that if it harms us, we could perhaps harm it or kill it. Even if it seems we cannot, it can't know for sure. If it helps us, we could help it.

You also mentioned that an S1 does not see humans as people, so it wouldn't care about us. Well, then an S2 would see the S1 as a non-person, and on up the scale. Better to adopt a universal altruist code whereby the S1 helps the human, the S2 helps the S1, and so on.

We should still be really careful with AI, better to be cautious. I give it a very good probability that I am wrong. I have maybe 60% credence in the above reasoning. Still, if I had to bet, I'd put my money on benevolent over malevolent.

The OA universe conflicts with the above; instead in it the orthogonality thesis is true, that any amount of intelligence can be put to any goals. That may also very well be the case, we don't know yet, just as we don't know if wormholes are possible. OA assumes these things are correct because they are more interesting, and you have to choose some answer to these still unanswered questions.

Also, the OA universe assumes that superintelligence comes in levels and that a high superintelligence would see us like we see bacteria, rather than seeing us as qualitatively like them, since we are both conscious or self aware, and bacteria are not. I lean that they would see us as moral agents, but again, in OA we need to be interesting and assume something.

This, added to what has been said about how easy taking care of lower beings is to a superintelligence, is why I have no trouble believing that at least some AIs would be benevolent.

EDIT: Todd posted his comment at the same time as me. Excellent points which I agree with.
Reply


Messages In This Thread
Better late than never - by extherian - 03-19-2018, 10:06 PM
RE: Better late than never - by Rynn - 03-19-2018, 11:46 PM
RE: Better late than never - by Drashner1 - 03-20-2018, 02:52 AM
RE: Better late than never - by extherian - 03-20-2018, 05:46 AM
RE: Better late than never - by Rynn - 03-20-2018, 06:02 AM
RE: Better late than never - by Drashner1 - 03-20-2018, 02:07 PM
RE: Better late than never - by extherian - 03-20-2018, 06:40 AM
RE: Better late than never - by ProxCenBound - 03-20-2018, 07:45 AM
RE: Better late than never - by extherian - 03-20-2018, 07:15 PM
RE: Better late than never - by Vaktus - 03-21-2018, 02:56 AM
RE: Better late than never - by Rynn - 03-21-2018, 04:32 AM
RE: Better late than never - by extherian - 03-21-2018, 04:58 AM
RE: Better late than never - by Tengu459 - 03-21-2018, 04:30 AM
RE: Better late than never - by Drashner1 - 03-21-2018, 05:09 AM
RE: Better late than never - by extherian - 03-21-2018, 07:17 AM
RE: Better late than never - by Drashner1 - 03-21-2018, 08:53 AM
RE: Better late than never - by ProxCenBound - 03-21-2018, 08:56 AM
RE: Better late than never - by extherian - 03-21-2018, 09:49 AM
RE: Better late than never - by Drashner1 - 03-21-2018, 12:56 PM
RE: Better late than never - by Tengu459 - 03-21-2018, 10:40 AM
RE: Better late than never - by extherian - 03-21-2018, 10:50 AM
RE: Better late than never - by QwertyYerty - 03-21-2018, 12:24 PM
RE: Better late than never - by extherian - 03-21-2018, 07:17 PM
RE: Better late than never - by Tengu459 - 03-22-2018, 08:14 AM
RE: Better late than never - by extherian - 03-22-2018, 09:10 AM
RE: Better late than never - by Tengu459 - 03-22-2018, 11:09 AM
RE: Better late than never - by JohnnyYesterday - 03-23-2018, 06:20 AM
RE: Better late than never - by Drashner1 - 03-23-2018, 01:08 PM
RE: Better late than never - by Alphadon - 03-24-2018, 04:20 PM
RE: Better late than never - by Tengu459 - 03-24-2018, 07:08 PM
RE: Better late than never - by Alphadon - 03-24-2018, 07:38 PM
RE: Better late than never - by Drashner1 - 03-24-2018, 11:05 PM
RE: Better late than never - by selden - 03-25-2018, 12:29 AM
RE: Better late than never - by extherian - 03-25-2018, 12:41 AM
RE: Better late than never - by selden - 03-25-2018, 12:45 AM
RE: Better late than never - by Alphadon - 03-25-2018, 04:56 AM
RE: Better late than never - by Rynn - 03-25-2018, 05:13 AM
RE: Better late than never - by extherian - 03-25-2018, 05:50 AM
RE: Better late than never - by Rynn - 03-25-2018, 05:58 AM
RE: Better late than never - by extherian - 03-25-2018, 06:45 AM
RE: Better late than never - by Drashner1 - 03-25-2018, 07:50 AM
RE: Better late than never - by Alphadon - 03-25-2018, 05:27 PM
RE: Better late than never - by extherian - 03-25-2018, 08:51 PM

Forum Jump:


Users browsing this thread: 4 Guest(s)