reason1377.com
1377.com 时间:2021-03-20 阅读:(
)
MoralpreferencesFrancescaRossiIBMT.
J.
WatsonResearchcenterfrossi@it.
ibm.
com1MotivationandIntroductionHowdohumansormachinesmakeadecisionWheneverwemakeadecision,weconsiderourpreferencesoverthepossi-bleoptions.
Also,inasocialcontext,collectivedecisionsaremadebyaggregatingthepreferencesoftheindividuals.
AIsystemsthatsupportindividualandcollectivedecisionmak-inghavebeenstudiedforalongtime,andseveralpreferencemodellingandreasoningframeworkshavebeendenedandexploitedinordertoproviderationalitytothedecisionpro-cessanditsresult.
However,littleefforthasbeendevotedtounderstandwhetherthisdecisionprocess,oritsresult,isethicalormoral.
Rationalitydoesnotimplymorality.
HowcanweembedmoralityintoadecisionprocessAndhowdoweensurethatthedecisionwemake,asanindividualoracollectivityofin-dividuals,aremoralInotherwords,howdowepassfromtheindividuals'personalpreferencestomoralbehaviouranddecisionmakingWhenwepassfromhumanstoAIsystems,thetaskofmodellingandembeddingmoralityandethicalprinciplesisevenmorevagueandelusive.
Aretheexistingethicaltheo-riesapplicablealsotoAIsystemsOnonehand,thingsseemeasiersincewecannarrowthescopeofanAIsystem,sothatthecontextualinformationcanhelpusindenethecorrectmoralvaluesitshouldworkaccordingto.
However,itisnotclearwhatmoralvaluesweshouldembedinthesystem,norhowtoembedthem.
Shouldwecodetheminasetofrules,orshouldweletthesystemlearnthevaluesbyobservingushumansPreferencesandethicaltheoriesarenotthatdifferentinonerespect:theybothdeneprioritiesoveractions.
So,canweuseexistingpreferenceformalismstoalsomodelethicalthe-oriesWediscusshowtoexploitandadaptcurrentpreferenceformalismsinordertomodelmoralityandethicstheories,aswellasthedynamicintegrationofmoralcodeintopersonalpreferences.
Wealsodiscusstheuseofmeta-preferences,sincemoralityseemstoneedawaytojudgepreferencesac-cordingtotheirmoralitylevel.
Itisimperativethatwebuildintelligentsystemswhichbe-havemorally.
Toworkandlivewithus,weneedtotrustsuchsystems,andthisrequiresthatweare"reasonably"surethatitbehavesmorally,accordingtovaluesthatarealignedtotheOnleavefromUniversityofPadova,Italyhumanones.
Otherwise,wewouldnotletarobottakecareofourelderlypeopleorourkids,noracartodriveforus,norwewouldlistentoadecisionsupportsysteminanyhealth-carescenario.
Ofcoursetheword"reasonable"makessensewhentheapplicationdomaindoesnotincludecriticalsitua-tions(likesuggestingafriendonasocialmediaoramovieinanonlinesellingsystem).
ButwhentheAIsystemishelping(orreplacing)humansincriticaldomainssuchashealthcare,thenweneedtohaveaguaranteethatnothingmorallywrongwillbedone.
Inthisextendedabstractweintroducesomeissuesinem-beddingmoralityintointelligentsystems.
Afewresearchquestionsaredened,withnoanswertothem,withthehopethatthediscussionraisedbythequestionswillshedsomelightontothepossibleanswers.
2PreferencemodellingandreasoningPreferenceshavebeenstudiedforalongtimeinAI,bothintheareaofknowledgerepresentationandinmulti-agentsys-tems.
Severalframeworkshavebeendenedtomodeldif-ferentkindsofpreferences,suchasqualitative(asin,e.
g.
,"Ipreferbluetored")andquantitativeones(asin,e.
g.
,"Igive5starstoBreakfastatTiffany'sand2starstoTerminator").
Ingeneralpreferencesaredeninganorderingoverasetofoptions.
Thisordercanbetotalandstrict,butinpracticeitmayhavealotoftiesandincomparability.
Whenthesetofoptionsisverylarge,andeachoptionisdenedbyasetoffeatures(suchasacar,whichcanbede-nedbyitmodel,itscolour,itsengine,etc.
),preferencescanbeexpressedoversinglefeaturesofsmallsetsofthem,ratherthanentireoptions(asin,e.
g.
,"IfIbuyaconvertible,Ipreferittoberedratherthanwhite").
Thisallowsforafasterandeasierpreferencespecicationphase,aswellasformoreef-cientpreferenceelicitation.
Severalwayshavebeendenedtopassfromsuchcompactwaystomodelpreferencesoverfeaturestothepreferenceorderingovertheoptions.
How-ever,itispossibletoreasonaboutsuchpreferenceswithoutgeneratingtheexponentiallylargeorderingovertheoptions,whichmakespreferencesreasoningtractableinsomecases.
Examplesofframeworktodothisareconstraints[Rossietal.
,2006],softconstraints[Mesegueretal.
,2005]andCP-nets[Boutilieretal.
,2004].
Onceanindividual'spreferencesoverthepossibleoptionsarespecied,weneedtobeabletondthemostpreferredoption,orthenextbestoption,ortocomparetwooptionsthatmaybepresentedtous.
Severalalgorithmstoperformssuchtaskshavebeendened[Brafmanetal.
,2010;Boutilieretal.
,2004].
Whenindividuals,orAIsystems,arepartofasocialen-vironmentandneedtomakecollectivedecisions,individ-ual'spreferencesareaggregated(forexampleviasomevot-ingrule)andanoptionischosenforthewholegroup.
Manyvotingruleshavebeendenedandstudied,aswellastheirproperties[Arrowetal.
,2002].
Issuessuchasmanipu-lation,control,bribery,aswellaspropertiessuchasfair-nessandunanimityhavelongbeinginvestigated,inordertodenedecisionsupportsystemsthatbehaveasdesired[Airiauetal.
,2011;Fargieretal.
,2012;Conitzeretal.
,2011;XiaandConitzer,2010;Langetal.
,2007;Pinietal.
,2011;Pozzaetal.
,2011;Gonzalesetal.
,2008;Maranetal.
,2013;PurringtonandDurfee,2007;LangandXia,2009].
3FrompreferencestomoralityTotrustanAIsystem,likeacompanionrobotoraself-drivingcar,weneedtobereasonablysurethatitbehavesmorally,ac-cordingtovaluesthatarealignedtothehumanones.
Other-wise,wewouldnotletarobottakecareofourelderlypeopleorourkids,noracartodriveforus,norwewouldlistentoadecisionsupportsysteminanyhealthcarescenario.
SoitisimperativethatweunderstandhowtoprovideAIsys-temswithmorality[MusschengaandvanHarskamp,2013;WallachandAllen,2009;Greeneetal.
,2016].
Moralityandethicalbehaviourarebasedonprioritisingac-tionsonthebasisofwhatismorallyrightorwrong.
Manyethicaltheorieshavebeendenedandstudiedinthepsychol-ogyliterature.
Theyincludethefollowingones:Consequentialism:Actionconsequencesareevaluatedinternsofascaleofgoodandbad,andanagentshouldchoosetheactionthatminimisethebadandmaximisesthegood.
VirtueEthics:Anagentshouldchooseactionsthatsat-isfysomepre-denedsetofvirtuesDeontologism:Actionsarepredenedasgoodorbad,andanagentshouldchoosethebestaction,nomattertheconsequences.
Nomatterwhichethicaltheoryonedecidestouse,theno-tionofrightandwrongofcoursedependsonthecontextinwhichhumans(ormachines)function,soformallyanethicaltheorycanbedenedasafunctionfromacontexttoapar-tialorderingoveractions.
Indeed,usuallywehaveapartialorderoveractions,sincesomeactionscouldbeincompara-bletoothers.
Asonemaynoticebylookingattheprevioussectiononpreferences,thisisnotthatdifferentfromwhatpreferencesdene:apartialorderoverpossibleoptions(ofactions,ordecisionsingeneral).
Soitmakessensetoinvesti-gatethepossibleuseofpreferenceframeworksinmodellingandembeddingmoralityintoAIsystems.
Researchquestion1:Areexistingpreferencemodellingandreasoningframeworksreadytobeusedalsotomodelandreasonwithethicalprinciplesandmoralcode,orweneedtoadaptthemorinventnewonesIfwehadthe"moral"partialorderandthe"preference"partialorderforeachindividual,onecouldtrytomergetheminsomeway,toobtaina"moralpreferenceordering".
Forex-ample,twoCP-netsmodellingthemoralandthepreferenceorderingscouldbesyntacticallyorsemanticallymergedviaoperatorsthatcouldgiveprioritytothemoralCP-netandletthepreferenceonedictatethebehaviouronlywhenitisnotinconictwiththemoralone.
Thetechnicaldetailshavenotbeenspelledoutyet,butonecouldimagineseveralreason-ablewaysofdoingthis.
Researchquestion2:Givenamoralandanethicalorder-ingoveractions,howtocombinethemGivensuchorder-ingsintheformsofCP-netsorsoftconstraints,orothercom-pactformalismstomodelpreferences,howtocombinethemWhatpropertiesshouldwedesireabouttheircombinationHowever,knowingthepreferencesofanindividualisal-readyadifculttask.
Elicitationandlearningframeworkhavebeeproposedinordertodothatinawaythatismostfaith-fultothe"real"preferencesoftheindividual.
Knowingthemoralorderingofanindividualisevenmoredifcult.
Andthisisevenmoresowhenweareinasocialcontext,sincethismaymakeindividualschangetheirmoralattitudesovertimebecauseofsocialinteraction.
TheexistingapproachestodeneethicalprinciplesinAIsystemsrangefromtryingtocodeethicalprinciplesintheformofrules,tolettingthesystem"learn"suchprinciplesfroma(possiblysupervised)observationofthebehaviourofhumansinsimilarsettings.
SomeAIsystemstrytolistthesetofrulestouseinself-drivingcarstosolveethicaldilemmaslikethetrolleyprob-lem.
However,suchapproachesareusuallynotgeneral,sinceitisunfeasibletoforeseeallpossiblesituationsinaverywidescenario.
Ontheotherhand,otherapproachesuse,forexam-ple,inversereinforcementlearning[NgandRussell,2000]totrytolearnmoralityfromhumanbehaviour.
Ipersonallyfeelthatthebestresultscouldbeobtainedbycombiningthesetwoapproaches,althoughitisnotclearyethowtodoitbest.
Researchquestion3:Howtocombinebottom-uplearningapproacheswithtop-downrule-basedapproachesindeningethicalprinciplesforAIsystemsResearchquestion4:Recently,themostsuccessfulAIsystemsarebasedonstatisticalmachinelearningapproachesthat,bytheirnature,donotprovideanaturalwaytoexplainorjustifytheirdecisions(orsuggestions),northeyassureopti-mality.
Ifweemploythisapproachalsoforembeddingmoral-ityintoamachine,howarewegoingtoprovethatnothingmorallywrongwillhappen4Moralitybymeta-preferencesAsmentionedabove,inasocialcontext,individualprefer-encesaretransformedlittlebylittlebyincorporatingreason-ableelementsfromthesocietalinteractionwithothermem-bersofthegroup.
Thisisoftencalled"reconciliation"ofin-dividualpreferenceswithsocialreason,andtakesplaceinthecontextofcollectivechoice.
Tobeabletodescribethedynamicmovingfromonepreferenceorderingoverthenextone(intime),andtomakesurethatthelaterpreferenceor-deringsareindeedbetterintermsofmorality,oneneedstohaveawaytojudgepreferencesaccordingtosomenotionofgoodandbad(inanyoftheabovementionedethicaltheo-ries).
Indeed,Sen[Sen,1974]claimsthatmoralityrequiresjudgementamongpreferences.
Toaccountforthis,hein-troducedthenotionofmetaranking(thatis,preferencesoverpreferences)whichenablestoformaliseindividualpreferencemodications.
Amoralcodecouldthenbedenedasrankingofpreferencerankings.
Thatis,themoralcodeisdenedbyastructurethat,byemployingnotionssuchasdistance,isabletorankpreferencesaccordingtotheirmoralitylevel.
Thedistanceintrinsicinthemoralcodecanthenbeusefulinmeasuringthedeviationofanysocialorindividualactionfromthemoralcodeitself.
Researchquestion5:Givenamoralcode,inasocialchoicecontext,whereindividualssubmittheirpreferenceor-deringandtheresultisacollectivepreferenceordering,howtomeasurethedeviationofthecollectiveorderingfromamoralcodeAndhowtomeasurethedeviationofindivid-ualsfromacollectivemoralcodeIfanindividualmodiesitspreferenceorderingfromamorallylowtoamorallyhigherordering,weshouldwanttousecollectivedecisionmakingsysteminwhichsuchamoveleadstocollectiveactionsofhighermorality.
Thatis,someformofmonotonicityshouldbedesired.
Researchquestion6:Whichpropertiesshouldbedesiredinamoralpreferenceaggregationenvironment5MoralityinnarrowAIsystemsIn[Greene,2014]itisshownthathumanmoraljudgmentdoesn'tcomefromadedicatedmoralsystem,butitisrathertheproductoftheinteractionofmanygeneral-purposebrainnetworks,eachworkingandbeingusefulinnarrowcontexts.
Soitseemsthathumansneedageneralpurposebraininordertobemoral.
IsittruealsoforAIsystemsResearchquestion7:CannarrowAIsystemsbemoralIfhumansbringalloftheirgeneralintelligencetobearwhenmakingmoraldecisions,evenfairlysimpleones,doesthatthatmeanthatwehavetosolveArticialGeneralIntelligenceinordertoproducesomethinguseful6ConclusionsIntelligentsystemsaregoingtobemoreandmorepervasiveinoureverydaylives.
Tonamejustafewapplications,theywilltakecareofelderlypeopleandkids,theywilldriveforus,andtheywillsuggestdoctorshowtocureadisease.
How-ever,wecannotletthemdoallthisveryusefulandbenecialtasksifwedon'ttrustthem.
Tobuildtrust,weneedtobesurethattheyactinamorallyacceptableway.
Soitisimpor-tanttounderstandhowtoembedmoralvaluesintointelligentmachines.
Existingpreferencemodellingandreasoningframeworkcanbeastartingpoint,sincetheydeneprioritiesoverac-tions,justlikeanethicaltheorydoes.
However,manymoreissuesareinvolvedwhenwemixpreferences(thatareatthecoreofdecisionmaking)andmorality,bothattheindividuallevelandinasocialcontext.
Wehavelistedsomeofthesequestions,hopingthatthisshortpapercangeneratesomean-swers.
References[Airiauetal.
,2011]S.
Airiau,U.
Endriss,U.
Grandi,D.
Porello,andJ.
Uckelman.
Aggregatingdependencygraphsintovotingagendasinmulti-issueelections.
InPro-ceedingsofIJCAI2011,pages18–23,2011.
[Arrowetal.
,2002]K.
J.
Arrow,A.
K.
Sen,andK.
Suzu-mura.
HandbookofSocialChoiceandWelfare.
North-Holland,2002.
[Boutilieretal.
,2004]C.
Boutilier,R.
I.
Brafman,C.
Domshlak,H.
H.
Hoos,andD.
Poole.
CP-nets:Atoolforrepresentingandreasoningwithconditionalceterisparibuspreferencestatements.
JAIR,21:135–191,2004.
[Brafmanetal.
,2010]R.
I.
Brafman,F.
Rossi,D.
Salvagnin,K.
B.
Venable,andT.
Walsh.
Findingthenextsolutioninconstraint-andpreference-basedknowledgerepresen-tationformalisms.
InProceedingsofKR2010,2010.
[Conitzeretal.
,2011]V.
Conitzer,J.
Lang,andL.
Xia.
Hy-percubewisepreferenceaggregationinmulti-issuedo-mains.
InProceedingsofIJCAI2011,pages158–163,2011.
[Fargieretal.
,2012]H.
Fargier,J.
Lang,J.
Mengin,andN.
Schmidt.
Issue-by-issuevoting:anexperimentaleval-uation.
InProceedingsofMPREF2012,2012.
[Gonzalesetal.
,2008]C.
Gonzales,P.
Perny,andS.
Queiroz.
Preferenceaggregationwithgraphicalutilitymodels.
InProceedingsofAAAI2008,pages1037–1042,2008.
[Greeneetal.
,2016]JoshuaGreene,FrancescaRossi,JohnTasioulas,KristenBrentVenable,andBrianWilliams.
Embeddingethicalprinciplesincollectivedecisionsup-portsystems.
InProceedingsAAAI2016.
AAAIPress,2016.
[Greene,2014]JoshuaGreene.
Thecognitiveneuroscienceofmoraljudgmentanddecisionmaking.
InTheCognitiveNeurosciencesV(ed.
M.
S.
Cazzaniga).
MITPress,2014.
[LangandXia,2009]J.
LangandL.
Xia.
Sequentialcompo-sitionofvotingrulesinmulti-issuedomains.
Mathemati-calsocialsciences,57:304–324,2009.
[Langetal.
,2007]J.
Lang,M.
S.
Pini,F.
Rossi,K.
B.
Ven-able,andT.
Walsh.
Winnerdeterminationinsequentialmajorityvoting.
InProceedingsofIJCAI2007,pages1372–1377,2007.
[Maranetal.
,2013]A.
Maran,N.
Maudet,M.
S.
Pini,F.
Rossi,andK.
B.
Venable.
Aframeworkforaggregat-inginuencedCP-netsanditsresistancetobribery.
InProceedingsofAAAI2013,2013.
[Mesegueretal.
,2005]P.
Meseguer,F.
Rossi,andT.
Schiex.
Softconstraints.
InP.
VanBeekF.
RossiandT.
Walsh,editors,HandbookofConstraintProgramming.
Elsevier,2005.
[MusschengaandvanHarskamp,2013]BertMusschengaandAnton(eds.
)vanHarskamp.
WhatMakesUsMoralOnthecapacitiesandconditionsforbeingmoral.
Springer,2013.
[NgandRussell,2000]AndrewY.
NgandStuartRussell.
Algorithmsforinversereinforcementlearning.
InPro-ceedingsoftheSeventeenthInternationalConferenceonMachineLearning.
MorganKaufmann,2000.
[Pinietal.
,2011]M.
S.
Pini,F.
Rossi,K.
B.
Venable,andT.
Walsh.
Incompletenessandincomparabilityinprefer-enceaggregation:Complexityresults.
Artif.
Intell.
,175(7-8):1272–1289,2011.
[Pozzaetal.
,2011]G.
DallaPozza,M.
S.
Pini,F.
Rossi,andK.
B.
Venable.
Multi-agentsoftconstraintaggregationviasequentialvoting.
InProceedingsofIJCAI2011,pages172–177,2011.
[PurringtonandDurfee,2007]K.
PurringtonandE.
H.
Dur-fee.
Makingsocialchoicesfromindividuals'CP-nets.
InProceedingsofAAMAS2007,pages1122–1124,2007.
[Rossietal.
,2006]F.
Rossi,P.
VanBeek,andT.
Walsh.
HandbookofConstraintProgramming.
Elsevier,2006.
[Sen,1974]AmartyaSen.
Choice,orderingandmorality.
InPracticalReason,KrnerS.
(ed).
Oxford,1974.
[WallachandAllen,2009]WendellWallachandColinAllen.
MoralMachines.
Oxford,2009.
[XiaandConitzer,2010]L.
XiaandV.
Conitzer.
Strategy-proofvotingrulesovermulti-issuedomainswithrestrictedpreferences.
InProceedingsofWINE2010,pages402–414,2010.
陆零网络是正规的IDC公司,我们采用优质硬件和网络,为客户提供高速、稳定的云计算服务。公司拥有一流的技术团队,提供7*24小时1对1售后服务,让您无后顾之忧。我们目前提供高防空间、云服务器、物理服务器,高防IP等众多产品,为您提供轻松上云、安全防护 为核心数据库、关键应用系统、高性能计算业务提供云端专用的高性能、安全隔离的物理集群。分钟级交付周期助你的企业获得实时的业务响应能力,助力核心业务飞速成...
企鹅小屋怎么样?企鹅小屋最近针对自己的美国cn2 gia套餐推出了2个优惠码:月付7折和年付6折,独享CPU,100%性能,三网回程CN2 GIA网络,100Mbps峰值带宽,用完优惠码1G内存套餐是年付240元,线路方面三网回程CN2 GIA。如果新购IP不能正常使用,请在开通时间60分钟内工单VPS技术部门更换正常IP;特价主机不支持退款。点击进入:企鹅小屋官网地址企鹅小屋优惠码:年付6折优惠...
RackNerd 商家我们应该是比较熟悉的商家,速度一般,但是人家便宜且可选机房也是比较多的,较多集中在美国机房。包括前面的新年元旦促销的时候有提供年付10美元左右的方案,实际上RackNerd商家的营销策略也是如此,每逢节日都有活动,配置简单变化,价格基本差不多,所以我们网友看到没有必要囤货,有需要就选择。RackNerd 商家这次2022农历新年也是有几款年付套餐。低至RackNerd VPS...
1377.com为你推荐
12306崩溃iphone 12306网络错误同ip网站一个域名能对应多个IP吗seo优化工具SEO优化神器有什么比较好的?sss17.com一玩棋牌吧(www.17wqp.com)怎么样?51sese.com谁有免费看电影的网站?www.kanav001.com跪求下载[GJOS-024] 由愛可奈 [Kana Yume] 現役女子高生グラビア种子的网址谁有www.544qq.COM跪求:天时达T092怎么下载QQwww.se222se.com请问http://www.dibao222.com这个网是做什么99nets.com制作网络虚拟证件的网站 那里有呀?广告法中国的广告法有哪些。
3322免费域名 主机测评网 simcentric linode sugarsync idc评测网 gomezpeer 京东商城双十一活动 坐公交投2700元 什么是刀片服务器 刀片服务器的优势 php空间推荐 双11秒杀 1g空间 空间租赁 西安服务器托管 国外在线代理服务器 个人免费邮箱 摩尔庄园注册 标准机柜 更多