IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksWebInterfacetoRforHigh-PerformanceComputingJunjiNAKANOEi-jiNAKAMATheInstituteofStatisticalMathematics,JapanCOM-ONELtd.
,JapanTheRUserConference2009July8-10,Agrocampus-Ouest,Rennes,FranceIntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarks1Introduction2Rdwebsystem3Examplesofexecution4InstallingRdweb5ConcludingremarksIntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksRandrequirementforhugecalculationR:afreesoftwareenvironmentforstatisticalcomputingandgraphicsforstatisticianstoimplementnewstatisticalmethodspractitionerstoanalyzerealdatasetsinvariouseldsRecently,bothusersrequirehugeamountofcalculationfortheirownpurposesParallelcomputingisapracticalmethodforrealizinghugecalculationbyexecutingcalculationsonseveralcomputersand/ormanyCPUcoresatthesametimeIntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksParallelcomputingtechniquesonRParallelBLAS(BasicLinearAlgebraSubprograms)usingthreadsATLASFreeparallelandoptimizedBLASGotoBLASFastestparallelandoptimizedBLASIntelMKL,AMDACMLParallelandoptimizedBLASprovidedbyvendersMPItypelibrariesforRusingclusteredcomputersRpvmanRinterfacetoPVM(ParallelVirtualMachine)RmpianRinterfacetoMPI(MessagePassingInterface)snow(SimpleNetworkofWorkstations)ApackageforrealizingparallelcomputingbyparallelapplyfunctionsUsinglowerlevelparallellibrariessuchasSocket,MPI,PVM,nwsfortransferringdataamongprocessesAsitconcealsdierenceoflowerlevellibraries,itiseasytouseforparallelcomputing.
multicoreRunningparallelcomputationsinRonmachineswithmultiplecoresorCPUs.
.
.
.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksExistingWebenvironmentsforRRwebAWebbasedinterfacetoRforsubmittingthecodeRpadAworkbook-styleuserinterfacetoRthroughaWebbrowserrapacheEmbeddingRintheApacheWebserverRserveTCP/IPserverthatallowsotherprogramstousefacilitiesofRRWebServicesExposingRfunctionsasWebservicesthroughJava/Axis/Apache.
.
.
Parallelcomputingisnotthemainconcernoftheseprograms.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksSupercomputersinISMWehavethreesupercomputersystemsintheInstituteofStatisticalMathematics(ISM),Japan.
(Wewillreplacethemnextyear.
)Presentsupercomputersprovideparallelcomputingfacilities.
WeuseRonoursupercomputers.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksOurproblemsTroublesEachsupercomputerusesdierent(Unix-like)environment.
Unix-likeenvironmentsarenoteasytousefornovices.
Severalparametersforparallelcomputingneedtobespecieddierentlyforeachsupercomputer.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksOursolutionApproach:WebinterfaceWehavemade"Rdweb",aWebinterfacetoRforusingparallelcomputingfunctionsinRIntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksStructureofRdwebRdweb(RdaemonforWeb)systemconsistsofthreecomponents:Webinterface(viaWebbrowseronuser'scomputer)ItisrathersimpleandprogrammedbyHTMLandJavaScript.
JavaScriptisusedtoassistusers'inputslightly.
Webserver(onRdwebgatewaycomputer)ItisaCGIprogramforauthentication,letransfer,jobcontrol(start,stopandcheck),creationofJCL(JobControlLanguage)scriptandscatteringtheprogramtoremotecomputersasaclientofRdaemonRdaemon(onthefront-endcomputerofclustersystem)Itchecksauthentication,transfersrequiredles,startsandendsjobs,andshowsthestatus.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksCharacteristicsofRdwebRdwebisdesignedforsupercomputersandpersonalPCclustersystems.
AbovestatedthreecomponentsofRdwebandRslavescanresideondierentorsamecomputers.
Text-basedWebbrowserscanbeused(withalittlelimitation).
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksRdwebonsupercomputersinISMShared-MemoryDistributed-MemoryIntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksDierencesbetweenRwebandRdwebFromtheuserside,RdwebissimilartoRweb.
Rdwebcancontrolsystemresourcessuchasuser,CPU,memoryandqueue.
AlthoughRwebdoesnotallowtheuseof"system"commandfromthesecurityreason,RdwebdoesnothavesuchlimitationbecauseRdwebhasrigidauthenticationmechanism.
RwebandRdwebRwebRdwebAuthenticationnonePAM,NISorUnixpasswardFileuploadoneleAlotoflesControlofparallelBLASimpossibleEachsessionControlofsnowimpossibleEachsessionIntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksAuthenticationofRdweb(1)-WebserverRdwebadoptstwoauthenticationstages.
FirststageutilizesWebserverauthenticationmechanismwhentheuserisconnectedtotheWebserveronthegatewaycomputer.
ThemechanismisrealizedbymodauthpamofApache.
sites-enabledOptions.
.
.
.
AllowOverrideNoneOrderallow,denyAllowfromallAuthPAM_EnabledonAuthTypeBasicAuthName"RdwebUserLogin"Requirevalid-userIntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksAuthenticationofRdweb(2)-RdaemonAssecondstageofRdwebauthentication,RdaemonutilizesauthenticationmethodssuchasPAM(recommended),NISandUnixpassword.
WecanselectoneofthemwhenwecompileRdwebsystem.
CookiemustbeenabledintheWebbrowserforWebinterfaceofRdweb.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksPAMauthenticationPAM(PluggableAuthenticationModules)istheAPIforauthenticationusedinLinux,Solaris,MacOSXandAIX(5.
3orlater).
PAMusesNISorLDAPorUnixpassword.
IfPAMisnotavailable,NISorUnixpasswordcanbedirectlyusedforauthenticationinRdaemon.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksLocationofles"Rdweb"directoryiscreatedinthehomedirectoryonthefront-end.
Directoryforexecutionis/Rdweb/Uploadedlesarealsostoredin/Rdweb/Logsandscriptsarestoredin/Rdweb/YYYYMMDDhhmmss/whereYYYYMMDDhhmmssshowsyear,month,day,hour,minuteandsecond,accordingtotheISO-8601dateformat.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksUploadinglesTouploaddataand/orprogramles,weclick"Choose"button,selectale,andclick"upload"button.
Theseoperationscanberepeatedwithoutaectingeditedscriptandotherfunctions.
SCPorSFTPclientssuchasFilezillaclientarerecommendedforuploadinglargelesbecauseHTTPuploadsometimescausestimeoutandstops.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksPreparingdataandprogramByusingatexteditor,wepreparethefollowingdatale.
HW.
csvheight,weight1.
70,651.
85,801.
75,86Savethisleas"HW.
csv".
WealsoprepareRprogramBMI.
RBMI<-function(H,W){W/H^2}andsaveitas"BMI.
R".
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksInputUploadtwoles"HW.
csv"and"BMI.
R".
TheninputthefollowingRprograminputtextareaHW<-read.
csv("HW.
csv")source("BMI.
R")HWB<-cbind(HW,BMI=BMI(HW$height,HW$weight))HWBplot(HWB)intheeditorareaofWebinterfacewhichisconnectedtoRdwebgateway.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksExecutionJobisstartedbyclicking"Execute"button.
Jobstatusisshownin"JOBInformation".
Jobinformationisrefreshedbyclicking"Refresh"buttonortoptitle.
Resultsofcalculationarestoredasleswithextensions.
Rout(textformat)and.
pdf(pdfGraphics).
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksUseofsnowUsuallyinR,wehavetospecifythenumberofprocessesdierentlyaccordingtotheclustertype.
makeClusternormal#SOCKclustercl<-makeCluster(c("hostname1","hostname2"))#MPIclusterwith2slaveprocessescl<-makeCluster(2)Weaddnewfunction"setDefaultClusterOptions"touseparametersgivenintheWebinterfaceinthesamewayforallclustertypes.
makeClusterRdwebcl<-makeCluster(getClusterOption("spec"))IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksSelectionofparametersforparallelcomputingWeneedtoselectqueue,numberofslaveprocesses,numberofthreadsofparallelBLAS,andclustertypebyusingpull-downmenusinthisorder.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksExecutionJobisstartedbyclicking"Execute"button.
Creationofnewresultlesisshownbyclicking"Refresh"button.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksBatchsystemRdwebrequiresabatchsystem.
Severalbatchsystemsareavailable.
at,batchStandardbatchsystemofUnixspeciedinXPG4(X/OpenportabilityguideVer.
4).
Ithassimplequeuemechanism.
OpenPBS(NASAetc.
)Queuingandschedulingcontrolsystemforclustersystems.
Developmentstoppedin1998.
Torque(ClusterResourceInc.
)FreesystembasedonOpenPBSLoadLeveler(IBM)BatchsystembyavenderLSF(PlatformComputingInc.
)CommercialjobcontrollingtoolSLURMFreeresourcecontrolutilityIntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksPlatformsRdwebshouldworkonalmostallUnix-likeOSs.
WehavecheckedthefollowingsystemsinISMandCOM-ONE.
MPIOSBATCHSYSTEMHP-MPILinuxLSF+slurmLAM-MPILinuxTorqueOpenMPILinuxTorqueLAM-MPILinuxOpenPBSLAM-MPILinuxatLAM-MPISolarisatLAM-MPIAIXLoadLevelerLAM-MPIMacOSXatNote:Installationofthesebatchsystemsissometimescomplicated.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksInstallationWekeepsourcecodesofRdwebathttp://prs.
ism.
ac.
jp/~nakama/rdweb/RequiredinstallationprocedurePreparetheskeletonoftheshellletoafront-endDenethesysteminformationonWebserverTheydependheavilyontheclustersystem.
Detailsofthesettinginformationcanbeseenin"README"leinRdwebarchive.
WeputrequiredpackagesforDebianGNU/Linux(Lenny)athttp://prs.
ism.
ac.
jp/~nakama/debian/lenny-ism/.
TheyincludehelperpackagesforGotoBLAS,Torque,andpackagesoflam-mpiandopenmpiforTorque.
(Unfortunately,thesearestillbuggy.
).
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksExamplesinISM(1)IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksExamplesinISM(2)IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksConcludingremarksAdvantagesofRdwebNovicescanuseparallelexecutionfunctionsofwithlesseorts.
NumberofparallelexecutioncanbespeciedeasilyforparallelBLASandsnow.
SecureauthenticationisavailablebyPAMwhichcanuseLDAPorNIS.
DisadvantagesofpresentRdwebSysteminstallationiscomplicatedandcompletelyplatformdependentFutureworkEncryptingcommunicationbetweenWebserverandRdaemonPortingtovariousRRwithmanyBLASsRcompiledbyseveralcompilersRonmanyOSs
paypal贝宝可撸$10的代金券!这两天paypal出了活动,本次并没有其他的限制,只要注册国区的paypal,使用国内的手机号和62开头的银联卡,就可以获得10美元的代金券,这个代金券购买产品需要大于10.1美元,站长给大家推荐几个方式,可以白嫖一年的VPS,有需要的朋友可以看看比较简单。PayPal送10美元活动:点击直达活动sfz与绑定卡的号码可以重复用 注册的邮箱,手机号与绑的银联卡必须...
快云科技怎么样?快云科技是一家成立于2020年的新起国内主机商,资质齐全 持有IDC ICP ISP等正规商家。云服务器网(yuntue.com)小编之前已经介绍过很多快云科技的香港及美国云服务器了,这次再介绍一下新的优惠方案。目前,香港云沙田CN2云服务器低至29元/月起;美国超防弹性云/洛杉矶CUVIP低至33.6元/月起。快云科技的云主机架构采用KVM虚拟化技术,全盘SSD硬盘,RAID10...
创梦网络怎么样,创梦网络公司位于四川省达州市,属于四川本地企业,资质齐全,IDC/ISP均有,从创梦网络这边租的服务器均可以****,属于一手资源,高防机柜、大带宽、高防IP业务,另外创梦网络近期还会上线四川眉山联通、广东优化线路高防机柜,CN2专线相关业务。广东电信大带宽近期可以预约机柜了,成都优化线路,机柜租用、服务器云服务器租用,适合建站做游戏,不须要在套CDN,全国访问快,直连省骨干,大网...
filezillaclient为你推荐
乐划锁屏乐视屏幕手机解锁忘记但是指纹可以解开怎么办?h连锁酒店世界知名的连锁酒店有哪些?嘉兴商标注册我在濮院想注册一个羊毛衫商标?该怎么做?陈嘉垣反黑阿欣是谁演的 扮演者介绍杰景新特萨克斯吉普特500是台湾原产的吗haole018.com为什么www.haole008.com在我这里打不开啊,是不是haole008换新的地址了?www.299pp.com免费PP电影哪个网站可以看啊5566.com5566网址大全www.175qq.com最炫的qq分组www.1diaocha.com哪个网站做调查问卷可以赚钱 啊
万网域名注册 中文域名注册 万网域名代理 dreamhost 免费cdn加速 美国php主机 dropbox网盘 云图标 数字域名 什么是刀片服务器 699美元 hktv 怎么建立邮箱 万网主机管理 石家庄服务器托管 新加坡空间 美国服务器 瓦工工具 八度空间论坛 qq空间排行榜 更多