IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksWebInterfacetoRforHigh-PerformanceComputingJunjiNAKANOEi-jiNAKAMATheInstituteofStatisticalMathematics,JapanCOM-ONELtd.
,JapanTheRUserConference2009July8-10,Agrocampus-Ouest,Rennes,FranceIntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarks1Introduction2Rdwebsystem3Examplesofexecution4InstallingRdweb5ConcludingremarksIntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksRandrequirementforhugecalculationR:afreesoftwareenvironmentforstatisticalcomputingandgraphicsforstatisticianstoimplementnewstatisticalmethodspractitionerstoanalyzerealdatasetsinvariouseldsRecently,bothusersrequirehugeamountofcalculationfortheirownpurposesParallelcomputingisapracticalmethodforrealizinghugecalculationbyexecutingcalculationsonseveralcomputersand/ormanyCPUcoresatthesametimeIntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksParallelcomputingtechniquesonRParallelBLAS(BasicLinearAlgebraSubprograms)usingthreadsATLASFreeparallelandoptimizedBLASGotoBLASFastestparallelandoptimizedBLASIntelMKL,AMDACMLParallelandoptimizedBLASprovidedbyvendersMPItypelibrariesforRusingclusteredcomputersRpvmanRinterfacetoPVM(ParallelVirtualMachine)RmpianRinterfacetoMPI(MessagePassingInterface)snow(SimpleNetworkofWorkstations)ApackageforrealizingparallelcomputingbyparallelapplyfunctionsUsinglowerlevelparallellibrariessuchasSocket,MPI,PVM,nwsfortransferringdataamongprocessesAsitconcealsdierenceoflowerlevellibraries,itiseasytouseforparallelcomputing.
multicoreRunningparallelcomputationsinRonmachineswithmultiplecoresorCPUs.
.
.
.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksExistingWebenvironmentsforRRwebAWebbasedinterfacetoRforsubmittingthecodeRpadAworkbook-styleuserinterfacetoRthroughaWebbrowserrapacheEmbeddingRintheApacheWebserverRserveTCP/IPserverthatallowsotherprogramstousefacilitiesofRRWebServicesExposingRfunctionsasWebservicesthroughJava/Axis/Apache.
.
.
Parallelcomputingisnotthemainconcernoftheseprograms.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksSupercomputersinISMWehavethreesupercomputersystemsintheInstituteofStatisticalMathematics(ISM),Japan.
(Wewillreplacethemnextyear.
)Presentsupercomputersprovideparallelcomputingfacilities.
WeuseRonoursupercomputers.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksOurproblemsTroublesEachsupercomputerusesdierent(Unix-like)environment.
Unix-likeenvironmentsarenoteasytousefornovices.
Severalparametersforparallelcomputingneedtobespecieddierentlyforeachsupercomputer.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksOursolutionApproach:WebinterfaceWehavemade"Rdweb",aWebinterfacetoRforusingparallelcomputingfunctionsinRIntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksStructureofRdwebRdweb(RdaemonforWeb)systemconsistsofthreecomponents:Webinterface(viaWebbrowseronuser'scomputer)ItisrathersimpleandprogrammedbyHTMLandJavaScript.
JavaScriptisusedtoassistusers'inputslightly.
Webserver(onRdwebgatewaycomputer)ItisaCGIprogramforauthentication,letransfer,jobcontrol(start,stopandcheck),creationofJCL(JobControlLanguage)scriptandscatteringtheprogramtoremotecomputersasaclientofRdaemonRdaemon(onthefront-endcomputerofclustersystem)Itchecksauthentication,transfersrequiredles,startsandendsjobs,andshowsthestatus.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksCharacteristicsofRdwebRdwebisdesignedforsupercomputersandpersonalPCclustersystems.
AbovestatedthreecomponentsofRdwebandRslavescanresideondierentorsamecomputers.
Text-basedWebbrowserscanbeused(withalittlelimitation).
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksRdwebonsupercomputersinISMShared-MemoryDistributed-MemoryIntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksDierencesbetweenRwebandRdwebFromtheuserside,RdwebissimilartoRweb.
Rdwebcancontrolsystemresourcessuchasuser,CPU,memoryandqueue.
AlthoughRwebdoesnotallowtheuseof"system"commandfromthesecurityreason,RdwebdoesnothavesuchlimitationbecauseRdwebhasrigidauthenticationmechanism.
RwebandRdwebRwebRdwebAuthenticationnonePAM,NISorUnixpasswardFileuploadoneleAlotoflesControlofparallelBLASimpossibleEachsessionControlofsnowimpossibleEachsessionIntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksAuthenticationofRdweb(1)-WebserverRdwebadoptstwoauthenticationstages.
FirststageutilizesWebserverauthenticationmechanismwhentheuserisconnectedtotheWebserveronthegatewaycomputer.
ThemechanismisrealizedbymodauthpamofApache.
sites-enabledOptions.
.
.
.
AllowOverrideNoneOrderallow,denyAllowfromallAuthPAM_EnabledonAuthTypeBasicAuthName"RdwebUserLogin"Requirevalid-userIntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksAuthenticationofRdweb(2)-RdaemonAssecondstageofRdwebauthentication,RdaemonutilizesauthenticationmethodssuchasPAM(recommended),NISandUnixpassword.
WecanselectoneofthemwhenwecompileRdwebsystem.
CookiemustbeenabledintheWebbrowserforWebinterfaceofRdweb.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksPAMauthenticationPAM(PluggableAuthenticationModules)istheAPIforauthenticationusedinLinux,Solaris,MacOSXandAIX(5.
3orlater).
PAMusesNISorLDAPorUnixpassword.
IfPAMisnotavailable,NISorUnixpasswordcanbedirectlyusedforauthenticationinRdaemon.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksLocationofles"Rdweb"directoryiscreatedinthehomedirectoryonthefront-end.
Directoryforexecutionis/Rdweb/Uploadedlesarealsostoredin/Rdweb/Logsandscriptsarestoredin/Rdweb/YYYYMMDDhhmmss/whereYYYYMMDDhhmmssshowsyear,month,day,hour,minuteandsecond,accordingtotheISO-8601dateformat.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksUploadinglesTouploaddataand/orprogramles,weclick"Choose"button,selectale,andclick"upload"button.
Theseoperationscanberepeatedwithoutaectingeditedscriptandotherfunctions.
SCPorSFTPclientssuchasFilezillaclientarerecommendedforuploadinglargelesbecauseHTTPuploadsometimescausestimeoutandstops.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksPreparingdataandprogramByusingatexteditor,wepreparethefollowingdatale.
HW.
csvheight,weight1.
70,651.
85,801.
75,86Savethisleas"HW.
csv".
WealsoprepareRprogramBMI.
RBMI<-function(H,W){W/H^2}andsaveitas"BMI.
R".
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksInputUploadtwoles"HW.
csv"and"BMI.
R".
TheninputthefollowingRprograminputtextareaHW<-read.
csv("HW.
csv")source("BMI.
R")HWB<-cbind(HW,BMI=BMI(HW$height,HW$weight))HWBplot(HWB)intheeditorareaofWebinterfacewhichisconnectedtoRdwebgateway.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksExecutionJobisstartedbyclicking"Execute"button.
Jobstatusisshownin"JOBInformation".
Jobinformationisrefreshedbyclicking"Refresh"buttonortoptitle.
Resultsofcalculationarestoredasleswithextensions.
Rout(textformat)and.
pdf(pdfGraphics).
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksUseofsnowUsuallyinR,wehavetospecifythenumberofprocessesdierentlyaccordingtotheclustertype.
makeClusternormal#SOCKclustercl<-makeCluster(c("hostname1","hostname2"))#MPIclusterwith2slaveprocessescl<-makeCluster(2)Weaddnewfunction"setDefaultClusterOptions"touseparametersgivenintheWebinterfaceinthesamewayforallclustertypes.
makeClusterRdwebcl<-makeCluster(getClusterOption("spec"))IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksSelectionofparametersforparallelcomputingWeneedtoselectqueue,numberofslaveprocesses,numberofthreadsofparallelBLAS,andclustertypebyusingpull-downmenusinthisorder.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksExecutionJobisstartedbyclicking"Execute"button.
Creationofnewresultlesisshownbyclicking"Refresh"button.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksBatchsystemRdwebrequiresabatchsystem.
Severalbatchsystemsareavailable.
at,batchStandardbatchsystemofUnixspeciedinXPG4(X/OpenportabilityguideVer.
4).
Ithassimplequeuemechanism.
OpenPBS(NASAetc.
)Queuingandschedulingcontrolsystemforclustersystems.
Developmentstoppedin1998.
Torque(ClusterResourceInc.
)FreesystembasedonOpenPBSLoadLeveler(IBM)BatchsystembyavenderLSF(PlatformComputingInc.
)CommercialjobcontrollingtoolSLURMFreeresourcecontrolutilityIntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksPlatformsRdwebshouldworkonalmostallUnix-likeOSs.
WehavecheckedthefollowingsystemsinISMandCOM-ONE.
MPIOSBATCHSYSTEMHP-MPILinuxLSF+slurmLAM-MPILinuxTorqueOpenMPILinuxTorqueLAM-MPILinuxOpenPBSLAM-MPILinuxatLAM-MPISolarisatLAM-MPIAIXLoadLevelerLAM-MPIMacOSXatNote:Installationofthesebatchsystemsissometimescomplicated.
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksInstallationWekeepsourcecodesofRdwebathttp://prs.
ism.
ac.
jp/~nakama/rdweb/RequiredinstallationprocedurePreparetheskeletonoftheshellletoafront-endDenethesysteminformationonWebserverTheydependheavilyontheclustersystem.
Detailsofthesettinginformationcanbeseenin"README"leinRdwebarchive.
WeputrequiredpackagesforDebianGNU/Linux(Lenny)athttp://prs.
ism.
ac.
jp/~nakama/debian/lenny-ism/.
TheyincludehelperpackagesforGotoBLAS,Torque,andpackagesoflam-mpiandopenmpiforTorque.
(Unfortunately,thesearestillbuggy.
).
IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksExamplesinISM(1)IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksExamplesinISM(2)IntroductionRdwebsystemExamplesofexecutionInstallingRdwebConcludingremarksConcludingremarksAdvantagesofRdwebNovicescanuseparallelexecutionfunctionsofwithlesseorts.
NumberofparallelexecutioncanbespeciedeasilyforparallelBLASandsnow.
SecureauthenticationisavailablebyPAMwhichcanuseLDAPorNIS.
DisadvantagesofpresentRdwebSysteminstallationiscomplicatedandcompletelyplatformdependentFutureworkEncryptingcommunicationbetweenWebserverandRdaemonPortingtovariousRRwithmanyBLASsRcompiledbyseveralcompilersRonmanyOSs
GigsGigsCloud新上了洛杉矶机房国际版线路VPS,基于KVM架构,采用SSD硬盘,年付最低26美元起。这是一家成立于2015年的马来西亚主机商,提供VPS主机和独立服务器租用,数据中心包括美国洛杉矶、中国香港、新加坡、马来西亚和日本等。商家VPS主机基于KVM架构,所选均为国内直连或者优化线路,比如洛杉矶机房有CN2 GIA、AS9929或者高防线路等。下面列出这款年付VPS主机配置信息...
上次部落分享过VirMach提供的End of Life Plans系列的VPS主机,最近他们又发布了DEDICATED MIGRATION SPECIALS产品,并提供6.5-7.5折优惠码,优惠后最低每月27.3美元起。同样的这些机器现在订购,将在2021年9月30日至2022年4月30日之间迁移,目前这些等待迁移机器可以在洛杉矶、达拉斯、亚特兰大、纽约、芝加哥等5个地区机房开设,未来迁移的时...
麻花云在7月特意为主机测评用户群定制了促销活动:香港宽频CN2云服务器、安徽移动云服务器(BGP网络,非单线,效果更好)、安徽移动独立服务器、安徽电信独立服务器,全部不限制流量,自带一个IPv4,默认5Gbps的DDoS防御。活动链接:https://www.mhyun.net/act/zjcp特价云服务器不限流量,自带一个IPv4,5Gbps防御香港宽频CN2全固态Ⅲ型 4核4G【KVM】内存:...
filezillaclient为你推荐
广东GDP破10万亿中国GDP10万亿,广东3万亿多。占了中国三分之一的经纪。如果,我是说如果。广东独立了。中国会有什18comic.fun黑色禁药http://www.lovecomic.cn/attachment/Fid_18/18_4_00d3b0cb502ea74.jpg这幅画名字叫什么?22zizi.comwww 地址 didi22怎么打不开了,还有好看的吗>com原代码源代码是什么意思啊百度关键词分析百度竞价关键词分析需要从哪些数据入手?网站检测请问,对网站进行监控检测的工具有哪些?同一服务器网站一个服务器能运行多少个网站ip在线查询通过对方的IP地址怎么样找到他的详细地址?mole.61.com摩尔庄园的米米号和密码我都忘了 只记得注册的邮箱 怎么办-_-avtt4.comCOM1/COM3/COM4是什么意思??/
云服务器租用 cn域名注册 美国加州vps lamp安装 华为云服务 godaddy主机 42u机柜尺寸 阿里云代金券 服务器怎么绑定域名 镇江联通宽带 河南服务器 怎么测试下载速度 seednet admit的用法 架设邮件服务器 西安服务器托管 114dns 七十九刀 美国主机侦探 带宽测速 更多