ResearchonmassivedatastorageinvirtualroamingsystembasedonRAID5RANFeipeng,DAIHuayang,XINGWujie,WANGXiang,LiXuesongCollegeofGeoscienceandSurveyingEngineering,ChinaUniversityofMining&Technology,Beijing100083,ChinaKeywords:virtualroamingsystem,RAID5,PDSS,panoramicdataAbstract.
AmassivedatamanagementmethodwasproposedbasedonRAID5againstlimitationsofdataexpansion,andalackofautomaticdatarecoverycapabilityincurrentvirtualroamingsystem:thepanoramicdataisseparatedfromtheroamingsystemasanindependentpanoramicdataservicesystem(PDSS),anddistributedtomultiplenodestoperformanceparallelservicetakingadvantageofdiskparallelismofRAID5.
Inthisway,wecanenhancethedatastoragecapacityandfaulttoleranceoftheserverinalargeextend.
Finally,aprototypevirtualroamingsystemwasdesignedbasedonPDSS.
Theresultsshowedthatthismethodhadagoodapplicationprospect.
IntroductionVirtualroamingtechnologybasedonthePanoramaandcombinedwiththeadvantageofGISisanimportantapproachtorealizethevisualizationofGIS[1]-[2].
Withthecontinuousarealexpansioncoveredbythevirtualroamingandgreaterdetailedpanoramaspatialinformation,thestoragenodesindatacenterunderthemassivedatastorageenvironmentareverylarge,itsefficiencyandfaulttoleranceinfluencetheefficiencyandstabilityofvirtualroamingsystem.
Itisdifficulttomeetthepracticaldemands[3],thoughtherearesomesolutionssuchasdatacompressionortheimprovementofthebroadbandtoreleasethepressureoftheserver.
Thesemethodsarenotthebestwaytosolvetheseproblems,becausetheP2Pstructurehasalargenumberofnodesandcomplexencryptionalgorithm[4]-[5].
RedundantArraysofIndependentDisks(RAID)[6]putsapluralityofdiskstogethertoformaunifiedlogicalstoragedevice,thecommonmethodsofwhichwerediskimaging,stripinganderrorcorrection[7].
Forexample,RAID5scattersdatastoredindifferentdisksarraysforthepurposeofmassivestorageandhightransmissionrate,datasecurityandstoragecost,soithasbeenwidelyused[8]-[9].
Inthispaper,anewmethodwasproposedtosolvethemassivedataprobleminvirtualroamingsystembasedonRAID5.
Datastoragestructureandfault-toleranceMechanismTakingonesectionoftheroadforexample,supposingthatthereareipanoramicdataandnisomorphiccorrespondingstorageunits,thethroughputisk.
Theloadingtimeisdifferunderthesamenetworkduetothedifferentsizeofthepanoramicdata,named12,,.
.
.
nttt,thewholeloadingtimeis12,,.
.
.
nTttt=;theaveragenumberoftherequestingaccessisλ,theoretically,therejectionrateis:1(1)rrNTkTrλ1)Nrrepresentsthenumberofdatarejections,Trthetotalaccesstime.
Therefore,toreducetherejectionrateρ,weneedtoreduceT.
Ifthepanoramicdataarestoredonndifferentstorageunits,theservicetimeofeachunitswouldreducetoT/n,theacceptancesuccessfulrequestratewouldrisefromk/(1+λ*T)uptok/(1+λ*T/n),whichmeansthattheactualparallelismoftheapplicationserverisnearlyntimescomparedtosingledisk.
Hence,inordertoimprovedataservicesperformance,aserverstructurewasadoptedwhichissimilartothefeaturesofRAID5[6].
AsisshowninFig1,thepanoramicdataisseparatedfromtheroamingsystemanddistributedtomultiplenodestoestablishadataserverconnectedbyhighspeednetworkbetweenservicenodesandcontrolnodes.
Theservicenodesareusedtodynamicallystorepanoramicdata,whilethecontrolnodesusedtoresponsetotherequestfromtheroamingsystemtoassigntheservicenode.
Datanodesstoreandsendthedatatoservicenodesviathehighspeednetworkaccordingtotheinstructionfromtheservicenodes.
Fig.
1StructureofclusteredparallelpanoramicdataservicesystemTheFig.
2showsthepanoramadataunitandtheparityunitblock.
Ineachrow,Prepresentsparitysectioninformation,andthedataineachnodearestoredintheremainingmodules.
ThepanoramadataaredividedintoseveralStripeUnit,andarowdataunitandverificationunitsarecombinedintoonestripe.
Thelocalpanoramadataarestoredindataunit,andtheparityunitwhichisusefulindatarecoveryisusedtostoreinformationonothernodes.
Wetakeadvantageofrandomallocationalgorithmtoassignthepanoramadata,inotherwords,thestorageunitaredepositedtoeachnodethroughapseudorandomfunctiontosolvetheproblemofnodeoverload.
Fig.
2StorageconfigurationforparallelpanoramicdataThedataandthesystemareoftencombinedtogetherintraditionalvirtualroamingsystemwhichwillreducethestabilityandfaulttolerance,thatistosaythewholesystemwillbeparalyzedoncefatalerrorordiskdamageoccursonthelocalserver.
EVENODDcode[10]isadualfault-tolerancecodingalgorithmwhichiscommonlyusedinarraystoragesystem.
Iftheerroroccursonanytwodisks,theredundantinformationoftwodisksinthesystemwillbeincreasedtorecoverthelostdata.
EVENODDcodeisbasedonthearrayof(p-1)*(p+2),andthefirstPcolumnsisusedtostorerawdata,andthelasttwocolumnswhichisthecheckingcolumnisusedtostoretheredundancycheckingdata.
di,j(0≤i≤p-2,0≤j≤p+1)representsthelineidataofdiskj,ThecolumnPiscalledforrow-bestcheckingcolumn.
Thecheckingblockdi,pwasgainedbyexclusiveORoperationwithalltheoriginaldatainthelinei;Thep+1columnisdiagonal-bestcheckinglist,wecangetthecheckingblockthroughtheexclusiveorbetweentheregulatorsandthecorrespondingrawdatablocks.
Thestructuralformulaisasfollows:1,,0pijijjdd==(2))(,101,jjipjpipdsd>Similarly,therow-bestcheckingcolumnisusedforrecoveringthedataindamageddisk.
Iferroroccurredoncheckingdisk,alldataindisksshouldbereadtorecoveritaccordingtotheformula(2)-(4).
ThevirtualroamingsystembasedonPDSSThelogicalstructuredesign.
AsisshowninFig3,thesystemconsistsofimageprocessingsubsystem,parallelledstoragesubsystemandvirtualroamingsubsystem.
ThevirtualroamingsystemconsistsofIFRAMmoduleandGISmodulewhichisresponsibleforspatialinformationdisplay,query,analysisandoutput.
Thispaperusethemethodinreference[11],whichtransmitsthepanoramicdatatovirtualroamingsystemasthesourceofIFRAM,meanwhilethepanoramicdataservicesystemwillbelinkedtogetherwiththevirtualroamingsystem.
Thispaperonlydiscussthestoragemethodofpanoramicdata,sothestoragemethodaboutgeographicdatawillnotbediscussed.
Fig.
3FrameworkofthesystemfunctionsDesignofSystemFunctionModule.
Fromthepractical,easyoperabilityandotherprinciples,thesystemisdividedintoninemodulesincludingdocumentmanagement,mapoperation,layersettings,tools,geographicanalysis,datamanagement,imageediting,visualfieldlabelsandoutput,asshowninFig4.
Thesystemwillloadthecorrespondingpanoramicviewwhenauserchoosethestartpointandendpointalongtheroadintheelectronicroamingmap,atthesametime,panoramicviewcanbesetindependentlyintheimportantregion.
Thesysteminterfaceincludesdisplaywindow,electronicnavigationmapandviewcontroltoolbar.
Fig.
4FrameworkofthesystemfunctionsSystemperformanceanalysisTheperformanceofPDSShasadirecteffectonwholeroamingsystem.
Wearetoevaluatethesystemperformanceseparatelyfromthroughputrate,reliabilityandresponsetime.
WeSelected80harddiskswiththecapacityis80GB(theharddrivespeedis10000RPM,channelseekingtimeVirtualSpaceSystemGISbasicfunctionsSpatialDatabaseManagementSpatialinformationqueryDataOutputIFRAMEComponentsImageprocessingsubsystemRealdataservicesystemURLURLImageacquisitionImageprocessingGeneratingpanoramaDataconversionFileMapLayersToolsGeographiclDataVisionlblOutputTheimage-basedvirtualspacesystemLoadCloseSaveSaveasPrintExitZoominZoomoutPanFullViewPointlayerrenderingLinelayerrenderingArealayerrenderingRasterlayerrenderingVisionadjustmentScenerotationWalkingsimulationDirectionalradarPauseShortestpathanalysisBufferanalysisTimingAnalysisAddrealdataDeleterealdataAddimagearrayDeleteimagearrayStationsHospitalBusStationHotelShoppingFitnessExportingSWFExportImageExportingPDFMapOutputPrintis5ms,therateofdatatransmissionis200MB/sec),SCSI/FCinterface,MTBF1200000h,and16paritygroups.
Datathroughput.
Throughputrepresentsthespeedofdatatransmissioninstoragesystem,whichusedtobeexpressedintwoways:I/Orateanddatatransferrate.
ThispaperadoptedI/Orate,becauseeachvolumeofrequestissmallinvirtualroamingsystem.
450networkservicesstartedoneachnodeinclientterminalatonetime.
Thereisasimulationtestinwhichdataisrequestedbyseveralusersatonetime.
Experimentsshowthattheserverapplicationcaneasilyhandle10000datarequestandsupport4200concurrentrequests,whichbrokenthroughthelimitsoftraditionalstoragesystem.
Theresponsetimeofdataacquisition.
Theresponsetimereferstothetotaltimeofobtainingthedata.
Usersandreconstructionprocesshaveahigherpriorityincontentionforthediskbandwidth,onthecontrary,thewriteoperationwillhavetowaitfortheendofthereconstructionprocess.
Theresponsetimeisrelativelyfaster.
SimultaneouslytheoperationofdatareconstructionhasalimitonthenumberofreconstructedStripsubmittedbydisks,whichcanensurethattherecoveryworkflowcanevenlydistributedamongthedisks.
Theworkingstateofthesystemisrelativelybalanced.
Reliabilityanalysis.
Reliabilityisoneofthemostimportantindexes[12]totheperformanceofthesystem.
TheindexesofreliabilityconsistofMTTF(averagetimeoffailure),MTTR(meantimetorepair)andMTBF(meantimebetweenfailures),amongthem:MTBFMTTFMTTR=+(5)Foreachdisk,MTBF=1,200,000h,MTTR=1h.
FromMTTR<9999928.
Thatis,theMTTFhasincreasedto1000timesoftraditionalcopyingbackup.
Thefailuretimeperyearis3.
8min,whichismeettherequirements.
ConclusionsTakingadvantageoftheRAID5suchaseasinessinstorageextension,storageefficiency,cheapness,andautomaticdatarecovery,asolutionsofthemassivedatastorageandfault-toleranceinvirtualroamingsystemmethodwaspresented.
Thepanoramicdatawasseparatedfromtheroamingsystemanddistributedtomultiplenodes.
Inthisway,theexpansioncapabilityofthevirtualroamingspatialwouldbeenhancedinlargeextend.
Inaddition,thesystemhadautomaticdatarecoverycapability.
Finally,thePDSSthroughput,reliabilityandresponsetimewastested,theresultsshowedthatthismethodprovidedanewwayofsolvingthedatalimitationofvirtualroamingtechnology.
References[1]JSurong,WSong,FGang,TechnologyofPanoramicViewBasedonImages,ComputerApplications.
16(2002)85-87.
[2]DEREKBRADLEY,ALANBRUNTON,MARKFIALA,GERHARDROTH.
Image-basedNavigationinRealEnvironmentsUsingPanoramas[C],IEEEInternationalWorkshoponHapticAudioVisualEnvironmentsandtheirApplications,Ontario,Canada,2005.
[3]ZHUB,LIK,PATTERSONH.
AvoidingtheDiskBottleneckintheDataDomainReduplicationFileSystem[C].
Proceedingsofthe6thUSENIXConferenceonFileandStorageTechnologies(FAST'08),SanJose,CA,USA,2008.
[4]JibfTian,YaFeiDai.
studyondurablepeer-to-peerstoragetechniques.
[J]Journalofsoftware2007,18(6):1379-1399.
[5]E.
Pinheiro,W.
D.
Weber,L.
A.
Barroso.
Failuretrendsinalargediskdrivepopulation[C].
Proceedingsofthe5thUSENIXconferenceonFileandStorageTechnologies,SanJose,2007,17-28.
[6]HAYESB.
CloudComputing[J].
CommunicationsoftheACM,2008,51(7):9-11[7]HuanQingDong,ZhanHuaiLi,WeiLin.
RAIDVCR:ANewRAIDArchitectureforToleratingTripleDiskFailures[J].
ChineseJournalofcomputers2006,29(5):792-800[8]WenWuNa,JianKe,XuDongKe,etal,ANetworkRAIDSystemwithBackendCentralizedRedundancyManagement[J],ChineseJournalofcomputers,2011,34(5):912-923[9]SUNGHOONBAEK,KYUHOPARK.
Prefetchingwithadaptivecachecullingforstripeddiskarrays[C].
USENIXAnnualTechnicalConference,USA,2008[10]BlaumM,BradyJ,BruckJ.
EVENODD:anefficientschemefortoleratingdoublediskfailuresinRAIDarchitectures[J].
IEEETransactionsonComputers,1995,44(2):192-202[11]FeipengRan,TaoJiang,HuayangDai,etal,Keytechnologyofdigitalcampusestablishmentbasedonflexframework,JournalofGeo-InformationScience,15(2013)123-127(InChinese).
[12]LiangZhao,KeytechnologyofRedundantArraysofIndependentDisks(RAID)[D].
NationalUniversityofDefenseTechnology.
2002.
RAKsmart怎么样?RAKsmart机房即日起开始针对洛杉矶机房的独立服务器进行特别促销活动:低至$76.77/月,最低100Mbps带宽,最高10Gbps带宽,优化线路,不限制流量,具体包括有:常规服务器、站群服务器、10G大带宽服务器、整机机柜托管。活动截止6月30日结束。RAKsmart,美国华人老牌机房,专注于圣何塞服务器,有VPS、独立服务器等。支持PayPal、支付宝付款。点击直达...
华为云818上云活动活动截止到8月31日。1、秒杀限时区优惠仅限一单!云服务器秒杀价低至0.59折,每日9点开抢秒杀抢购活动仅限早上9点开始,有限量库存的。2G1M云服务器低至首年69元。2、新用户折扣区优惠仅限一单!购云服务器享3折起加购主机安全及数据库。企业和个人的优惠力度和方案是不同的。比如还有.CN域名首年8元。华为云服务器CPU资源正常没有扣量。3、抽奖活动在8.4-8.31日期间注册并...
月神科技是由江西月神科技有限公司运营的一家自营云产品的IDC服务商,提供香港安畅、香港沙田、美国CERA、成都电信等机房资源,月神科技有自己的用户群和拥有创宇认证,并且也有电商企业将业务架设在月神科技的平台上。本次带来的是全场八折促销,续费同价。并且上新了国内成都高防服务器,单机100G集群1.2T真实防御,上层屏蔽UDP,可定制CC策略。非常适合网站用户。官方网站:https://www.ysi...
阵列卡为你推荐
站酷zcool站酷zcool字体下载后怎么安装到PS中对对塔101,简单学习网,对对塔三个哪个好firetrap流言终结者 中的银幕神偷 和开保险柜 的流言是 取材与 那几部电影的7788k.comwww.k6320.com 大家给我看看这网站是真是假...www.yahoo.com.hk香港有什么有名的娱乐门户网站吗?haole16.com玛丽外宿中16全集在线观看 玛丽外宿中16qvod快播高清下载m.2828dy.com电影虫www.dyctv.com这个电影站能下载电影吗?www.299pp.com免费PP电影哪个网站可以看啊789se.comwuwu8.com这个站长是谁?广告法新广告法哪些广告词不能用,广告违禁词大全
godaddy优惠码 wdcp 英语简历模板word 名片模板psd 双11抢红包攻略 debian7 一元域名 500m空间 坐公交投2700元 域名转入 广州主机托管 中国电信宽带测速 阿里云邮箱怎么注册 碳云 nano 瓦工工资 魔兽世界服务器维护 网络存储服务器 web服务器软件 win7配置web服务器 更多