HALId:inria-00349127https://hal.
inria.
fr/inria-00349127Submittedon23Dec2008HALisamulti-disciplinaryopenaccessarchiveforthedepositanddisseminationofsci-entificresearchdocuments,whethertheyarepub-lishedornot.
ThedocumentsmaycomefromteachingandresearchinstitutionsinFranceorabroad,orfrompublicorprivateresearchcenters.
L'archiveouvertepluridisciplinaireHAL,estdestinéeaudéptetàladiffusiondedocumentsscientifiquesdeniveaurecherche,publiésounon,émanantdesétablissementsd'enseignementetderecherchefranaisouétrangers,deslaboratoirespublicsouprivés.
Grimage:3DmodelingforremotecollaborationandtelepresenceBenjaminPetit,Jean-DenisLesage,Jean-SébastienFranco,EdmondBoyer,BrunoRainTocitethisversion:BenjaminPetit,Jean-DenisLesage,Jean-SébastienFranco,EdmondBoyer,BrunoRain.
Grimage:3Dmodelingforremotecollaborationandtelepresence.
VRST2008-ACMsymposiumonVirtualrealitysoftwareandtechnology,Oct2008,Bordeaux,France.
pp.
299-300,10.
1145/1450579.
1450662.
inria-00349127299Grimage:3DModelingforRemoteCollaborationandTelepresenceBenjaminPetitINRIAGrenobleUniversitiesJean-DenisLesageINRIAGrenobleUniversitiesJean-SebastienFrancoINRIAUniversiteBordeaux1EdmondBoyer§INRIAGrenobleUniversitiesBrunoRafnINRIAGrenobleUniversitiesAbstractReal-timemulti-camera3Dmodelingprovidesfull-bodygeometricandphotometricdataontheobjectspresentintheacquisitionspace.
Itcanbeusedasaninputdeviceforrenderingtextured3Dmodels,andforcomputinginteractionswithvirtualobjectsthroughaphys-icalsimulationengine.
Inthispaperwepresentaworkinprogresstobuildacollaborativeenvironmentwheretwodistantusers,eachone3Dmodeledinreal-time,interactinasharedvirtualworld.
CRCategories:I.
3.
2[ComputerGraphics]:GraphicsSystems—Distributed/networkgraphicsI.
4.
5[ImageProcessingandCom-puterVision]:ReconstructionKeywords:Telepresence;Collaborative3DInteractions;Marker-less3DModeling;Multi-cameras;PCCluster1IntroductionTelepresenceisofcentralimportanceinvirtualandaugmentedreal-ityapplications.
Itreferstotheabilitytoembedapersoninagivenlocationintovirtualenvironmentsatotherlocations.
Whileseveraltechnologiesalreadyallowvisualizationatdifferentlocations,thecreationofvirtualenvironmentswherepersonsinremotesitescaninteractwitheachother,aswellaswithvirtualobjects,isstillchal-lenging.
Oneofthedifcultyistobuildvirtualusermodelsthatcarryenoughinformationforsuchapplications.
Therearedifferentapplicationsofvirtualimmersiveandcollab-orativeenvironmentssuchasvideogames,teleconferencingwiththecapabilitytomanipulateandinteracttogetherwithaCADmodel,learnandtrainfromremotesitesormanageemergencycri-sis,amongothers.
Traditionaltechnologiesforsuchapplicationsaregenerallylimitedinseveralaspects.
Themainreasonsaretobefoundinthevirtualrepresentationsoftheuserwhichareoftencoarseandhencepreventpeoplefrominteractinginanaturalway.
Mostoftheexistingsystemsuses2Drepresentationsobtainedwithmono-camerasystems.
Whilegivingapartiallytruerepresentationoftheuser,theyarenotimmersiveenoughfor3Dvirtualworlds.
Othersystems,whicharetosomeextentmoresuitablefor3Dvir-tualworlds,useavatars,e.
gmulti-playergameslikeSecondLife.
e-mail:benjamin.
petit@inrialpes.
fre-mail:jean-denis.
lesage@imag.
fre-mail:jean-sebastien.
franco@labri.
fr§e-mail:edmond.
boyer@inrialpes.
fre-mail:bruno.
rafn@imag.
frButavatarsonlycarrypartialinformationaboutusers.
Thoughreal-timemotioncaptureenvironmentscanimprovesuchmodelsandallowforanimation,avatarsdonotyetprovidearealisticrepresen-tation.
Onewaytoimprovethesenseofpresenceandrealismistocom-putereal-time3Dmodelsbasedonbothphotometricandgeomet-ricdata.
Theyyieldmorefaithfullifelikerepresentationsthatcanincludeuserappearance,motionsandevenfacialexpressions.
Dif-ferentstrategiescanbefollowedtoobtainthe3Dmodelofaper-son.
Themostcommononeistousemulti-camerasystems.
Suchsystemsarealreadyusedfortelepresence[Grossetal.
2003].
Nev-ertheless,existing3Dpersonrepresentations,inreal-timesystems,oftenhavelimitationssuchasimperfectorcoarsegeometricmod-elsandlowresolutiontextures.
Thisasaresultofthemethodusedtoreconstructin3D,e.
g.
stereo-visionorvisualhull,andofthenumberofcamerasandthealgorithmcomputationtime.
Wepresentworksinprogressonusingmulti-camerareal-time3Dmodelingbetweenremotesites.
Suchworksarebasedonourpre-viousexperiencewiththeGrimagemulti-cameraplatformthaten-ablesoneorseveraluserspresentinthesameacquisitionspacetointeractwithvirtualobjectsanimatedbyaphysicalsimulation.
Weconsiderheretheextensiontomulti-sitefortelepresenceandcol-laborativeenvironments.
Theremainderofthepaperisasfollows.
Section2presentstheexistingGrimageplatformwhilesection3describeshowthisenvi-ronmenthasevolvedtosupportmulti-siteinteractions,remotecol-laborationandtelepresence.
2TheSingle-siteEnvironmentTheGrimageplatformconsistsinamulti-cameraenvironment,aPCclusterprovidingacquisition,computingandrenderingre-sources.
Wecompute3Dgeometricmodelsandextractmulti-viewtexturesfromasetofcalibratedcameraswithoutusingintrusivemarkersorassumptionsabouttheobjectsbeinglmed.
Wecomputethevisualhulloftheobjectsbyreconstructingtheirshapefromthesilhouettesextractedfromthevideostreams.
Thealgorithmwedevelopedanduse,calledtheExactPolyhedralVisualHullalgorithm[FrancoandBoyer2003],computesinreal-timethecompleteandexactvisualhullpolyhedronwithregardtosilhouetteinputs.
The3DmodelsareinjectedintotheSOFAphysicalsimulationsoft-ware[Sof].
SOFAanimatesvirtualobjectstakingintoaccountthepresenceofthereal-objectsthroughtheir3Dmodels.
Thesceneisrenderedaftertexturingthe3Dmodelsforanimprovedrealism.
Thissingle-siteplatformwaspresentedattheSiggraph2007EmergingTechnologiesshowbyAllard&al.
[2007].
Photosandvideosareavailableat[Gri].
Permissiontomakedigitalorhardcopiesofallorpartofthisworkforpersonalorclassroomuseisgrantedwithoutfeeprovidedthatcopiesarenotmadeordistributedforprofitorcommercialadvantage,andthatcopiesbearthisnoticeandthefullcitationonthefirstpage.
Tocopyotherwise,torepublish,topostonserversortoredistributetolists,requirespriorspecificpermissionand/orafee.
VRST'08,October27-29,2008,Bordeaux,FranceCopyright2008ACMISBN978-1-59593-951-7/08/10.
.
.
$5.
003003RemoteCollaborationandTelepresenceWeextendGrimagetoadistributedcontext.
Weconnectdifferentclusterstogetherinsidethesametelepresenceapplication.
Eachclusterhostsasitewithanacquisitionareaandrendersthevir-tualworldindependently.
Acentralnodeoftheapplicationgath-ersthe3Dmodelsfromallsitesandrunsthephysicalsimulation(Figure1).
Thissimulationdetectscollisionsandcomputestheef-fectofeachuseronthevirtualworld.
Itisofcourseimpossibletochangethestateoftheinputmodelsthem-selvesastherearenoforce-feedbackdeviceontheplatform.
Physicalinteractionsbe-tweenparticipantsarealsoimpossibleforthesamereason.
Thesimulationsendsthe3Dscene,i.
e.
thevirtualobjects,toallrenderingnodesofeachsite.
Eachacquisitionplatformsendsits3Dtexturedmodelstotheothersites.
Therenderingnodesofeachclustermergethesedatasentbydifferentsourcesandprovideacon-sistentviewofthescene.
Renderingcanbedoneonvirtuallyanydisplaydevicewithdifferentlevelsofimmersion(e.
gstereoscopicdisplay,HMD,displaywall,Cave).
CouplingthedifferentsoftwarecomponentsinvolvedintothisprojectanddistributingthemonthenodesofaPCclusterforreachingreal-timeexecutionsisperformedusingFlowVR[Flo;LesageandRafn2008],ahierarchicalcomponentorientedmid-dlewarebasedonadata-owparadigm.
FlowVRenforcesamod-ularprogrammingthatleveragessoftwareengineeringissueswhileenablinghighperformanceexecutionsonmulti-clusterarchitec-tures.
Figure1:Applicationarchitecturefor2multi-cameraacquisitionspaces.
3.
1PracticalSetupThedemonstrationisconductedontwoplatformslocatedattheVRSTconferencesite.
Eachplatformhasanacquisitionspaceofonesquaredmeterattableheightwithverewirecameras.
Itissuitableforhands/armsinteractions.
EachplatformisequippedwithaPCclustercomposedofvePCsusedforcameraacquisition,onePCforcomputationandrenderingandalaptopforsupervision.
Thetwoclustersareconnectedbyagigabyteethernetnetworkus-ingonePCasgatewaybetweenthetwoplatforms.
ThisPCrunsthephysicalsimulation.
3.
2ResultsWesucceededinbroadcastingthe3Dmodelsbetweensitesatelevenframespersecondwhilethephysicalsimulationwasrun-ningat30iterationspersecond.
Performancesreachedduringex-perimentsenabledtwouserstointeractwithacommonphysicalsimulationwithoutsignicantlatency.
4ConclusionWepresentedanon-goingworkfortelepresenceandcollaborativeinteractionusingtwomulti-cameraandreal-time3Dmodelingplat-formsandaphysicalsimulationtohandlethevirtualinteractionspace.
Firstresultsareverypositive.
Fromtheuserpointofviewthesenseofpresenceisstrong.
Wealsonoticedthatusersdonotneedtolearntheinteractionparadigmsbasedontheonespeopleexperienceintherealworld.
Thisworkalsostressesanumberofweakpointsthatwewillad-dressinthefuture.
Texturing3Dmodelisakeycomponentoftelepresence,butimprovingtexturequalitytendstooverloadthecommunicationnetworkandleadstoextra-latencyintheapplica-tion.
Interactionsusinga3Dmodelandphysicalsimulationdonotallowsomeactionslikeobjectpreemption.
AcknowledgmentThisworkwaspartlyfundedbyAgenceNationaledelaRecherche,contractANR-06-MDCA-003.
ReferencesALLARD,J.
,MENIER,C.
,RAFFIN,B.
,BOYER,E.
ANDFAURE,F.
2007.
Grimage:Markerless3DInteractions.
InSIGGRAPH'07:ACMSIGGRAPH2007emergingtechnologies,ACM,NewYork,NY,USA,9.
FlowVR.
http://flowvr.
sf.
net.
FRANCO,J.
,ANDBOYER,E.
2003.
ExactPolyhedralVisualHulls.
InProceedingsofBMVC2003.
Grimage.
http://www.
inrialpes.
fr/grimage.
GROSS,M.
,W¨URMLIN,S.
,NAEF,M.
,LAMBORAY,E.
,SPAGNO,C.
,KUNZ,A.
,KOLLER-MEIER,E.
,SVOBODA,T.
,GOOL,L.
V.
,LANG,S.
,STREHLKE,K.
,MOERE,A.
V.
,ANDSTAADT,O.
2003.
Blue-C:aSpatiallyImmersiveDisplayand3DVideoPortalforTelepresence.
ACMTrans.
Graph.
22,3,819–827.
LESAGE,J.
-D.
,ANDRAFFIN,B.
2008.
AHierarchicalCompo-nentModelforLargeParallelInteractiveApplications.
JournalofSupercomputing(July).
Sofa.
http://www.
sofa-framework.
org.
从介绍看啊,新增的HostYun 俄罗斯机房采用的是双向CN2线路,其他的像香港和日本机房,均为国内直连线路,访问质量不错。HostYun商家通用九折优惠码:HostYun内存CPUSSD流量带宽价格(原价)购买地址1G1核10G300G/月200M28元/月购买链接1G1核10G500G/月200M38元/月购买链接1G1核20G900G/月200M68元/月购买链接2G1核30G1500G/月...
易探云香港vps主机价格多少钱?香港vps主机租用费用大体上是由配置决定的,我们选择香港vps主机租用最大的优势是免备案vps。但是,每家服务商的机房、配置、定价也不同。我们以最基础配置为标准,综合比对各大香港vps主机供应商的价格,即可选到高性能、价格适中的香港vps主机。通常1核CPU、1G内存、2Mbps独享带宽,价格在30元-120元/月。不过,易探云香港vps主机推出四个机房的优惠活动,...
A400互联是一家成立于2020年的商家,本次给大家带来的是,全新上线的香港节点,cmi+cn2线路,全场香港产品7折优惠,优惠码0711,A400互联,只为给你提供更快,更稳,更实惠的套餐。目前,商家推出香港cn2节点+cmi线路云主机,1H/1G/10M/300G流量,37.8元/季,云上日子,你我共享。A400互联优惠码:七折优惠码:0711A400互联优惠方案:适合建站,个人开发爱好者配置...
realplayersp为你推荐
支持ipadpublicationethics.orgpreviouslybit《个人收入的分配过关检测》photoshop技术什么是ps技术google分析怎样学会使用谷歌分析? 我自己想往网站分析走。routeadd如何用route add添加本地路由表,使一个网段的机器能访问另一个网段局域网的机器。望高手指点。morphvoxpro怎么用怎么使用morphvox prochrome18CHROME现在最新版是多少?药学快讯主编:朱家勇(广东药学院院长)
顶级域名 windows虚机 联通vps 漂亮qq空间 台湾服务器 韩国电信 12306抢票攻略 青果网 三拼域名 anylink 微信收钱 柚子舍官网 如何用qq邮箱发邮件 宏讯 独享主机 德隆中文网 阵亡将士纪念日 买空间网 cdn服务 北京主机托管 更多