multiple网易轻博客

ResearchonMotionModelforTechniqueMovementsofCompetitiveSwimminginVirtualInteractiveEnvironmentMaoJie(&)CollegeofSportsEngineeringandInformationTechnology,WuhanSportsUniversity,Wuhan430079,ChinaJiem027@163.
comAbstract.
Withtheconstantimprovementoftechnologiesforvirtualinterac-tion,ithasgraduallybecomeafashiontohavevirtualinteractionsaboutsports.
Forvirtualinteraction,unity3Disn'tonlyeffectiveforpresentinga3A-ratedvividvirtualenvironment,butmayalsoperfectlyinteractwithMotionSensingequipment.
Asbrandnewandcutting-edgetechnologiesincurrenteldof3Ddigitalinteractivemultimedia,virtualinteractionandMotionSensingtech-nologieshavebroadprospectsfordevelopmentandgreatspaceforappliedresearch,sotheymaycontributetomoreresearchandapplicationsintermsofsports.
Basedonliteratureconsultation,interview,experimentandmathematicalanalysis,sportsformsandenvironmentaresimulatedbyvirtualrealitytech-nologies,tocreatealifelikevirtual3Denvironmentforsports.
Virtualinter-actionismadepossibleforswimmingtocreateabrandnewsportspattern.
Differentmovementorbitsofhumanactionsareacquiredfromvirtualenvi-ronmentwithKinectMotionSensingequipment,inorderthat3Dhumanbodymodelscouldmoveinvirtualswimmingscenes.
Suggestionsaremadetofurtherimprovethecreationofvirtualrealityenvironmentandaddvirtualequipment,sothatvirtualrealitiesmaybemorevivid.
WiththeuseofMotionSensingtechnologies,theapplicationofmoresportsinvirtualMotionSensinginterac-tionwillbepromoted.
Keywords:MotionSensingVirtualinteractionKinectUnity3D1IntroductionAspioneerofMotionSensingtechnologies,"motioncapture"hasoriginatedfromMaxFleischer'sRotoscopein1915,anduptillnow,hasbeensuccessfullyappliedinmanyeldssuchasvirtualrealitytechnologies,gamingplatforms,researchonergonomics,simulationsandbiomechanicalresearch[1].
MotionSensingtechnologiesmaynotonlycaptureskeletalmovementsofhumanbodyonareal-timebasis,butmayalsointeractwithsurroundingequipmentorenvironment.
Involvingseveraleldslikegames,medicine,commerceandsmarthome,theyhavehugespacefordevelopmentandimagination.
InApril2013,thePerfectWorldreleasedMotionSensingvideosof"Swordsman"producedbySharpNow,whichlaunchedtheprototypeof3Dsensingtechnologiesbasedongesturerecognitiontechnologies.
SpringerInternationalPublishingSwitzerland2016S.
LackeyandR.
Shumaker(Eds.
):VAMR2016,LNCS9740,pp.
233–242,2016.
DOI:10.
1007/978-3-319-39907-2_22Nowadays,MotionSensingtechnologiesarefairlywidelyusedindesign.
Forinstance,adequatelyinvestigatedinthegameindustry,Kinectalsotakestheleadinotherelds,includingclinicalmedicine,remoteoperation,medicaleducationandmedicaldatasurvey.
Intheeldofcommerce,ARDoor,atechnologycompanyinRussia,utilizedthe"virtualttingmirror"inventedwithKinectMotionSensingpe-ripherals.
Then,shopperscouldstandinfrontofvirtualttingmirrorsandtheir3Dimagesoftryingonnewclothescouldbeautomaticallydisplayed.
Concerningappliedresearchontechnologicalaidsforthehandicapped,MichaelZollneroftheUniver-sityofKonstanzdevelopedtheNavigationalAidsfortheVisuallyImpaired(NAVI)tohelpwiththenavigationoftheblind.
Inaddition,MotionSensingtechnologiesareusedforrobotsandsmarthomesandsoon[4].
Inthispaper,Unity3DisintegratedwithKinectMotionSensingtechnologies,andavirtualinteractiveMotionSensingdesignbasedonUnity3DengineiscompletedforswimmingbyKinectopticalsensing.
2PurposesWiththedevelopmentofintelligentcomputertechnologies,virtualinteractiontech-nologythatcanpassinteractiveequipmentandsoftwareofMotionSensinginteractivesystembasedon3Ddigitalcontenthaveemerged.
Today,MotionSensingtechnologyisn'tonlyanadvanced3Ddigitalinteractivemultimediatechnology,butalsoabrandnewresearchinterestintheeldofhuman-computerinteraction.
Theirapplicationhasbeenpopularineldsofmedicine,education,rehabilitation,e-commerce,competitivesports,animationandgameproduction.
Withprettybroadprospectofapplication,thistechnologycanrealizenew-generationhuman-computerinteraction,3Dhumanmod-elingandskeletontrackingintermsofmotion,gestureandlanguagerecognition.
Itsapplicationiswidespreadfromdeepdatatorobotvisionandcontrol.
Inthefuture,itwillbeusedmorepotentially,andtherewillbequitegreatmarketdemandsfordesignedvirtualinteractiveMotionSensingproducts.
3Methods(1)LiteratureConsultationForeignanddomesticliteratureaboutmeansforexploringMotionSensingtechnologies,3Dhumanmodelsandconstructionofvirtualrealityenvironmentisconsulted,todeterminecontentandmethodsforstudyingMotionSensingtechnologies.
(2)InterviewBycarryingoutresearchaboutChinesesportsinformationtechnologyandsportstrainingandconductingstructuredandunstructuredinterviewsofexperts,opin-ionsonresearchfeasibilityandeffectivenessaresummedup,tolayafoundationforsurveysandempiricalresearch.
234M.
Jie(3)ExperimentVirtualinteractivemodelsarebuiltforswimmingwithcomputernumericalsimulationtechnology.
(4)MathematicalanalysisAdataanalysisisperformedonresearchcontentofMotionSensingtechnologies,includingdeepdataowandskeletontracking.
4Results4.
1MotionSensingTechnologiesAscurrentbrandnewandadvancedtechnologiesof3Ddigitalinteractivemultimedia,MotionSensingtechnologieshaveabroadprospectofdevelopmentandtremendousspaceforappliedresearch,contributingtomorestudiesandapplicationsintheeldofsports.
RepresentedbyMotionSensingtechnologies,Kinectisa3DMotionSens-ingcamera,asshowninFig.
1asfollows.
TheemergenceofKinecthardwareshallbeattributedtocombineduseoftechnologiesrelatedtomultipleaspectssuchassound,light,electricityandmachinery[3].
Withafunctionforimmediatedynamiccapture,itmaycapturemotionsofhumanlimbstoautonomouslyrecognize,memorize,analyzeandhandlethesemotions.
Withthistechnology,peoplemayhavedifferentmovementsandinteractwitheachotherinvirtualscenes,butalsosharetheirpicturesandinfor-mation,etcthroughtheinternet,tomakeitpossiblethat"thebodyisacontroller".
AsregardsKinect,keytechnologiesaremainlycharacterizedbyskeletontracking,motionrecognition,facialrecognitionandspeechrecognition.
Kinectacquiresdepthimagesandrecognizeshumanskeletonsbyaninfraredcamera,toseparatehumanbodyfrombackground.
ItoftenrecognizesskeletonsbylookingfortheChinesecharacter"大".
Inthemeantime,theskeletonacquisitionissomewhatinterferedbydark-coloredclothes,soitismorefavorableforacquiringskeletonsifthebackgroundiswhite.
Concerningspatialcoordinateofskeletons,itisnoteworthythatitisinadvisabletoreadskeletonsfromtherightleftorright,orelsetheskeletonswillbeoverlaidandtherebyimpactintendedexplorations.
Fig.
1.
KinectforXboxoneWindowsResearchonMotionModelforTechniqueMovements2354.
2ConstructionofVirtualEnvironment4.
2.
1ScenarioandHumanBodyModeling(1)ModelofswimmingstadiumThemodelofswimmingstadiumismadeupofdifferentparts,andthescenariomodelmaybebuiltasfollows:Thebottomoftheswimmingpoolismodiedbyabuilt-incubicmodel.
Parameterssuchas"length","width"and"height"aresettobe500cm,400cmand350cmrespectively.
Firstofall,thetopsurfaceofthecuboidiscutintofoursideswhichareintersected.
Next,thecutmiddlelargerectangleisintrudedintothecuboidby"extrusion"toformapoolshape,asshowninFig.
2.
Concerningwateroftheswimmingpool,materialparametersaresetasfollows:diffusecolors:149,178,222;highgloss:80;glossiness:80;opacity:40.
VRaymapsareconcaveandconvexwithnoises.
Asregardsnoiseparameters,ripplesizeiscontrolledat5(thelowerthevalue,thesmallerandthedenseristheripple.
Besides,therippleistrackedbyreectionmappingincombinationwithlight.
(2)HumanbodymodelingHumanbodymodelingshallbebasedonphysicalattractivenessandphysiology.
Builtmodelofhumanbodyisapolygonalmodel.
Threeinbuiltmodelsof3Dsmaxareconsideredashead,upperpartofbodyandbreechrespectively.
Then,theyarebridgedaftersimplemodication.
Subsequently,thepartswherehumanarmsareandlegsatthecrotchformasectionwherearmsandlegscanbemade.
Armsandlegsareextrudedaccordingtobodyproportions,toformtheinitialshapeofhumanbody.
Next,basicstructureofpeople(includinghandsandfeet)isdrawnaccordingtoorderslikecutting,connection,disconnection,collapseandbridging.
A"turbosmooth"modierisaddedtoan"editablepolygon",inordertoaddplanestohumanbodyandmakethemsmooth.
Atlast,theplanesmaybemodiedbyrepeatedlyusingorderswithinthe"PaintDeformation",sothattheFig.
2.
3Dmodelofswimmingpool236M.
Jiestructureofhumanbodycouldbemorevividandlively.
Oncethebodyiswellmade,effortsshallfocusonhands,headandveorgansaswellasmoredetailedprocessing.
Intheprocessofmaking,itisnecessarytoensureeachplanehasfoursidesasfaraspossible,whereastherecanbesomeve-sidedplanesatturns.
Forinstance,theturnsaremadebyvertexesofvesidesatthezygomaticbone.
Linesshallbepulledinlinewithactualorientationofhumanmuscle.
Forthemuscleatarmsandlegs,thereshallbelinesperpendiculartotheirskeletons,soastobehelpfulforproducinganimationofskeletonmodels.
Attentionshallbepaidtocheckiftherearemorepoints.
Ifyes,extrapointsshallbepromptlyeliminated,orelsesubsequentskinningwillbeimpacted,asshowninFig.
3.
4.
2.
2ConstructionofUnityVirtualEnvironmentDirectX11issupportedbyUnity,whichcanrealizelifelike3A-ratedvirtualsimulationscenariosincombinationwithoptimizedilluminationsystemandShaderLab,tomakethevirtualenvironmentmorerealandvividbyefcientlysimulatingphysicaleffectssuchascollisionofrigidbodiesandgravitationinalifelikemanner[12,16].
Intheentiredesignprocess,itisnecessarytobuildabigenvironmentlikeblueskyinscenariosapartfromtheearth.
RequiredbigenvironmentmaybecreatedwiththeSkyboxinUnity.
TheenvironmentsetupbytheSkyboxmaybemorerealistic.
ThesystemitselfisequippedwitharesourcepackoftheSkybox,insidewhichtherearesixdifferentmaterialsofsky.
Inaddition,materialsoftheSkyboxnecessaryfordesignmaybedrawnaccordingtomappinglawsoftheSkybox.
Here,itisnoteworthythattheskycan'tberenderedunlesstheSkyboxthrough"RenderSettings".
ItmayberenderedbyclickingEdit!
RenderSettingstosetoptionsofSkyboxMaterial.
IndesigningrequiredSkybox,anewmaterialspheremaybecreatedbyopeninglesAssets!
MaterialsonthepanelofProject,andtheShaderpropertiesinsidethepropertiesviewerarechangedintoSkybox.
ImportsuccessivepicturesthathavebeendrawnpursuanttocuberulesintothepicbyopeningtheletitledAssets.
ChangetheirFig.
3.
RenderedmodelofswimmingstadiumResearchonMotionModelforTechniqueMovements237propertyfromWrapModeintoClampandthenputthemintheMaterialsbasedonpertinentorientationstorenderspecialenvironment[17,23].
InUnity4.
x,watereffectsarecreatedwithawaterresourcepackknownasWater(Pro).
Inthisresourcepack,therearetwoinstancesinWater4,includingdaylightandnighttimewater,amongwhichthelatterappearstobedarker.
DragwaterintotheHierarchyPanelandchangetheScaleoftheTransforminthepropertiesviewertogetrequiredwatersize.
Then,dragittothedesiredplacebyamovetool,asshowninFig.
4asfollows.
4.
3RealizationofMotionSensingEffectsforGamesAfterlotsofliteratureandonlinematerials,currentMotionSensingtechnologiesaremostlyrealizedbyintegratingUnitysoftwarewithKinecthardware,whiletheKinecthardwaremainlytransmitsdatabyfollowingmethods[24]:1.
KinectWrapper.
unitypackage(CarnegieMellon)plug-in;2.
OpenNI_Unity_Toolkit-0.
9.
7.
4.
unitypackageplug-in;3.
Zigfuplug-in;4.
Adevine1618plug-in;5.
.
dllplug-inswrittenandpackagedinC#,C++orJava.
Afteradvantagesanddisadvantagesofaboveplug-insareanalyzed,dataofUnitysoftwareenvironmentandKinectequipmentaretransmittedbyKinectWrapper.
unitypackageplug-inanduser-denedpackagingplug-insinthispaper.
Fig.
4.
Arunningscenario238M.
JieThispaperfocusesonillustratingUnityandKinectdatatransmissionprocessesofKinectWrapper.
unitypackageplug-in.
OthersoftwareenvironmentincludesKinectSDK1.
7andUnity4.
5.
1.
4.
3.
1KeyMotionSensingTechnologiesKinectWrapper.
unitypackageplug-incontainsmultiplescripts,whichplaydifferentrolesindatatransmissionsofKinectequipmentandUnitysoftware,asshowninTable1asfollows.
Apartfromscripts,KinectPrefabiscriticalfordatatransmissionsofUnity3DsoftwareandKinectequipment.
InutilizingKinectPointControllerandKinectModelControllerV2,theprefabshallbeputinsidetheexposurevariableSkeletonWrapper(Sw).
4.
3.
2DiscussionofModelMovementInthisdesign,aninteractivefunctionisrealizedthat"matchstickman"(prefabKinectAvatar)ofKinectWrapper.
unitypackagefollowstheKinectequipmenttoacquireinformationaboutpeople'smovements.
AllpointsontheHierarchypanelareputtomatchwithcorrespondingvariablesexposedbyKinectPointController.
PertinentscriptTable1.
AListofKinectWrapper.
unitypackagePlug-inScriptsNameofScriptsFunctionsKinectModelControllerV2Controlmodels,matchhumanskeletonmodelswithskeletalvariablesexposedbyscripts(globalvariables)andbind3DskeletonmodelswithhumanskeletonsrecognizedbyKinecthardware.
KinectPointControllerControlpointsofbodyparts,whicharesetasexposurevariablesofscripts(globalvariables)forconvenientcontrolbyKinectequipment.
DeviceOrEmulatorJudgeifKinectphysicalequipmentorKinectsimulationequipmentistobeused.
DepthWrapperAcquirepeople'sdataaboutdepthimages.
SkeletonWrapperAcquiredataaboutskeletonsandobtaintwopersons'skeletonsatmost.
KinectInteropAcquiredatafromMicrosoftKinectSDK;thisiscriticalfordatatransmissionsofKinectandUnity3D.
DisplayDepthObtainpeople'sdepthimages.
DisplayColorObtainpeople'sRGBimages.
KinectRecorderRecordmotions,generatereplaydocumentswithKinectemulatorandonlyusedwhenemulatorsareused.
KinectEmulatorSimulateKinectequipmentandruntogetherwithreplaydocumentsgeneratedbyKinectRecorder.
KinectSensorAcquiredatafromKinectbyKinectInterop.
ResearchonMotionModelforTechniqueMovements239"man.
cs"iswrittentocontrolthemovementofthe"matchstickman".
ModifyKinectPointController,andgrantthevelvalueof"man.
cs"tobe"1",soastomodify"goTransform.
position"of"man.
cs".
The"matchstickman"maymoveaccordingtothevalueof"goTransform.
position"of"man.
cs"forrealizingtheinteractivefunctionthatthe"matchstickman"moveswithpeople.
4.
3.
3MotionSensingDesignofSwimmingTheKinectPrefabshallbeplacedinsidetheHierarchypanelandtheKinectModelControllerV2needstobeputattheparenthierarchy.
PlaceskeletonsofthismodelcorrespondingtovariablesinexposedskeletonvariablesanddragtheKinectPrefabintotheexposurevariableSwofKinectModelControllerV2onthehumanmodel.
Here,itisnoteworthythatonly20skeletonsarecontrolledbyKinect,butmorethan20areunderthecontrolofKinectModelControllerV2.
Therefore,variablesofwrists,handsandngersaresupposedtobeputinsideskeletonsofhands.
Itwillbebetterformovementwhenvariablesofanklesandfeetareplacedinsidesuchmodels.
Tocontroltwomodelsofhumanbody,Playervariableshallbeset.
Maskvariablemaybesetifnotallskeletonsareexpectedtobecontrolled.
Themodelmayplayitsoriginalanimationsaslongas"Animated"ischosen,andBlendWeight(0*1)shallbeset.
ThevalueofBlendWeightmaybeusedfordeterminingeffectsofsyntheticmotionsachievedbyanimationandKinect-drivenmotions,asshowninFig.
5.
Afterskeletonsarebound,theyshallbeoperatedincombinationwithKinect.
Inthisway,themodelcanmovewithpeople.
Fig.
5.
ValuesofexposurevariablesofKinectModelControllerV2240M.
Jie5ConclusionsandSuggestions5.
1Conclusions(1)Virtualrealitytechnologiesareusedforcreatinglifelike3Denvironmentoratmosphereforswimmingthatpeoplecanfeelasiftheyarepersonallyonthesceneaccordingtosportsformsandswimmingenvironment.
(2)IncombinationwithMotionSensinginteractivetechnologies,virtualinteractiveinteractionismadepossibleforswimming,tocreateabrandnewsportspattern.
(3)Variousmovementorbitsofhumanmotionsareacquiredfromvirtualenviron-mentwithKinectequipment,inorderthatthree-dimensionalmodelsofhumanbodycanmoveinvirtualbody-buildingscenes.
5.
2Suggestions(1)Furtherimprovementsneedtobemadeincreatingvirtualrealityenvironment,andvirtualequipmentshallbeadded,soastodevelopmorevividvirtualrealities.
(2)MotionSensingtechnologiesareutilized,inorderthatvirtualMotionSensinginteractionsmayberealizedinmoresports.
Acknowledgment.
WethankWeiTian,LuQiandDuYunyunforhelpfuldiscussionsandtherefereesforgreatlyimprovingthemanuscript.
TheresearchwassupportedbyTheNationalSocialScienceFundofChina.
References1.
Wang,G.
J.
:TheInteractiveIntelligentControlandVirtualSimulationBasedOntheMotionCaptureData.
ANQINGNormalUnicersity(2013)2.
Bai,D.
:MotionSensingTechnologies.
http://baike.
baidu.
com/view/5338106.
html,2013-06-013.
Yu,T.
:KinectApplicationDevelopmentinTheMostNaturalWaywithTheMachineDialogue.
PublishingHouseofElectronicsIndustry,Beijing(2012)4.
smile_979.
:Kinectinteractivetechnologyofmoderncommunicationtheoryandadvancedtechnology.
http://wenku.
baidu.
com/linkurl=q-kdTjuSLi7oIdXR7hZIMmZ60AsjPqleTe2yrKqI_9ukTurSd_S5L-kNRSCo3uJJME_1MpYGWzi6F-1PzYF5Wl4FMHZEeL-Hoy8lRQa_vjK.
2014-11-065.
Zai,X.
F.
,Zhu,J.
J.
,Pan,Z.
G.
:3dsMAXmodelinganditsapplicationinvirtualreality.
Comput.
Simulation.
4,94–97+86(2004)6.
Li,H.
:3DSMAXmodelingtechnologyanalysis.
J.
XingtaiUniv.
4,106–107(2009)7.
Huang,J.
,Zhang,H.
Z.
:Theapplicationof3DSMAXinvirtualreality.
GeomaticsSpat.
Inf.
Technol.
2,124–126(2013)8.
Yang,D.
C.
,Xu,K.
,Liu,L.
:Using3DSMAXtorealizetheanimationsimulationofhumanoidrobot.
Mach.
Des.
Manuf.
2,48–49(2002)ResearchonMotionModelforTechniqueMovements2419.
Cheng,J.
H.
:Virtualrealitymodelingtechnologybasedon3DSMAX.
J.
ZhangzhouNormalUniv.
(Nat.
Sci.
)3,18–22(2002)10.
Liu,B.
W.
:Modelingcharacteristicsandeffectofvirtualrealityscene.
Comput.
Eng.
Appl.
5,137–141(2014)11.
Liu,G.
D.
:Intuitiveinteractioninterfaceandvirtualreality.
J.
WuhanUniv.
Technol.
1,132–136(2014)12.
Lan,J.
,Sun,J.
,Yang,Y.
B.
:ResearchoncontrolmethodofskeletaltrackingbasedonKinect.
8,20–22+27(2014)13.
Luo,Q.
:Studyonthreedimensionsbodyreconstructionandmeasurementbyusingkinect.
In:Duffy,V.
G.
(ed.
)DHM2014.
LNCS,vol.
8529,pp.
35–42.
Springer,Heidelberg(2014)14.
Luo,Q.
,Yang,G.
:Researchandsimulationonvirtualmovementbasedonkinect.
In:Shumaker,R.
,Lackey,S.
(eds.
)VAMR2014,PartI.
LNCS,vol.
8525,pp.
85–92.
Springer,Heidelberg(2014)15.
Wu,Z.
D.
:ResearchandimplementationofagameenginebasedonUnity3d.
In:ZhongShanUniversity(2012)16.
Chen,Z.
H.
:WithUnity3DKinectgamedevelopmentofasummaryofideas,11March2012.
http://diandian.
chenzhehuai.
com/post/2012-11-03/4004296274217.
Han,J.
D.
D.
:ForWindowsSDKKinectdevelopmentintroduction(3):basicknowledge.
http://www.
cnblogs.
com/yangecnu/archive/2012/04/02/KinectSDK_Application_Fundamentals_Part2.
html,2012-04-0218.
HackerSaillen:SomestudiesontheuseofKinectinUnity3D.
http://blog.
csdn.
net/hackersaillen/article/details/8780719,2013-04-1019.
Duncan,G.
:ZDK=ZigfuDevelopmentKit=CommercialKinectDevelopentlibraryforUnity3DandJavaScript[EB/OL].
https://channel9.
msdn.
com/coding4fun/kinect/ZDK–Zigfu-Development-Kit–Commercial-Kinect-Development-library-for-Unity3D-and-JavaScript,2012-03-1920.
Advine1618.
KinectSDK-Unity3D_Interface_Plugin[EB/OL],17August2013.
https://gthub.
com/adevine1618/KinectSDK-Unity3D_Interface_Plugin21.
Da,H.
H.
:Matrix4x4matrixtransformationofUnity3Ddevelopment.
http://sygame.
lofter.
com/post/117105_3b843c,2013-01-0922.
Chong,Q.
:unity3d:Unity3DWater-Realwatersettingtechnique,12March2013.
http://cl314413.
blog.
163.
com/blog/static/190507976201321211943837/23.
Yu,T.
:ThecombinationofKinectandUnity.
http://game.
ceeger.
com/forum/read.
-Phptid=2142,2012-06-1024.
KinectforWindows1.
7.
1.
7SDKandDeveloperToolkitKnownIssues[EB/OL].
https://msdn.
microsoft.
com/en-us/library/dn188692.
aspx,2013-01-07242M.
Jie