kinect windowshardware和sdk概述外文文献翻译学位论文.docx
- 文档编号:8836275
- 上传时间:2023-02-02
- 格式:DOCX
- 页数:10
- 大小:23.23KB
kinect windowshardware和sdk概述外文文献翻译学位论文.docx
《kinect windowshardware和sdk概述外文文献翻译学位论文.docx》由会员分享,可在线阅读,更多相关《kinect windowshardware和sdk概述外文文献翻译学位论文.docx(10页珍藏版)》请在冰豆网上搜索。
kinectwindowshardware和sdk概述外文文献翻译学位论文
外文翻译
KinectforWindows–HardwareandSDKOverview
Inthischapterwewilldefinethekeynotionsandtipsforthefollowingtopics:
•CriticalhardwarecomponentsoftheKinectforWindowsdeviceandtheir
functionalities,properties,andlimits
•SoftwarearchitecturedefiningtheKinectSDK1.6MotioncomputingandKinect.BeforegettingKinectinmotion,let'strytounderstandwhatmotioncomputing(ormotioncontrolcomputing)isandhowKinectbuiltitssuccessinthisarea.Motioncontrolcomputingisthedisciplinethatprocesses,digitalizes,anddetectsthepositionand/orvelocityofpeopleandobjectsinordertointeractwithsoftwaresystems.
MotioncontrolcomputinghasbeenestablishingitselfasoneofthemostrelevanttechniquesfordesigningandimplementingaNaturalUserInterface(NUI).NUIsarehuman-machineinterfacesthatenabletheusertointeractinanaturalwaywithsoftwaresystems.ThegoalsofNUIsaretobenaturalandintuitive.NUIsarebuiltonthefollowingtwomainprinciples:
•TheNUIhastobeimperceptible,thankstoitsintuitivecharacteristics:
(asensorabletocaptureourgestures,amicrophoneabletocaptureourvoice,andatouchscreenabletocaptureourhands'movements).Alltheseinterfacesareimperceptibletousbecausetheiruseisintuitive.Theinterfaceisnotdistractingusfromthecorefunctionalitiesofoursoftwaresystem.
KinectforWindows–HardwareandSDKOverview
•TheNUIisbasedonnatureornaturalelements.(theslidegesture,thetouch,thebodymovements,thevoicecommands—alltheseactionsarenaturalandnotdivertingfromournormalbehavior).NUIsarebecomingcrucialforincreasingandenhancingtheuseraccessibilityforsoftwaresolution.ProgrammingaNUIisveryimportantnowadaysanditwillcontinuetoevolveinthefuture.KinectembracestheNUIsprincipleandprovidesapowerfulmultimodalinterfacetotheuser.Wecaninteractwithcomplexsoftwareapplicationsand/orvideogamessimplybyusingourvoiceandournaturalgestures.Kinectcandetectourbodyposition,velocityofourmovements,andourvoicecommands.Itcandetectobjects'positiontoo.
MicrosoftstartedtodevelopKinectasasecretprojectin2006withintheXboxdivisionasacompetitiveWiikiller.In2008,MicrosoftstartedProjectNatal,namedaftertheMicrosoftGeneralManagerofIncubationAlexKipman'shometowninBrazil.The
project'sgoalwastodevelopadeviceincludingdepthrecognition,motiontracking,
facialrecognition,andspeechrecognitionbasedonthevideorecognitiontechnology
developedbyPrimeSense.KinectforXboxwaslaunchedinNovember2010anditslaunchwasindeedasuccess:
itwasanditisstillabreak-throughinthegamingworldanditholdstheGuinnessWorldRecordforbeingthe"fastestsellingconsumerelectronicsdevice"
aheadoftheiPhoneandtheiPad.InDecember2010,PrimeSense()releasedasetofopensourcedriversandAPIsforKinectthatenabledsoftwaredeveloperstodevelopWindowsapplicationsusingtheKinectsensor.Finally,onJune172011MicrosoftlaunchedtheKinectSDKbeta,whichisasetoflibrariesandAPIsthatenableustodesignanddevelopsoftwareapplicationsonMicrosoftplatformsusingtheKinectsensorasamultimodalinterface.WiththelaunchoftheKinectforWindowsdeviceandtheKinectSDK,motioncontrolcomputingisnowadisciplinethatwecanshapeinourgarages,writingsimpleandpowerfulsoftwareapplicationsourselves.Thisbookiswrittenforallofuswhowanttodevelopmarket-readysoftwareapplicationsusingKinectforWindowsthatcantrackaudioandvideoandcontrolmotionbasedonNUI.InanareawhereKinectestablisheditselfinsuchashortspanoftime,thereistheneedtoconsolidateallthetechnicalresourcesanddeveloptheminanappropriateway:
thisisourzero-to-heroKinectinmotionjourney.Thisiswhatthisbookisabout.
ThisbookassumesthatyouhaveabasicknowledgeofC#andthatweallhaveagreatpassiontolearnaboutprogrammingforKinectdevices.ThisbookcanbeenjoyedbyanybodyinterestedinknowingmoreaboutthedeviceandlearninghowtotrackaudioandvideousingtheKinectforWindowsSoftwareDevelopmentKit(SDK)1.6.Wedeeplybelievethisbookwillhelpyoutomasterhowtoprocessvideodepthandaudiostreamandbuildmarket-readyapplicationsthatcontrolmotion.Thisbookhasdeliberatelybeenkeptsimpleandconcise,whichwillaidyoutoquicklygraspthecoreandcriticalconcepts.
BeforejumpingonthecoreofaudioandvisualtrackingwithKinectforWindows,let'stakethespaceofthisintroductionchaptertounderstandwhatthehardwareandsoftwarearchitecturesKinectforWindowsanditsSDK1.6use.
Hardwareoverview
TheKinectdeviceisahorizontalbarcomposedofmultiplesensorsconnectedtoabasewithamotorizedpivot.ThefollowingimageprovidesaschematicrepresentationofallthemainKinecthardwarecomponents.LookingattheKinectsensorfromthefront,fromtheoutsideitispossibletoidentifytheInfrared(IR)Projector
(1),theRGBcamera(3),andthedepthcamera
(2).Anarrayoffourmicrophones(6),thethree-axisaccelerometer(5),andthetiltmotor(4)arearrangedinsidetheplasticcase.
ThedeviceisconnectedtoaPCthroughaUSB2.0cable.ItneedsanexternalpowersupplyinordertoworkbecauseUSBportsdon'tprovideenoughpower.Nowlet'sjumpintothemainfeaturesofitscomponents.
TheIRprojector
TheIRprojectoristhedevicethatKinectusesforprojectingtheIRraysthatareusedforcomputingthedepthdata.TheIRprojector,whichfromtheoutsidelookslikeacommoncamera,isalaseremitterthatconstantlyprojectsapatternofstructuredIRdotsatawavelengtharoundof830nm(patentUS20100118123,PrimeSenseLtd.).Thislightbeamisinvisibletohumaneyes(thattypicallyrespondtowavelengthsfromabout390nmto750nm)exceptforaredbrightdotinthecenterofemitter.Thepatterniscomposedby3x3subpatternsof211x165dots(foratotalof633x495dots).Ineachsubpattern,onespotismuchbrighterthanalltheothers.
Asthedottedlight(spot)hitsanobject,thepatternbecomesdistorted,andthisdistortionisanalyzedbythedepthcamerainordertoestimatethedistance
betweenthesensorandtheobjectitself.
Depthcamera
Thedepthcameraisa(traditional)monochromeCMOS(complementary
metal-oxide-semiconductor)camerathatisfittedwithanIR-passfilter(whichisblockingthevisiblelight).Thedepthcameraisthedevicethat
Kinectusesforcapturingthedepthdata
Thedepthcameraisthesensorreturningthe3Dcoordinates(x,y,z)ofthesceneasastream.ThesensorcapturesthestructuredlightemittedbytheIRprojectorandthelightreflectedfromtheobjectsinsidethescene.Allthisdataisconvertedintoastreamofframes.EverysingleframeisprocessedbythePrimeSensechipthatproducesanoutputstreamofframes.Theoutputresolutionisupto640x480pixels.Eachpixel,basedon11bits,canrepresent2048levelsofdepth.
TheRGBcamera
TheRGBcameraissimilartoacommoncolorwebcam,butunlikeacommonwebcam,theRGBcamerahasn'tgotanIR-cutfilter.ThereforeintheRGBcamera,theIRisreachingtheCMOS.Thecameraallowsaresolutionupto1280x960pixelswith12imagespersecondspeed.Wecanreachaframerateof30imagespersecondataresolutionof640x480with8bitsperchannelproducingaBayerfilteroutputwithaRGGBDpattern.Thiscameraisalsoabletoperformcolorflickeravoidance,colorsaturationoperations,andautomaticwhitebalancing.Thisdataisutilizedtoobtainthedetailsofpeopleandobjectsinsidethescene.
Microsoftnow announced ithasstarteddeliveringKinectforWindowsv2DeveloperPreviewkitstodeveloperswhosignedup forthe$399program.TheDeveloperPreviewincludesapre-releaseKinectforWindowsv2sensorandthenextreleaseoftheKinectforWindowssoftwaredevelopmentkit(SDK).
Microsoftsaysitreceived“thousandsofapplications”fortheprogramandselectedanunknownnumber(again,“thousands”)ofparticipantsbasedontheir“expertise,passion,andtherawcreativityoftheirideas.”Thecompanyispromisingongoingupdatesaswellasaccesstoprivateforumswheredeveloperscandiscusswhatworksandwhatdoesn’t.
Thebestpart,however,isthatparticipantswillalsoreceiveaKinectforWindowsv2sensorwhentheybecomeavailable“nextsummer.”Microsoftwouldn’tshareamorespecifictimeframethanthat.
TheKinectforWindowsv2sensorwillfeaturethecorecapabilitiesofthenewKinectforXboxOnesensor,includinganultrawide-angle1080pHDdepthcamera.ThedevicecapturesRGBcolorvideoataround30framespersecondandcanevenmonitortheuser’sheartrate.Hereishowthecompanybreaksdowntheimprovements:
RealVision:
KinectRealVisiontechnologydramaticallyexpandsitsfieldofviewforgreaterlineofsight.Anall-newactiveIRcameraenablesittoseeinthedark.Andbyusingadvancedthree-dimensionalgeometry,itcaneventellifyou’restandingoffbalance.
RealMotion:
KinectRealMotiontechnologytrackseventheslightestgestures.Soasimplesqueezeofyourhandresultsinprecisecontroloveranapplication,whetheryou’restandinguporsittingdown.
RealVoice:
KinectRealVoicetechnologyfocusesonthesoundsthatmatter.Thankstoanall-newmulti-microphonearray,theadvancednoiseisolationcapabilityletsthesensorknowwhotolistento,eveninacrowdedspace.
ItbeatstheoriginalKinectonalmosteverylevel.MicrosoftbelievesitsNaturalUserInterface(NUI)benefitswillimpactmultipleindustries,fromretailandmanufacturingtohealthcare,education,communications,andsoon.Wedon’tdoubt
- 配套讲稿:
如PPT文件的首页显示word图标,表示该PPT已包含配套word讲稿。双击word图标可打开word文档。
- 特殊限制:
部分文档作品中含有的国旗、国徽等图片,仅作为作品整体效果示例展示,禁止商用。设计者仅对作品中独创性部分享有著作权。
- 关 键 词:
- kinect windowshardware和sdk概述 外文文献翻译学位论文 windowshardware sdk 概述 外文 文献 翻译 学位 论文