实例介绍
【实例简介】
kinect v2鲜有的开发书籍，比看msdn要方便的多。 Set up Kinect 2 and a workspace for Kinect application development Access audio, color, infrared, and skeletal data streams from Kinect Use gesture and speech recognition Perform computer vision manipulations on image data streams Develop Windows Store apps and Unity3D
Beginning Microsoft Kinect for Windows SDK 2.0: Motion and Depth sensing for Natural User Interfaces Mansi rahman Montreal, Quebec, Canada ISBN-13(pbk):978-1-4842-2315-4 ISBN-l3( electronic:978-1-4842-2316-1 DOI10.1007/978-1-48422316-1 Library of Congress Control Number: 2017950735 Copyright o 2017 by Mansib rahman This work is subject to copyright All rights are reserved by the Publisher, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed. Trademarked names, logos, and images may appear in this book. Rather than use a trademark symbol with every occurrence of a trademarked name, logo, or image we use the names, logos, and images only in an editorial fashion and to the benefit of the trademark owner, with no intention of infringement of the trademark. The use in this publication of trade names, trademarks, service marks, and similar terms, even if they are not identified as such, is not to be taken as an expression of opinion as to whether or not they are subject to proprietary rights. While the advice and information in this book are believed to be true and accurate at the date of publication, neither the authors nor the editors nor the publisher can accept any legal responsibility for any errors or omissions that may be made. The publisher makes no warranty, express or implied, with respect to the material contained herein Cover image designed by Freepik Managing director: Welmoed spahr Editorial director. Todd green Acquisitions Editor: Jonathan Gennick Development Editor: Laura berendson Technical Reviewer: Dwight Goins Coordinating Editor Jill Balzano Copy Editor: April rondeau Compositor: SPi Global Indexer: SPi global Artist: SPi global Distributed to the book trade worldwide by Springer Science+ Business Media New York 233 Spring Street, 6th Floor, New York, NY 10013. Phone 1-800-SPRINGER, fax(201)348-4505, e-mail orders-ny@springer-sbm.comorvisitwww.springeronline.comApressMedia,LlcisaCaliforniaLlc and the sole member (owner)is Springer Science Business Media Finance Inc(SSBM Finance Inc) SSBM Finance Inc is a Delaware corporation Forinformationontranslationspleasee-mailrights@apress.comorvisithttp://www.apress.com/ rights-permissions press titles may be purchased in bulk for academic, corporate, or promotional use. e Book versions and licenses are also available for most titles for more information reference our print and ebook bulk sales webpageathttp://www.apress.com/bulk-sales Any source code or other supplementary material referenced by the author in this book is available to readersongIthubviathebooksproductpagelocatedatwww.apress.com/9781484223154.Formore detailedinformationpleasevisithttp://www.apress.com/source-code Printed on acid-free paper In loving memory of Uncle mannan. Entrepreneur for the ages; may your fingerprints taint the pages of this book Contents at a glance About the author mmm xii About the technical reviewer ■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■ XV Acknowledgments ■■■■■■■ XVI Introduction mix Chapter 1: Getting Started ■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■ Chapter 2: Understanding how the kinect Works 21 Chapter 3: Working with Image Data Sources. mmmIIRIIEIII n: 41 Chapter 4: Audio Speech mmnammmmmmmnmmmmmmmmmmmmmmmmmmmmmmm 77 Chapter 5: Body Face Tracking 105 Chapter 6: Computer Vision Image processingaaaan 161 Chapter 7: Game Development with Unity. adamant ■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■口■■■■■■■■■ 207 Chapter 8: Miscellaneous Tools mamma 227 Appendix A: Windows 10 Universal windows Platform mmmmmmmmnmmammann 261 Index…295 Contents About the author mmm xii About the technical reviewer ■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■ XV Acknowledgments ■■■■■■■ XVI Introduction mix Chapter 1: Getting Started ■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■ Hardware Requirements DDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDD 111 Required specs… Software Requirements 3 Installing and Setting Up the Kinect Verifying That the Kinect Driver Is Installed Correctly Positioning the Kinect, and other Starting a Kinect project in visual studio Adding the Kinect Reference Through a Local Reference Adding the Kinect Reference Through NuGet Completing and Launching Your Kinect Project in Visual Studio………… 12 Creating the User Interface Firing Up the Kinect and Taking It for a Spin 17 Kinect evolution 18 Summary 20 Chapter 2: Understanding how the kinect Works mmammmma 21 Exploring the hardware.... 21 Inside the kinect Comparing the Kinect for Windows vi to the Kinect for Windows v2. coNTENtS Exploring the software Interface 29 Understanding Data Sources 29 Readers and frames 30 Working with Kinect Studio 33 Using Kinect studio. Recording and playing Back.... …37 Summary 40 Chapter 3: Working with Image Data Sources. marIN, 41 ColorFrame Source: Color Image Data 41 ColorFrame Source in WPF ColorFrame Source in Windows Store Apps. ...................................................48 Casual Image Manipulation.. 52 InfraredFrame Source: Infrared Image data. Displaying Infrared Data 57 Depth Frame Source: Depth Image Data 61 Displaying Depth Data 62 Visualization techn Summar Chapter 4: Audio Speech Working with Kinect's Audio Features 78 Recording audi 78 Audio Beam Properties 85 Using Kinect for Speech Recognition.……87 Installing microsoft speech 88 Integrating Microsoft Speech in an Application Speech Recognition in Windows Store Apps...........................100 Human Interface Guidelines for Voice Input. m..mmmm.mmmmmmmmmm....n 101 Environment………101 Confidence Levels 101 CONtENTS Word choice 102 nteraction Design…...........................,…….,102 Summary.....,….103 Chapter 5: Body Face Tracking aat ■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■口■■■■■■■■■■■■■■■■■■■■口■■■■■■■■口 105 Body Frame Source: Skeletal Data …105 Drawing skeletons....……106 Understanding Joint Orientations 122 Determining Body Lean 126 Bodylndex Frame Source: Body Index Data 129 Displaying bodyIndex Data 129 Rudimentary Green Screen App.…,,…,…………131 FaceFrameSource HighDefinition Face Frame Source: Facial Structure Data 135 Face.. HD Face Conclusion …160 Chapter 6: Computer Vision Image Processing mmmmmmmmmmmmmn 161 Setting Up Mgu CV 163 System Specs......................... 163 nstallation& Verification,…… ,163 Including Emgu CV as a dependency . Manipulating Images in Emgu cV........,…,……167 Understanding mat Using Mat with Kinect Image Data Basic Image Processing Techniques 170 Color Conversion Thresholding 174 Smoothing… 176 Morphological Transformations 日日日日日日日日日a日自日日自日日日日日日日日面日面日面日面日面日面日面日面日面日面日面日面日面日面日面 179 Bitwise Arithmetical Operations 185 CONTENTS Object Detection 198 Simple blob detecto Conclusion 206 Chapter 7: Game Development with Unity ■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■口■■■■■■■■■■■■■■■■■■ 207 Getting Started 207 Understanding Kinect for Windows v2 for Unity Through Kinectview…………………………212 Summary 226 Chapter 8: Miscellaneous Tools amama 227 Visual gesture builder 227 Discrete gestures 228 Continuous gestures 237 Including Gesture Databases in a Kinect project...,………,241 Kinect fusion 245 Kinect Fusion Explorer 246 3D Scan 250 Kinect ripple 251 Physical Setup 252 Configuring content 253 Ripple sdk 255 Conclusion, m. mm.. 258 Conclusion for real 259 Appendix A: Windows 10& Universal Windows Platform m mmmmanamnn 261 Dwight Goins 261 Foreword by Mansi Rahman 261 Introduction 262 Windows 10 UWP Paradigm.amamamm.m.mmmmttn....mm...t............... 262 One billion devices 262 Lifecycle Management…...,..,…,…,…,…,……….262 System Environment changes................................263 Packaging and store Submission..……………264 CONtENTS History of the Kinect and windows 10 265 Windows 10 UWP Kinect Architecture 268 How Do the New components Work Together? 269 Microsoft media foundation(MF)..,,,,…,,…,…,…,…,…,……………270 Device Perception provider Updated Kinect Driver...,.,….,….….…..273 Similarities in the architecture m..m.m.m...m.m.m.. 274 Creating a Windows 10 UWP Kinect-Based Store app 274 How to get the latest drivers 274 Building a uwp store application 277 How to Access data streams. How to work with color 日日面日日面日面日日自日面日日日面日日自日面面日日日自日日自日面面日日日自日日自日面面日日自日自日面日自日面日日日自日面日自日面日 284 How to Work with Depth 290 Howtoworkwithirwww.291 How to Work with Custom Data Streams( How to Use audio 日日日面日日日日自日日面日日日面面日自日日面日日自日面面日日日日面日自目日面日自日自日面面日自日日面日自日自日面面日自日日日日自日日面日自日 293 What about kinect fusion face hd Face. visual gesture builder and kinect studio tools?,m. 293 Summary 日面口 日面口 294 Index 295 【实例截图】
【核心代码】
kinect v2鲜有的开发书籍，比看msdn要方便的多。 Set up Kinect 2 and a workspace for Kinect application development Access audio, color, infrared, and skeletal data streams from Kinect Use gesture and speech recognition Perform computer vision manipulations on image data streams Develop Windows Store apps and Unity3D
Beginning Microsoft Kinect for Windows SDK 2.0: Motion and Depth sensing for Natural User Interfaces Mansi rahman Montreal, Quebec, Canada ISBN-13(pbk):978-1-4842-2315-4 ISBN-l3( electronic:978-1-4842-2316-1 DOI10.1007/978-1-48422316-1 Library of Congress Control Number: 2017950735 Copyright o 2017 by Mansib rahman This work is subject to copyright All rights are reserved by the Publisher, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed. Trademarked names, logos, and images may appear in this book. Rather than use a trademark symbol with every occurrence of a trademarked name, logo, or image we use the names, logos, and images only in an editorial fashion and to the benefit of the trademark owner, with no intention of infringement of the trademark. The use in this publication of trade names, trademarks, service marks, and similar terms, even if they are not identified as such, is not to be taken as an expression of opinion as to whether or not they are subject to proprietary rights. While the advice and information in this book are believed to be true and accurate at the date of publication, neither the authors nor the editors nor the publisher can accept any legal responsibility for any errors or omissions that may be made. The publisher makes no warranty, express or implied, with respect to the material contained herein Cover image designed by Freepik Managing director: Welmoed spahr Editorial director. Todd green Acquisitions Editor: Jonathan Gennick Development Editor: Laura berendson Technical Reviewer: Dwight Goins Coordinating Editor Jill Balzano Copy Editor: April rondeau Compositor: SPi Global Indexer: SPi global Artist: SPi global Distributed to the book trade worldwide by Springer Science+ Business Media New York 233 Spring Street, 6th Floor, New York, NY 10013. Phone 1-800-SPRINGER, fax(201)348-4505, e-mail orders-ny@springer-sbm.comorvisitwww.springeronline.comApressMedia,LlcisaCaliforniaLlc and the sole member (owner)is Springer Science Business Media Finance Inc(SSBM Finance Inc) SSBM Finance Inc is a Delaware corporation Forinformationontranslationspleasee-mailrights@apress.comorvisithttp://www.apress.com/ rights-permissions press titles may be purchased in bulk for academic, corporate, or promotional use. e Book versions and licenses are also available for most titles for more information reference our print and ebook bulk sales webpageathttp://www.apress.com/bulk-sales Any source code or other supplementary material referenced by the author in this book is available to readersongIthubviathebooksproductpagelocatedatwww.apress.com/9781484223154.Formore detailedinformationpleasevisithttp://www.apress.com/source-code Printed on acid-free paper In loving memory of Uncle mannan. Entrepreneur for the ages; may your fingerprints taint the pages of this book Contents at a glance About the author mmm xii About the technical reviewer ■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■ XV Acknowledgments ■■■■■■■ XVI Introduction mix Chapter 1: Getting Started ■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■ Chapter 2: Understanding how the kinect Works 21 Chapter 3: Working with Image Data Sources. mmmIIRIIEIII n: 41 Chapter 4: Audio Speech mmnammmmmmmnmmmmmmmmmmmmmmmmmmmmmmm 77 Chapter 5: Body Face Tracking 105 Chapter 6: Computer Vision Image processingaaaan 161 Chapter 7: Game Development with Unity. adamant ■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■口■■■■■■■■■ 207 Chapter 8: Miscellaneous Tools mamma 227 Appendix A: Windows 10 Universal windows Platform mmmmmmmmnmmammann 261 Index…295 Contents About the author mmm xii About the technical reviewer ■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■ XV Acknowledgments ■■■■■■■ XVI Introduction mix Chapter 1: Getting Started ■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■ Hardware Requirements DDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDD 111 Required specs… Software Requirements 3 Installing and Setting Up the Kinect Verifying That the Kinect Driver Is Installed Correctly Positioning the Kinect, and other Starting a Kinect project in visual studio Adding the Kinect Reference Through a Local Reference Adding the Kinect Reference Through NuGet Completing and Launching Your Kinect Project in Visual Studio………… 12 Creating the User Interface Firing Up the Kinect and Taking It for a Spin 17 Kinect evolution 18 Summary 20 Chapter 2: Understanding how the kinect Works mmammmma 21 Exploring the hardware.... 21 Inside the kinect Comparing the Kinect for Windows vi to the Kinect for Windows v2. coNTENtS Exploring the software Interface 29 Understanding Data Sources 29 Readers and frames 30 Working with Kinect Studio 33 Using Kinect studio. Recording and playing Back.... …37 Summary 40 Chapter 3: Working with Image Data Sources. marIN, 41 ColorFrame Source: Color Image Data 41 ColorFrame Source in WPF ColorFrame Source in Windows Store Apps. ...................................................48 Casual Image Manipulation.. 52 InfraredFrame Source: Infrared Image data. Displaying Infrared Data 57 Depth Frame Source: Depth Image Data 61 Displaying Depth Data 62 Visualization techn Summar Chapter 4: Audio Speech Working with Kinect's Audio Features 78 Recording audi 78 Audio Beam Properties 85 Using Kinect for Speech Recognition.……87 Installing microsoft speech 88 Integrating Microsoft Speech in an Application Speech Recognition in Windows Store Apps...........................100 Human Interface Guidelines for Voice Input. m..mmmm.mmmmmmmmmm....n 101 Environment………101 Confidence Levels 101 CONtENTS Word choice 102 nteraction Design…...........................,…….,102 Summary.....,….103 Chapter 5: Body Face Tracking aat ■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■口■■■■■■■■■■■■■■■■■■■■口■■■■■■■■口 105 Body Frame Source: Skeletal Data …105 Drawing skeletons....……106 Understanding Joint Orientations 122 Determining Body Lean 126 Bodylndex Frame Source: Body Index Data 129 Displaying bodyIndex Data 129 Rudimentary Green Screen App.…,,…,…………131 FaceFrameSource HighDefinition Face Frame Source: Facial Structure Data 135 Face.. HD Face Conclusion …160 Chapter 6: Computer Vision Image Processing mmmmmmmmmmmmmn 161 Setting Up Mgu CV 163 System Specs......................... 163 nstallation& Verification,…… ,163 Including Emgu CV as a dependency . Manipulating Images in Emgu cV........,…,……167 Understanding mat Using Mat with Kinect Image Data Basic Image Processing Techniques 170 Color Conversion Thresholding 174 Smoothing… 176 Morphological Transformations 日日日日日日日日日a日自日日自日日日日日日日日面日面日面日面日面日面日面日面日面日面日面日面日面日面日面 179 Bitwise Arithmetical Operations 185 CONTENTS Object Detection 198 Simple blob detecto Conclusion 206 Chapter 7: Game Development with Unity ■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■口■■■■■■■■■■■■■■■■■■ 207 Getting Started 207 Understanding Kinect for Windows v2 for Unity Through Kinectview…………………………212 Summary 226 Chapter 8: Miscellaneous Tools amama 227 Visual gesture builder 227 Discrete gestures 228 Continuous gestures 237 Including Gesture Databases in a Kinect project...,………,241 Kinect fusion 245 Kinect Fusion Explorer 246 3D Scan 250 Kinect ripple 251 Physical Setup 252 Configuring content 253 Ripple sdk 255 Conclusion, m. mm.. 258 Conclusion for real 259 Appendix A: Windows 10& Universal Windows Platform m mmmmanamnn 261 Dwight Goins 261 Foreword by Mansi Rahman 261 Introduction 262 Windows 10 UWP Paradigm.amamamm.m.mmmmttn....mm...t............... 262 One billion devices 262 Lifecycle Management…...,..,…,…,…,…,……….262 System Environment changes................................263 Packaging and store Submission..……………264 CONtENTS History of the Kinect and windows 10 265 Windows 10 UWP Kinect Architecture 268 How Do the New components Work Together? 269 Microsoft media foundation(MF)..,,,,…,,…,…,…,…,…,……………270 Device Perception provider Updated Kinect Driver...,.,….,….….…..273 Similarities in the architecture m..m.m.m...m.m.m.. 274 Creating a Windows 10 UWP Kinect-Based Store app 274 How to get the latest drivers 274 Building a uwp store application 277 How to Access data streams. How to work with color 日日面日日面日面日日自日面日日日面日日自日面面日日日自日日自日面面日日日自日日自日面面日日自日自日面日自日面日日日自日面日自日面日 284 How to Work with Depth 290 Howtoworkwithirwww.291 How to Work with Custom Data Streams( How to Use audio 日日日面日日日日自日日面日日日面面日自日日面日日自日面面日日日日面日自目日面日自日自日面面日自日日面日自日自日面面日自日日日日自日日面日自日 293 What about kinect fusion face hd Face. visual gesture builder and kinect studio tools?,m. 293 Summary 日面口 日面口 294 Index 295 【实例截图】
【核心代码】
标签：
好例子网口号：伸出你的我的手 — 分享！
小贴士
感谢您为本站写下的评论，您的评论对其它用户来说具有重要的参考价值，所以请认真填写。
- 类似“顶”、“沙发”之类没有营养的文字，对勤劳贡献的楼主来说是令人沮丧的反馈信息。
- 相信您也不想看到一排文字/表情墙，所以请不要反馈意义不大的重复字符，也请尽量不要纯表情的回复。
- 提问之前请再仔细看一遍楼主的说明，或许是您遗漏了。
- 请勿到处挖坑绊人、招贴广告。既占空间让人厌烦，又没人会搭理，于人于己都无利。
关于好例子网
本站旨在为广大IT学习爱好者提供一个非营利性互相学习交流分享平台。本站所有资源都可以被免费获取学习研究。本站资源来自网友分享，对搜索内容的合法性不具有预见性、识别性、控制性，仅供学习研究，请务必在下载后24小时内给予删除，不得用于其他任何用途，否则后果自负。基于互联网的特殊性，平台无法对用户传输的作品、信息、内容的权属或合法性、安全性、合规性、真实性、科学性、完整权、有效性等进行实质审查；无论平台是否已进行审查，用户均应自行承担因其传输的作品、信息、内容而可能或已经产生的侵权或权属纠纷等法律责任。本站所有资源不代表本站的观点或立场，基于网友分享，根据中国法律《信息网络传播权保护条例》第二十二与二十三条之规定，若资源存在侵权或相关问题请联系本站客服人员，点此联系我们。关于更多版权及免责申明参见 版权及免责申明
网友评论
我要评论