CN102004843A - Handheld control roaming system with pattern recognition function - Google Patents
Handheld control roaming system with pattern recognition function Download PDFInfo
- Publication number
- CN102004843A CN102004843A CN2010102739575A CN201010273957A CN102004843A CN 102004843 A CN102004843 A CN 102004843A CN 2010102739575 A CN2010102739575 A CN 2010102739575A CN 201010273957 A CN201010273957 A CN 201010273957A CN 102004843 A CN102004843 A CN 102004843A
- Authority
- CN
- China
- Prior art keywords
- roaming system
- module
- software
- layer software
- hand
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Mobile Radio Communication Systems (AREA)
Abstract
The invention relates to a handheld control roaming system with pattern recognition function, which belongs to the technical field of wireless sensor multimedia modeling. In the handheld control roaming system, the motion track of handheld equipment is positioned by an acceleration transducer and a micro-electromechanical system (MEMS) gyroscope, so that the motion of a person is simulated; and voice information of an operator is acquired by a silicon microphone, processed by an advanced RISC machines (ARM) microprocessor in the handheld equipment and is transmitted to analytical layer software through a ZigBee wireless network to perform route recognition and voice recognition, so that a reasonable control command is transmitted to presentation layer software, the roaming system executes the appointed operation and the processed image information is transmitted to a liquid crystal display screen through a video graphics array (VGA). The handheld control roaming system gets rid of the limit of the conventional mouse and keyboard, is small in volume and flexible and convenient in operation, can be entered in a three-dimensional full-immersion mode, and can transmit an accurate and quick command to the appointed occasion in time or execute the appointed operation.
Description
Technical field
The invention belongs to wireless sensing multimedia modeling technique field, relate in particular to a kind of hand-held control virtual roaming system with pattern recognition function.
Background technology
The virtual roaming system adopts the virtual reality technology performance.Virtual reality (VR) technology is one of focus direction of always paying close attention to of the academic boundary of domestic and international computing machine, and it is constantly developing in the exploration and practice.It makes up out an interactive environment that is really true to life with actual environment by computing machine, makes the user with the mode of nature and the object interaction in the virtual environment, thereby produces impression and the experience that is equal to true environment.It has in fields such as military affairs, city planning, tourism, amusement, engineering design, medical science, education very widely uses, with network, multimedia and be called three big technology of tool application prospect of 21 century.
The virtual roaming system is the integrated application of virtual reality technology, because valuable 3I characteristic---feeling of immersion, interactivity and imagination are arranged, makes that other roaming technologies and the system that continue to use means such as fixing roaming path can't be by comparison.At present, the maximum difficult point of Virtual Building scene walkthrough is the contradiction of modeling fidelity and drafting real-time.Because the scene that this roaming is seen is near from the observer, require to draw very true to nature.Therefore, structure is meticulous during modeling, can consume a lot of times.Equally, because the restriction of computing power, the model that constructs is complicated more, and it is just difficult more to reach live effect when drawing, and real-time is too poor will to make the observer accept, and operation is also difficult.
The present virtual roaming system that implements, what its operation was adopted is that keyboard and mouse are conventional common input equipment, complex operation.In addition, existing virtual roaming system does not generally have pattern recognition function, can not gather user's command information fast and accurately, the characteristics that do not possess accurate location can not apply the operation of ordering more quickly and accurately to given scenario or execution appointment to presentation layer roaming software in time.
Summary of the invention
The purpose of this invention is to provide a kind of hand-held control roaming system with pattern recognition function, make the operator only need adjust handheld device, just can realize entering roaming system from the full immersion of three-dimensional perspective, and can apply the operation of ordering quickly and accurately in time to given scenario or execution appointment, break away from the restriction of conventional mouse-keyboard, convenient and swift.
Realize principle of the present invention:
Utilize acceleration transducer, MEMS gyroscope to locate the movement locus of handheld device, thereby simulation personage's movement locus, and utilize silicon microphone to collect operator's voice messaging, after the ARM microprocessor processes in handheld device, by RF CC2430 chip through the ZigBee wireless network transmissions to analysis layer software, use rational algorithm, carry out approach identification and speech recognition, thereby presentation layer software is sent rational control command, make roaming system jump to corresponding scene, carry out the operation of appointment.
Technical scheme of the present invention:
This has the hand-held control of pattern recognition function roaming system by handheld device, the ZigBee wireless-transmission network, and analysis layer software and presentation layer software four parts constitute.Wherein,
(1) handheld device: form by sensor assembly, micro treatment module, data transmission module, 4 parts of power module.Its function can be located the movement locus of self, collects operator's voice messaging, and the information of collecting is carried out being sent to the ZigBee wireless network after the pre-service transmits.
(2) ZigBee wireless network transmissions part: the integrated RF transmitting-receiving CC2430 chip that meets the 2.4GHz of IEEE802.15.4 standard, hardware supported CSMA/CA function; Be applicable to short distance radio communication among a small circle, can control the data output and the input of various sensors; Its function is that the information that will handle well gathers and is sent to analysis layer software.
(3) analysis layer software: analysis layer software adopts the mode of pattern-recognition, the information that is transmitted by RF transmitting-receiving CC2430 chip is carried out the typical module discriminance analysis, by rational algorithm, the correct control signal that goes out identification of realization approach and speech identifying function, final analysis instructs presentation layer to realize corresponding operation.
(4) presentation layer software (roaming system software): software is divided into graphic plotting piece, acoustic processing piece and input processing block.Its function is that the graphic plotting piece can form complete real-time three-dimensional scenic; The acoustic processing piece is handled background music and sound equipment audio; Import the signal of processing block Treatment Analysis layer transmission, and signal is identified as corresponding message, again by the message trigger events corresponding.
The invention has the advantages that:
(1) data acquisition unit is by acceleration transducer, the MEMS gyroscope, and silicon microphone is integrated, can and collect operator's voice messaging to the handheld device location, save the troublesome operation of conventional common input equipment.
(2) have speech identifying function, auxiliary approach recognition function can be roamed software to presentation layer and apply order more quickly and accurately, saves the inconvenience of mobile hand-held device significantly.
(3) pass through different scene modelings, just renewable virtual roaming software has high reusability.
(4) lightly portable, long service life;
(5) take up room for a short time, system's oneself power consumption is low;
(6) environmental protection can reuse.
Description of drawings
Fig. 1 is an one-piece construction block diagram of the present invention
Fig. 2 is the structural drawing of handheld device
Fig. 3 is a RF CC2430 chip periphery typical application circuit
Fig. 4 is the pattern recognition system block diagram
Specific implementation
Discuss particular content of the present invention in conjunction with the accompanying drawings in detail, have the device of the hand-held control of pattern recognition function roaming system, by handheld device, the ZigBee wireless-transmission network, analysis layer software and presentation layer software four parts constitute, as shown in Figure 1.
The handset data collecting part is by acceleration transducer, the MEMS gyroscope, sensors such as silicon microphone are integrated, arm processor pick-up transducers data, by the ZigBee network with information aggregating to the Computer Analysis layer; Analysis layer software is made up of two parts, i.e. approach identification software and speech recognition software; Presentation layer, i.e. roaming system software, the identifying information of receiving and analyzing layer generates the scene picture, by VGA the image information of handling well is transferred on the LCDs at last.
Wherein:
(1) handheld device: as shown in Figure 2, form by sensor assembly, micro treatment module, data transmission module, 4 parts of power module.Sensor assembly is by acceleration transducer, the MEMS gyroscope, and silicon microphone is integrated, is responsible for the collection of information and is digital signal with the signal transition of gathering, and sends micro treatment module to; Micro treatment module is responsible for controlling processing operation, Routing Protocol, power managed, the task management of whole node and is realized the reliable communication protocol of network security.Data transmission module is responsible for communicating with other nodes, exchange control messages and transceive data.Adopt RF transceiving chip CC2430, pass through I
2C bus and discrete control signal and microprocessor communicate, and by the UART agreement data to be sent are write the wireless data transfer module transmit queue, wait to be sent.Power module is made up of lithium battery commonly used, also can adopt miniature button cell, further reduces volume.
Tcp data segment adopts RF CC2430 chip, realizes that by general-purpose interface additional function and system core module are separated, and reduces system complexity, and can add the energy monitoring module so that further control system power consumption.Wireless sensor network node is the embedded system of a microminiaturization, has constituted the Infrastructure support platform of wireless sensor network.Node adopts serial interface communication mode, utilizes the method for interrupting to finish the reception and the transmission of data.
(2) ZigBee wireless network transmissions part: ZigBee adopts the IEEE802.15.4 standard, utilizes frequency 2.4GHz, is applied to supervision, Control Network.Tcp data segment RF CC2430 chip in the handheld device, exemplary operation circuit as shown in Figure 3, current loss is 27mA during this chip operation, is applicable to the wireless network node of various ZigBee or similar ZigBee.The CC2430 chip has the 8051 microcontrollers nuclear of high-performance and low-power consumption, the integrated RF transceiver that meets the 2.4GHz of IEEE802.15.4 standard, characteristics with the highly sensitive and strong interference immunity of wireless receiving, the stream consumption that 0.9 μ A is only arranged under park mode, greatly reduce system power dissipation, hardware supported CSMA/CA function.
(3) analysis layer software: analysis layer software adopts the mode of pattern-recognition, is divided into Path Recognition and speech recognition, by data obtain, pre-service, feature extraction and selection, classifier design, categorised decision five parts form; The numerical information that sends by the ZigBee wireless-transmission network, from the recognizer of three aspect researchs such as pre-service, feature extraction and classifier design based on Path Recognition and speech recognition, to be mapped to feature space through pre-service and feature extraction and after selecting in the numerical information that signal space obtains, again behind classifier design and categorised decision, presentation layer software is sent suitable control signal, thus control roaming path and realization scheduled operation.
(4) presentation layer software is roaming system software: based on the virtual roaming system of PC hardware platform and Windows operating system platform.Software is divided into graphic plotting piece, acoustic processing piece and input processing block.The graphic plotting piece need carry out the scene design in early stage, and utilizes D modeling tool to set up out corresponding scene, uses OpenGL graphic plotting function to draw usually, finally forms complete real-time three-dimensional scenic.The acoustic processing piece uses the DirectX kit of Microsoft to handle background music and sound equipment audio, realizes audio mixing, the feeling of immersion of strengthening system.Input processing module, main processes sensor is input to the signal of system, and signal is identified as corresponding message, again by the message trigger events corresponding.
Claims (9)
1. hand-held control roaming system with pattern recognition function, it is characterized in that: this system is made of handheld device, ZigBee wireless-transmission network, analysis layer software and presentation layer software four parts, wherein:
1) handheld device: form by sensor assembly, micro treatment module, data transmission module, 4 parts of power module; Its function can be located the movement locus of self, collects operator's voice messaging, and the information of collecting is carried out being sent to the ZigBee wireless network after the pre-service transmits;
2) ZigBee wireless network transmissions part: the integrated RF transmitting-receiving CC2430 chip that meets the 2.4GHz of IEEE802.15.4 standard, hardware supported CSMA/CA function, be applicable to short distance radio communication among a small circle, can control the data output and the input of various sensors; Its function is that the information that will handle well gathers and is sent to analysis layer software;
3) analysis layer software: analysis layer software adopts the mode of pattern-recognition, the information of being come by the Zigbee wireless network transmissions is carried out the typical module discriminance analysis, by rational algorithm, the correct control signal that goes out identification of realization approach and speech identifying function, final analysis instructs presentation layer to realize corresponding operation;
4) presentation layer software is roaming system software: software is divided into graphic plotting piece, acoustic processing piece and input processing block; Its function is that the graphic plotting piece can form complete real-time three-dimensional scenic, the acoustic processing piece is handled background music and sound equipment audio, imported the signal that processing block Treatment Analysis layer transmits, and signal is identified as corresponding message, again by the message trigger events corresponding.
2. hand-held control roaming system according to claim 1, it is characterized in that: the sensor assembly of described handheld device is by acceleration transducer, the MEMS gyroscope, and silicon microphone is integrated, be responsible for the collection of information and be digital signal, send micro treatment module to the signal transition of gathering.
3. hand-held control roaming system according to claim 1 is characterized in that: the micro treatment module of described handheld device is responsible for controlling processing operation, Routing Protocol, power managed, the task management of whole node and is realized the reliable communication protocol of network security.
4. hand-held control roaming system according to claim 1 is characterized in that: the data transmission module of described handheld device is responsible for communicating with other nodes, exchange control messages and transceive data.Adopt RF transceiving chip CC2430, communicate by I2C bus and some discrete control signals and ARM microprocessor, and data to be sent are write the wireless data transfer module transmit queue, wait to be sent by the UART agreement.
5. hand-held control roaming system according to claim 1 is characterized in that: the power module of described handheld device is made up of lithium battery commonly used, or adopts miniature button cell.
6. hand-held control roaming system according to claim 1, it is characterized in that: tcp data segment adopts RF CC2430 chip, realize that by general-purpose interface additional function and system core module are separated, reduce system complexity, and can add the energy monitoring module so that further control system power consumption.
7. hand-held control roaming system according to claim 1 is characterized in that: described analysis layer software adopts the mode of pattern-recognition, is divided into Path Recognition and speech recognition; By data obtain, pre-service, feature extraction and selection, classifier design, categorised decision five parts form; The numerical information that sends by the ZigBee wireless-transmission network, from the recognizer of three aspect researchs such as pre-service, feature extraction and classifier design based on Path Recognition and speech recognition, to be mapped to feature space through pre-service and feature extraction and after selecting in the numerical information that signal space obtains, again behind classifier design and categorised decision, presentation layer software is sent suitable control signal, thus control roaming path and realization scheduled operation.
8. hand-held control roaming system according to claim 1, it is characterized in that: described presentation layer software is roaming system software, graphic plotting piece wherein, need carry out the scene design in early stage, and utilize D modeling tool to set up out corresponding scene, usually use OpenGL graphic plotting function to draw, finally form complete real-time three-dimensional scenic; The acoustic processing piece uses the DirectX of Microsoft to realize, through handling background music and sound equipment audio, realizes audio mixing, the feeling of immersion of strengthening system; Input processing module, main processes sensor is input to the signal of system, and signal is identified as corresponding message, again by the message trigger events corresponding.
9. hand-held control roaming system according to claim 1 is characterized in that: described roaming system software is based on the virtual roaming system of PC hardware platform and Windows operating system platform.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010102739575A CN102004843A (en) | 2010-09-07 | 2010-09-07 | Handheld control roaming system with pattern recognition function |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010102739575A CN102004843A (en) | 2010-09-07 | 2010-09-07 | Handheld control roaming system with pattern recognition function |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102004843A true CN102004843A (en) | 2011-04-06 |
Family
ID=43812201
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010102739575A Pending CN102004843A (en) | 2010-09-07 | 2010-09-07 | Handheld control roaming system with pattern recognition function |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102004843A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102323856A (en) * | 2011-08-09 | 2012-01-18 | 大连民族学院 | Data glove based on acceleration sensors and ZigBee |
| CN102722240A (en) * | 2011-05-18 | 2012-10-10 | 北京大学深圳研究生院 | Text information input system, handwriting input device and text information input method |
| CN102722275A (en) * | 2012-05-29 | 2012-10-10 | 惠州Tcl移动通信有限公司 | Mobile terminal and three-dimensional graphical presentation control system based on gyroscope and method thereof |
| CN102880309A (en) * | 2012-08-24 | 2013-01-16 | Tcl通力电子（惠州）有限公司 | Method and system for controlling application on image equipment |
| WO2013029303A1 (en) * | 2011-08-30 | 2013-03-07 | 江苏惠通集团有限责任公司 | Attitude sensing device and positioning, mouse cursor control method and device thereof |
| CN102982671A (en) * | 2012-11-12 | 2013-03-20 | 重庆大学 | Mechanical vibration monitoring special-purposed wireless sensor network node |
| CN103207677A (en) * | 2013-04-22 | 2013-07-17 | 北京工业大学 | System and method for realizing virtual-real somatosensory interaction of digital Zenghouyi bells |
| CN103776451A (en) * | 2014-03-04 | 2014-05-07 | 哈尔滨工业大学 | High-precision three-dimensional posture inertia measurement system and method based on MEMS (Micro Electro Mechanical Systems) |
| CN107005808A (en) * | 2014-12-09 | 2017-08-01 | 罗伯特·博世有限公司 | System, especially portable power tool system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101101666A (en) * | 2007-08-09 | 2008-01-09 | 中国科学院计算技术研究所 | Dummy role movement synthesis method based on movement capturing data |
| CN101136022A (en) * | 2006-09-01 | 2008-03-05 | 李筑 | Panorama manufacturing and displaying system of resource information |
| CN101256590A (en) * | 2008-04-03 | 2008-09-03 | 北京艺龙天地文化传播有限公司 | Simulation system for three-dimensional on-line virtual reality of environment combining with WebGis and method thereof |
| CN201364657Y (en) * | 2008-12-12 | 2009-12-16 | 大连海事大学 | Virtual reality simulation system of ship engine room |
-
2010
- 2010-09-07 CN CN2010102739575A patent/CN102004843A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101136022A (en) * | 2006-09-01 | 2008-03-05 | 李筑 | Panorama manufacturing and displaying system of resource information |
| CN101101666A (en) * | 2007-08-09 | 2008-01-09 | 中国科学院计算技术研究所 | Dummy role movement synthesis method based on movement capturing data |
| CN101256590A (en) * | 2008-04-03 | 2008-09-03 | 北京艺龙天地文化传播有限公司 | Simulation system for three-dimensional on-line virtual reality of environment combining with WebGis and method thereof |
| CN201364657Y (en) * | 2008-12-12 | 2009-12-16 | 大连海事大学 | Virtual reality simulation system of ship engine room |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102722240A (en) * | 2011-05-18 | 2012-10-10 | 北京大学深圳研究生院 | Text information input system, handwriting input device and text information input method |
| CN102323856A (en) * | 2011-08-09 | 2012-01-18 | 大连民族学院 | Data glove based on acceleration sensors and ZigBee |
| WO2013029303A1 (en) * | 2011-08-30 | 2013-03-07 | 江苏惠通集团有限责任公司 | Attitude sensing device and positioning, mouse cursor control method and device thereof |
| CN102722275A (en) * | 2012-05-29 | 2012-10-10 | 惠州Tcl移动通信有限公司 | Mobile terminal and three-dimensional graphical presentation control system based on gyroscope and method thereof |
| CN102880309A (en) * | 2012-08-24 | 2013-01-16 | Tcl通力电子（惠州）有限公司 | Method and system for controlling application on image equipment |
| CN102982671A (en) * | 2012-11-12 | 2013-03-20 | 重庆大学 | Mechanical vibration monitoring special-purposed wireless sensor network node |
| CN103207677A (en) * | 2013-04-22 | 2013-07-17 | 北京工业大学 | System and method for realizing virtual-real somatosensory interaction of digital Zenghouyi bells |
| CN103207677B (en) * | 2013-04-22 | 2017-05-10 | 北京工业大学 | System and method for realizing virtual-real somatosensory interaction of digital Zenghouyi bells |
| CN103776451A (en) * | 2014-03-04 | 2014-05-07 | 哈尔滨工业大学 | High-precision three-dimensional posture inertia measurement system and method based on MEMS (Micro Electro Mechanical Systems) |
| CN103776451B (en) * | 2014-03-04 | 2016-11-09 | 哈尔滨工业大学 | A kind of high-precision three-dimensional attitude inertial measurement system based on MEMS and measuring method |
| CN107005808A (en) * | 2014-12-09 | 2017-08-01 | 罗伯特·博世有限公司 | System, especially portable power tool system |
| US10674316B2 (en) | 2014-12-09 | 2020-06-02 | Robert Bosch Gmbh | System, in particular portable power tool system |
| CN107005808B (en) * | 2014-12-09 | 2020-08-07 | 罗伯特·博世有限公司 | System, in particular hand-held power tool system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102004843A (en) | Handheld control roaming system with pattern recognition function | |
| CN107643509B (en) | Localization method, positioning system and terminal device | |
| CN109870984B (en) | Multi-household-appliance control method based on wearable device | |
| CN103892503A (en) | Intelligent helmet device | |
| CN103455136A (en) | Inputting method, inputting device and inputting system based on gesture control | |
| CN109949795A (en) | A kind of method and device of control smart machine interaction | |
| CN109831689A (en) | A kind of data buffering method and mobile terminal | |
| CN106843069A (en) | One kind is based on the multi-functional mine search and rescue robot of cell-phone customer terminal | |
| CN108362304A (en) | A kind of data processing method and mobile terminal | |
| CN109040968A (en) | Road conditions based reminding method, mobile terminal and computer readable storage medium | |
| CN108519089A (en) | A kind of more people's route planning methods and terminal | |
| CN108917766A (en) | A kind of air navigation aid and mobile terminal | |
| CN109932685A (en) | A kind of localization method, mobile terminal and indoor locating system | |
| CN204649769U (en) | A kind of motion state multimedia monitoring system | |
| CN110377826A (en) | A kind of information-pushing method and mobile terminal | |
| CN110277097A (en) | Data processing method and relevant device | |
| CN107529146A (en) | With reference to more sensing chamber localization method, device, system and the storage mediums of audio | |
| CN206365014U (en) | A kind of handle | |
| CN201995017U (en) | Mobile phone acoustically controlled by microphone | |
| CN204790512U (en) | System of wisdom family | |
| CN104516007A (en) | Intelligent guide service locating device | |
| CN107255482A (en) | Air navigation aid and device | |
| CN204028701U (en) | A kind of miniature four-rotor aircraft control system | |
| Lu et al. | Design and implementation of a smart home system based on the risc-v processor | |
| CN205376089U (en) | Hand -held type appearance of conducting a sightseeing tour |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20110406 |