CN105389013A - Gesture-based virtual playing system - Google Patents
Gesture-based virtual playing system Download PDFInfo
- Publication number
- CN105389013A CN105389013A CN201510954338.5A CN201510954338A CN105389013A CN 105389013 A CN105389013 A CN 105389013A CN 201510954338 A CN201510954338 A CN 201510954338A CN 105389013 A CN105389013 A CN 105389013A
- Authority
- CN
- China
- Prior art keywords
- gesture
- virtual
- operation information
- system based
- data acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Abstract
The invention provides a gesture-based virtual playing system. The gesture-based virtual playing system comprises a data acquisition module, a transmission module and a processing module; the data acquisition module is used for acquiring operation information of human finger action; the transmission module is used for transmitting the operation information to the processing module; and the processing module is used for receiving the operation information, identifying note information represented by the human finger action after processing the operation information, and generating playing sound of a musical instrument according to the note information. According to the gesture-based virtual playing system provided by the invention, an operator can virtually play naturally and flexibly; and the gesture-based virtual playing system is high in interactivity.
Description
Technical field
The present invention relates to electronic technology field, particularly a kind ofly play system based on the virtual of gesture.
Background technology
Along with the development of computer technology and the fast lifting of system performance, the much hardware used on music making transforms into software simulating.The appearance of virtual performance technology, the grand piano making people that hundreds of thousands fund even up to a million need not be spent again to go to buy tone color first-class just can hear that the sound that the top piano in the world sends even is played.
In existing virtual technology, such as computing machine, mobile phone, panel computer etc., most terminal is the effect that the input realizing information by keyboard or touch-screen reaches performance.Need to watch screen attentively for a long time by the information input mode of keyboard or touch-screen and operate at specific equipment region, be easy to cause physiological fatigue, simultaneously interactive not strong, lack real experience sense to be subject to, be more and more difficult to meet growing real-time interaction demand in operability and convenience.
Summary of the invention
For above problem, patent object of the present invention is to devise a kind ofly plays system based on the virtual of gesture, makes operator naturally, neatly can carry out virtual playing, by force interactive.The present invention is achieved by the following technical solutions:
Play a system based on the virtual of gesture, comprise data acquisition module, transport module and processing module; Wherein:
Data acquisition module, is used for gathering the operation information of human finger action;
Transport module, is used for described operation information to be transferred to processing module;
Processing module, is used for receiving described operation information and identifies the note information of human finger action representative after processing described operation information, and produce musical instrument according to described note information play sound.
Further, data acquisition module of the present invention comprises micro-acceleration sensor and gyroscope, and described micro-acceleration sensor is used for perception finger and sweeps the acceleration of string or button, and described gyroscope is used for initialization coordinate system.
Further, data acquisition module of the present invention is arranged on sensor fingerstall.
Further, human finger action of the present invention comprises forward and backward action and the bullet of manipulating the strings by action.
Further, note information of the present invention comprises the weight of note intensity and the length of syllable.
Further, processing module of the present invention be used for simulate piano, guitar, Zheng, harp musical instrument play sound.
The invention provides a kind of utilize finger movement to carry out virtually play system, the fingering of playing is identical with real instrument, operator can be played when departing from concrete musical instrument, listen attentively to effect, software also can be coordinated to cross over the uninteresting single training stage and to set up " musicality " experience found and understand connotation of music fast, or carry out simple fingering memory training, excite music inspiration and interest.
Accompanying drawing explanation
Referring to accompanying drawing, embodiments of the present invention is further illustrated, wherein:
Fig. 1 is a kind of virtual module map of playing system based on gesture of the present invention;
Fig. 2 is a kind of virtual operation chart of playing system based on gesture of the present invention.
Embodiment
Below in conjunction with the drawings and specific embodiments, the present invention is described in further detail.
The present invention proposes and a kind ofly play system based on the virtual of gesture, refer to Fig. 1, comprise data acquisition module, transport module and processing module; Wherein:
Data acquisition module, is used for gathering the operation information of human finger action;
Transport module, is used for described operation information to be transferred to processing module;
Processing module, is used for receiving described operation information and identifies the note information of human finger action representative after processing described operation information, and produce musical instrument according to described note information play sound.
Described data acquisition module comprises micro-acceleration sensor and gyroscope, and described micro-acceleration sensor is used for perception finger and sweeps the acceleration of string or button, and described gyroscope is used for initialization coordinate system.
The present invention is based on the sensing principle of microelectromechanical systems, by wearing, micro-acceleration gauge and gyrostatic microdevice are housed, the gesture motion of perception finger, the different action of perception and power, time signal are transferred to calculation process end, the fingering motion for different musical instrument is identified by the algorithm of end for process, and then determine power and the rhythm speed of corresponding note and note thereof, realize virtual playing.
Described data acquisition module is arranged on sensor fingerstall.Refer to Fig. 2, described human finger action comprises forward and backward action and the bullet of manipulating the strings by action.
Described note information comprises the weight of note intensity and the length of syllable.
Described processing module be used for simulate piano, guitar, Zheng, harp musical instrument play sound.
A kind of virtual system of playing based on gesture provided by the invention is by the miniature receiving device of wearable sensors, or the mobile terminal of hand-held built-in sensors, by gesture motion, realizes the input to information word and identification.
The above the specific embodiment of the present invention, does not form limiting the scope of the present invention.Various other that any technical conceive according to the present invention is made change and distortion accordingly, all should be included in the protection domain of the claims in the present invention.
Claims (6)
1. play a system based on the virtual of gesture, it is characterized in that, comprise data acquisition module, transport module and processing module; Wherein:
Data acquisition module, is used for gathering the operation information of human finger action;
Transport module, is used for described operation information to be transferred to processing module;
Processing module, is used for receiving described operation information and identifies the note information of human finger action representative after processing described operation information, and produce musical instrument according to described note information play sound.
2. according to claim 1ly a kind ofly play system based on the virtual of gesture, it is characterized in that, described data acquisition module comprises micro-acceleration sensor and gyroscope, described micro-acceleration sensor is used for perception finger and sweeps the acceleration of string or button, and described gyroscope is used for initialization coordinate system.
3. according to claim 1ly a kind ofly play system based on the virtual of gesture, it is characterized in that, described data acquisition module is arranged on sensor fingerstall.
4. according to claim 1ly a kind ofly play system based on the virtual of gesture, it is characterized in that, described human finger action comprises forward and backward action and the bullet of manipulating the strings by action.
5. according to claim 1ly a kind ofly play system based on the virtual of gesture, it is characterized in that, described note information comprises the weight of note intensity and the length of syllable.
6. according to claim 1ly a kind ofly play system based on the virtual of gesture, it is characterized in that, described processing module be used for simulating piano, guitar, Zheng, harp musical instrument play sound.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510954338.5A CN105389013A (en) | 2015-12-21 | 2015-12-21 | Gesture-based virtual playing system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510954338.5A CN105389013A (en) | 2015-12-21 | 2015-12-21 | Gesture-based virtual playing system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105389013A true CN105389013A (en) | 2016-03-09 |
Family
ID=55421364
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510954338.5A Pending CN105389013A (en) | 2015-12-21 | 2015-12-21 | Gesture-based virtual playing system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105389013A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105867656A (en) * | 2016-04-27 | 2016-08-17 | 牛亚锋 | Motion-sensing music wearable device and playing motion recognition method thereof |
| CN106205283A (en) * | 2016-08-26 | 2016-12-07 | 北京千音互联科技有限公司 | A kind of handset type intelligent musical instrument playing method |
| CN107644631A (en) * | 2017-10-13 | 2018-01-30 | 深圳市明德智慧教育科技有限公司 | Method, system and the virtual reality device of music input based on virtual reality |
| CN108986777A (en) * | 2018-06-14 | 2018-12-11 | 森兰信息科技（上海）有限公司 | Method, somatosensory device and the musical instrument terminal of music simulation are carried out by body-sensing |
| CN110930803A (en) * | 2019-12-19 | 2020-03-27 | 郑州师范学院 | Musical note simulation training device for music teaching aid |
| WO2020155915A1 (en) * | 2019-01-29 | 2020-08-06 | 北京字节跳动网络技术有限公司 | Method and apparatus for playing back audio |
-
2015
- 2015-12-21 CN CN201510954338.5A patent/CN105389013A/en active Pending
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105867656A (en) * | 2016-04-27 | 2016-08-17 | 牛亚锋 | Motion-sensing music wearable device and playing motion recognition method thereof |
| CN105867656B (en) * | 2016-04-27 | 2019-03-08 | 牛亚锋 | A kind of performance action identification method based on body-sensing music wearable device |
| CN106205283A (en) * | 2016-08-26 | 2016-12-07 | 北京千音互联科技有限公司 | A kind of handset type intelligent musical instrument playing method |
| CN106205283B (en) * | 2016-08-26 | 2019-09-20 | 北京千音互联科技有限公司 | A kind of handset type intelligent musical instrument playing method |
| CN107644631A (en) * | 2017-10-13 | 2018-01-30 | 深圳市明德智慧教育科技有限公司 | Method, system and the virtual reality device of music input based on virtual reality |
| CN108986777A (en) * | 2018-06-14 | 2018-12-11 | 森兰信息科技（上海）有限公司 | Method, somatosensory device and the musical instrument terminal of music simulation are carried out by body-sensing |
| US11437006B2 (en) | 2018-06-14 | 2022-09-06 | Sunland Information Technology Co., Ltd. | Systems and methods for music simulation via motion sensing |
| US11749246B2 (en) | 2018-06-14 | 2023-09-05 | Sunland Information Technology Co., Ltd. | Systems and methods for music simulation via motion sensing |
| WO2020155915A1 (en) * | 2019-01-29 | 2020-08-06 | 北京字节跳动网络技术有限公司 | Method and apparatus for playing back audio |
| CN110930803A (en) * | 2019-12-19 | 2020-03-27 | 郑州师范学院 | Musical note simulation training device for music teaching aid |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105389013A (en) | Gesture-based virtual playing system | |
| US20200251011A1 (en) | Systems and methods for assisting a user in practicing a musical instrument | |
| US11557269B2 (en) | Information processing method | |
| US20130135223A1 (en) | Finger-worn input devices and methods of use | |
| US11749246B2 (en) | Systems and methods for music simulation via motion sensing | |
| US11670188B2 (en) | Method and apparatus for an adaptive and interactive teaching of playing a musical instrument | |
| US20160063975A1 (en) | Performance method of electronic musical instrument and music | |
| JP6737996B2 (en) | Handheld controller for computer, control system for computer and computer system | |
| CN103235642A (en) | 6-dimentional sensory-interactive virtual instrument system and realization method thereof | |
| Odowichuk et al. | Sensor fusion: Towards a fully expressive 3d music control interface | |
| US11893898B2 (en) | Method and apparatus for an adaptive and interactive teaching of playing a musical instrument | |
| US20220180767A1 (en) | Crowd-based device configuration selection of a music teaching system | |
| US20220172640A1 (en) | Method, device, system and apparatus for creating and/or selecting exercises for learning playing a music instrument | |
| WO2020059245A1 (en) | Information processing device, information processing method and information processing program | |
| CN110796918A (en) | Training method and device and mobile terminal | |
| JP7069768B2 (en) | Information processing methods, information processing equipment and programs | |
| Hariadi et al. | Design and implementation of virtual indonesian musical instrument (VIMi) application using leap motion controller | |
| CN105489209A (en) | Electroacoustic musical instrument rhythm controllable method and improvement of karaoke thereof | |
| Ren et al. | Designing virtual instruments with touch-enabled interface | |
| US20130106689A1 (en) | Methods of operating systems having optical input devices | |
| Overholt | Advancements in violin-related human-computer interaction | |
| Hemery et al. | Towards the design of a natural user interface for performing and learning musical gestures | |
| WO2023032422A1 (en) | Processing method, program, and processing device | |
| US11900825B2 (en) | Method and apparatus for an adaptive and interactive teaching of playing a musical instrument | |
| JP6782491B2 (en) | Musical tone generator, musical tone generator and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160309 |