CN105797366A - Head-wearing type interactive audio game terminal based on sound source location - Google Patents
Head-wearing type interactive audio game terminal based on sound source location Download PDFInfo
- Publication number
- CN105797366A CN105797366A CN201610172004.7A CN201610172004A CN105797366A CN 105797366 A CN105797366 A CN 105797366A CN 201610172004 A CN201610172004 A CN 201610172004A CN 105797366 A CN105797366 A CN 105797366A
- Authority
- CN
- China
- Prior art keywords
- head
- game
- wear
- game terminal
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F9/00—Games not otherwise provided for
- A63F9/0001—Games specially adapted for handicapped, blind or bed-ridden persons
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F9/00—Games not otherwise provided for
- A63F9/0001—Games specially adapted for handicapped, blind or bed-ridden persons
- A63F2009/0003—Games specially adapted for blind or partially sighted people
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Stereophonic System (AREA)
Abstract
The invention provides a head-wearing type interactive audio game terminal based on sound source location. The head-wearing type interactive audio game terminal comprises a head-wearing type stereo headphone, a microphone array unit, a head motion sensor unit and an embedded processor unit. The microphone array unit, the head motion sensor unit and the embedded processor unit are fixed on the head-wearing type stereo headphone. A user reacts to a game by wearing the head-wearing type stereo headphone, combining three-dimensional sound game content of the audio game and applying the two hands to make a sound around the body, the game terminal conducts sound source location processing on the sound captured by the microphone array unit, control over the game is conducted by means of obtained three-dimensional data of a sound source, and therefore the interactive function between the user and the audio game is achieved.
Description
Technical field
The invention belongs to electronic game field, particularly relate to a kind of wear-type interactive audio game terminal based on sound localization used in the electronic game of only audio content.
Background technology
Fast development along with electronic game industry, increasing electronic game product and game content are developed, it is based particularly on the game terminal of video and the fast development of external equipment, game terminal and external equipment have been increasingly becoming the requisite instrument of people's amusement and recreation.But most game is all based on the electronic game that visual manner interacts with user, and audio content generally assists video content as a part for electronic game.Therefore, cannot enjoy, for blind person or disturbance people, the audiovisual entertainment effect that conditional electronic game brings.
The life & amusement that technical development in recent years is blind person and disturbance people brings great improvement, commercially have been developed over the conditional electronic game products for blind person or the improvement of disturbance people, its basic method is to adopt to read screen software, the game content information shown by screen converts voice messaging to, player's prompting according to voice messaging, carries out interaction by traditional game peripherals.But in the process of game interaction, vast disturbance people still the same with normal visual acuity people can not enjoy interaction easily and the abundant visual experience that electronic game brings.Therefore, society needs a kind of only audio content there is no the electronic game types of video content, i.e. audio games, to provide entertainment service for blind person and disturbance people.
Three-dimension stereo synthetic technology can be the sound scenery that player truly restores solid, and most audio games is all based on this technology to carry out game design and interaction.At present, commercially the game station of audio games and game content are considerably less, are mainly used in the aspect such as audition treatment or training Auditory Perception.Game station is also based on existing computer equipment, is not specifically designed for interactive audio game terminal and the external equipment of blind person or disturbance people exploitation.
Therefore, in audio games field, it is necessary to provide a kind of three-dimension stereo audio games terminal with friendly interactive experience for blind person and disturbance people.
Summary of the invention
The invention provides a kind of wear-type interactive audio game terminal based on sound localization, it is possible to the 3 D stereo phonosynthesis and the friendly game interaction that realize audio games are experienced, the entertainment life of abundant blind person and disturbance people.
This invention example includes wear-type stereophone, microphone array column unit, head movement sensor unit and flush bonding processor unit.
The input of wear-type stereophone connects the data output end of flush bonding processor unit, the outfan of Mike's subarray unit connects the data input pin of flush bonding processor unit, and the data output end of head movement sensor unit connects the data input pin of flush bonding processor unit.
The hardware of the present invention is by the wear-type stereophone being connected to flush bonding processor unit, microphone array column unit and head movement sensor unit composition, by microphone array column unit, head movement sensor unit and flush bonding processor unit are fixed on the headband part of wear-type stereophone, user passes through wearing stereoscopic sound earphone, game content in conjunction with the three-dimension stereo of audio games, make with the hands or other objects send sound in health surrounding, game is made corresponding reaction, the aforementioned sound sent that microphone array is captured by game terminal carries out the process of sound localization, game is controlled by the three-dimensional data using the sound source obtained, thus the interaction function realized between user and audio games.
The technical scheme is that a kind of wear-type interactive audio game terminal based on sound localization, including hardware cell and software processing module；Described hardware cell includes wear-type stereophone, microphone array column unit, head movement sensor unit and flush bonding processor unit；Described software processing module is completed operation processing function by flush bonding processor unit, including sound signal collecting module, sound localization computing module, head movement data acquisition module, head pose identification module, three-dimension stereo synthesis module and game processing module.
Present invention have the advantage that
1, the present invention realizes the mutual of audio games by the mode of sound localization.
2, in the present invention, the data of sound localization are the three-dimensional data of solid space, and it is fast to calculate speed.
3, application of the present invention is extensive, is applicable not only to the entertainment field of electronic game, applies also for the aspect such as audition treatment or Auditory Perception training.
Accompanying drawing explanation
Fig. 1 is the system block diagram of the present invention；
Fig. 2 is the configuration schematic diagram of the present invention；
Fig. 3 is the flush bonding processor unit of the present invention and outer connection diagram, flush bonding processor unit comprises microprocessor, memorizer, power supply, audio stereo output port and four road analogue audio frequency input ports, the wear-type stereophone that native system uses is connected to flush bonding processor unit by audio stereo output port, four mikes in microphone array column unit are connected to flush bonding processor unit by four road microphone input ports, the data-out port of head movement sensor unit is connected to flush bonding processor unit, this figure is the known diagram of industry technology, it is only explanation native system principle, do not limit the invention and protect
Detailed description of the invention
As it is shown in figure 1, a kind of wear-type interactive audio game terminal based on sound localization of the present invention；The external voice signal that the microphone array column unit that this system comprises obtains sends into flush bonding processor unit, sequentially passes through sound signal collecting module, sound localization computing module, obtains the three-dimensional data of sound source；The head movement data that the head movement sensor unit that this system comprises obtains send into flush bonding processor unit, sequentially pass through head movement data acquisition module, head pose identification module, obtain head pose data；Sound source data and head pose data are after the process of game processing module and three-dimension stereo synthesis module, and wear-type stereophone is arrived in output, it is achieved the interactive function of audio games.
Described microphone array column unit is the headband part that No. four mikes are fixed on headband receiver, and composition has on four positions of tetragon of certain space distance, gathers four road sound simultaneously.
Described head movement sensor unit, including an acceleration transducer and an angular-rate sensor, obtains the kinestate data of head.
Described sound signal collecting module, refers to and by four microphone input ports, four road microphone signals is collected flush bonding processor unit, convert the voice data with certain digital audio format to.
Described sound localization computing module, refers to and four road voice datas carries out denoising, segmentation, the calculation process process such as location Calculation based on MUSIC algorithm.
Described head movement data acquisition module, refers to the data acquisition of acceleration transducer and angular-rate sensor to flush bonding processor unit.
Described head pose identification module, refers to data acceleration transducer and angular-rate sensor obtained, and carries out processing and obtains head at movable information both vertically as well as horizontally.
Described game processing module, the spatial relationship etc. of the spatial relationship and process head pose and gaming audio that refer to running game content, select audio content, process external voice and gaming audio processes.
Described three-dimension stereo synthesis module, refers to audio content game module selected, in conjunction with head pose and human body head related transfer function, synthesis output three-dimension stereo.
As in figure 2 it is shown, flush bonding processor unit 2 is fixed on the headband top of wear-type stereophone 1, receive the output signal of four mikes 4～7 from microphone array column unit, through processing the stereo output of synthesis to wear-type stereophone.
As in figure 2 it is shown, head movement sensor unit 3 is fixedly connected in flush bonding processor unit 2.
Again as in figure 2 it is shown, four mikes 4～7 are separately fixed at the outside of the headband part of wear-type stereophone 1, constitute the tetragon having certain space distance, collectively constitute microphone array column unit.
Above a specific embodiment of the present invention is described and illustrated, but described content should be considered it is illustrative of, it is impossible to be considered the practical range for limiting the present invention.All equalizations made according to the present patent application scope change and improvement etc., all should still belong within the patent covering scope of the present invention.
Claims (3)
1. based on a wear-type interactive audio game terminal for sound localization, it is characterized in that: include wear-type stereophone, microphone array column unit, head movement sensor unit and flush bonding processor unit；Described flush bonding processor unit completes operation processing function, including sound signal collecting module, sound localization computing module, head movement data acquisition module, head pose identification module, three-dimension stereo synthesis module and game processing module.
2. a kind of wear-type interactive audio game terminal based on sound localization according to claim 1, is further characterized in that described mike is fixed on the headband part of wear-type stereophone, and keeps on the position of tetragon of certain space distance.
3. a kind of wear-type interactive audio game terminal based on sound localization according to claim 1, it is further characterized in that described head movement sensor unit is made up of acceleration transducer and angular-rate sensor, is obtained the information of user head pose by the computing of flush bonding processor unit and process.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610172004.7A CN105797366A (en) | 2016-03-25 | 2016-03-25 | Head-wearing type interactive audio game terminal based on sound source location |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610172004.7A CN105797366A (en) | 2016-03-25 | 2016-03-25 | Head-wearing type interactive audio game terminal based on sound source location |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105797366A true CN105797366A (en) | 2016-07-27 |
Family
ID=56453734
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610172004.7A Pending CN105797366A (en) | 2016-03-25 | 2016-03-25 | Head-wearing type interactive audio game terminal based on sound source location |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105797366A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106331977A (en) * | 2016-08-22 | 2017-01-11 | 北京时代拓灵科技有限公司 | Virtual reality panoramic sound processing method for network karaoke |
| CN106959752A (en) * | 2017-03-16 | 2017-07-18 | 王昇洋 | Utilize stereo guiding and the head-wearing device of assessment head movement |
| CN108479056A (en) * | 2018-03-05 | 2018-09-04 | 成都看客网络技术有限公司 | A kind of blind person with grabbing doll machine on the net |
| CN109791441A (en) * | 2016-08-01 | 2019-05-21 | 奇跃公司 | Mixed reality system with spatialization audio |
| CN112951236A (en) * | 2021-02-07 | 2021-06-11 | 北京有竹居网络技术有限公司 | Voice translation equipment and method |
| WO2023226161A1 (en) * | 2022-05-25 | 2023-11-30 | 歌尔股份有限公司 | Sound source position determination method, device, and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201426153Y (en) * | 2009-05-27 | 2010-03-17 | 中山佳时光电科技有限公司 | Intelligent camera control system for video conference |
| CN102111697A (en) * | 2009-12-28 | 2011-06-29 | 歌尔声学股份有限公司 | Method and device for controlling noise reduction of microphone array |
| CN203074707U (en) * | 2012-10-15 | 2013-07-24 | 四川旭康医疗电器有限公司 | Remote information interaction-based head-mounted trainer |
| US20130194164A1 (en) * | 2012-01-27 | 2013-08-01 | Ben Sugden | Executable virtual objects associated with real objects |
| CN103890836A (en) * | 2010-09-20 | 2014-06-25 | 寇平公司 | Bluetooth or other wireless interface with power management for head mounted display |
| CN204864894U (en) * | 2015-08-19 | 2015-12-16 | 天津先驱领域科技有限公司 | A helmet for virtual reality recreation |
| CN105359063A (en) * | 2013-06-09 | 2016-02-24 | 索尼电脑娱乐公司 | Head mounted display with tracking |
-
2016
- 2016-03-25 CN CN201610172004.7A patent/CN105797366A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201426153Y (en) * | 2009-05-27 | 2010-03-17 | 中山佳时光电科技有限公司 | Intelligent camera control system for video conference |
| CN102111697A (en) * | 2009-12-28 | 2011-06-29 | 歌尔声学股份有限公司 | Method and device for controlling noise reduction of microphone array |
| CN103890836A (en) * | 2010-09-20 | 2014-06-25 | 寇平公司 | Bluetooth or other wireless interface with power management for head mounted display |
| US20130194164A1 (en) * | 2012-01-27 | 2013-08-01 | Ben Sugden | Executable virtual objects associated with real objects |
| CN203074707U (en) * | 2012-10-15 | 2013-07-24 | 四川旭康医疗电器有限公司 | Remote information interaction-based head-mounted trainer |
| CN105359063A (en) * | 2013-06-09 | 2016-02-24 | 索尼电脑娱乐公司 | Head mounted display with tracking |
| CN204864894U (en) * | 2015-08-19 | 2015-12-16 | 天津先驱领域科技有限公司 | A helmet for virtual reality recreation |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109791441A (en) * | 2016-08-01 | 2019-05-21 | 奇跃公司 | Mixed reality system with spatialization audio |
| CN106331977A (en) * | 2016-08-22 | 2017-01-11 | 北京时代拓灵科技有限公司 | Virtual reality panoramic sound processing method for network karaoke |
| CN106959752A (en) * | 2017-03-16 | 2017-07-18 | 王昇洋 | Utilize stereo guiding and the head-wearing device of assessment head movement |
| CN108479056A (en) * | 2018-03-05 | 2018-09-04 | 成都看客网络技术有限公司 | A kind of blind person with grabbing doll machine on the net |
| CN108479056B (en) * | 2018-03-05 | 2021-12-31 | 江苏嘉尚环保科技有限公司 | Online doll grabbing machine for blind people |
| CN112951236A (en) * | 2021-02-07 | 2021-06-11 | 北京有竹居网络技术有限公司 | Voice translation equipment and method |
| WO2023226161A1 (en) * | 2022-05-25 | 2023-11-30 | 歌尔股份有限公司 | Sound source position determination method, device, and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105797366A (en) | Head-wearing type interactive audio game terminal based on sound source location | |
| JP7275227B2 (en) | Recording virtual and real objects in mixed reality devices | |
| JP4921550B2 (en) | How to give emotional features to computer-generated avatars during gameplay | |
| JP6893868B2 (en) | Force sensation effect generation for space-dependent content | |
| EP3427103B1 (en) | Virtual reality | |
| CN205563457U (en) | Virtual reality's portable host computer, virtual reality helmet and system | |
| CN105915849A (en) | Virtual reality sports event play method and system | |
| CN104801039A (en) | Virtual reality gaming device and scene realization method | |
| CN106205245A (en) | Immersion on-line teaching system, method and apparatus | |
| CN104615243A (en) | Head-wearable type multi-channel interaction system and multi-channel interaction method | |
| CN204360325U (en) | A kind of wear-type multi-modal interaction system | |
| JP2018129035A (en) | Haptic broadcast with select haptic metadata | |
| CN106464995A (en) | Stand-alone multifunctional headphones for sports activities | |
| JP6147486B2 (en) | GAME SYSTEM, GAME PROCESSING CONTROL METHOD, GAME DEVICE, AND GAME PROGRAM | |
| CN108353244A (en) | Difference head-tracking device | |
| CN106464996A (en) | Multifunctional headphone system for sports activities | |
| JP6055651B2 (en) | Information processing system, information processing program, information processing control method, and information processing apparatus | |
| US20190384404A1 (en) | Virtual reality | |
| CN105325014A (en) | Sound field adaptation based upon user tracking | |
| CN103999021A (en) | Gesture controlled audio user interface | |
| CN107465972A (en) | The audio play control method and wireless headset of a kind of mobile terminal | |
| CN205451066U (en) | A children's autistic VR rehabilitation system | |
| CN102929386A (en) | Method and system of reproducing virtual reality dynamically | |
| CN204666958U (en) | Virtual reality glasses | |
| CN103167145A (en) | Achieving system and method of mobile phone motion sensing game |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160727 |
|
| RJ01 | Rejection of invention patent application after publication |