CN104731059A - Stereophonic user interface - Google Patents
Stereophonic user interface Download PDFInfo
- Publication number
- CN104731059A CN104731059A CN201510045965.7A CN201510045965A CN104731059A CN 104731059 A CN104731059 A CN 104731059A CN 201510045965 A CN201510045965 A CN 201510045965A CN 104731059 A CN104731059 A CN 104731059A
- Authority
- CN
- China
- Prior art keywords
- user
- user interface
- information
- interface
- sound
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Abstract
The invention relates to a stereophonic user interface which is a multimedia user interface applied to a multimedia computer system and an intelligent device and used for achieving interaction between a user and an operation system. The new multimedia user interface is designed based on the stereophonic theory. The operation system and the user are connected through the user interface, and the complete interaction interface is provided for information interaction between the user and the operation system. The user interface is composed of an input interface module, an output interface module and a core processing module. The user-friendly user interaction interface is formed through mutual coordination of user operation. Presentation of parallel information and control over the parallel information are achieved, and the new multimedia user interface is formed.
Description
Technical field
This invention stereophonics user interface is a kind of multimedia user interface, is applied to multi-media computer system, hand-held intelligent terminal and equipment, for user and operating system provide the system at interface alternately.
Background technology
Multimedia user interface is used widely.Through development for a long time, define based on graphical interfaces, comprehensively use information transmission and the interactive mode of various multimedia means.For desktop computer, information is shown to user by form of window, realizes the transmission of operation system information to user, uses keyboard and mouse to obtain input information.The information of this multimedia user interface is transmitted form and is comprised word and picture etc., forms friendly user interface.User and operating system carry out alternately, completing information interchange.For the software such as video player and game, except video pictures media, also combine acoustic medium.In recent years the smart machine risen, does larger improvement to input equipment, on the basis that traditional keyboard and mouse replaces to a fewer keys and touch-screen, adds multiple sensors.In acoustic information is mutual, employ microphone and receiver, or by bluetooth earphone etc. more easily medium to user's transmission of information content.Form the user interface of picture and sound combination, controlled by button and touch operation, form friendly user interface.But form in framework in current user interface, the application of sound is only as supplementary means, and except the minority application such as prompt tone application, sound strictly can not be defined as the ingredient of user interface, but the broadcasting of acoustic information self.And the broadcasting of sound only adopts single audio frequency to spread the form of putting, i.e. same time, operating system only transmits an acoustic information, even if there is multiple audio stream play simultaneously, only there is interference each other, does not form real voice user interface.This invention uses stereophonics theoretical, utilizes spatial sound source location technology and stereo-mixing technology etc., designs a kind of new multimedia user interface, by parallel audio-frequency information as interface medium, improves interactive efficiency.
Summary of the invention
This invention stereophonics user interface uses stereophonics theoretical, utilizes spatial sound source location technology and stereo-mixing technical design to form.The one of stereophonics user interface multimedia user interface is the sound multimedia user interface system of complete set.This system attended operation system and user, for the information interchange between user and operating system provides the interactive interface of complete set.By parallel audio-frequency information as interface medium, improve interactive efficiency.
This system is made up of input interface module, output interface module and core processing module.
The load module of this system comprises sound source bag administration module, sound remittance positioning control module, distribute control module and stream positioning control module four ingredients.Wherein sound source bag is the data encapsulation of the information content, is made up of audio stream data, sound source localization data, gain and play mode control information.
Sound remittance positioning control module is the comprising modules of control sound meeting point.Sound meeting point refers in systems in which, for Virtual User position, collects and receive the point of the voice signal in solid space.Sound meeting point is variable in user interaction process, and user, by control sound meeting point, receives voice signal in solid space.It is exactly the system module of control sound meeting point movement in space that sound converges positioning control module.Sound converges positioning control module by change sound meeting point and sound source distance, forms an approach process, listens to the audio-frequency information of this sound source for emphasis.
Distribute control refers to that user is when sound meeting point concentrates the voice signal receiving a sound source, regulates the control of the sound signal intensity of remote sound source.Distribute control is made up of concentrate and disperse two control operations.Operated by centralized control, user shields remote source sound signal, improves the acquisition efficiency of the voice signal of closely sound source.Operated by decentralised control, user can obtain the voice signal of more sound source simultaneously.Distribute control module is the system element realizing distribute control.
Stream positioning control refers to the location of the audio data stream at sound source bag.By stream positioning control, user can realize audio stream rollback and replay and F.F..For the information content, the positioning control operation of rollback is for confirming acoustic information content, and F.F., then for the obtaining information that jumps, designs according to the custom of user's obtaining information.Stream positioning control operation is realized by stream positioning control module.
Sound source bag is the mass data input of system, needs the information content transmitted for package system.In this user interface, operating system needs the information content transmitted to be that medium is shown to user with audio stream.Have multiple information to be passed at one time, operating system generates corresponding sound source bag respectively and is input to this user interface.Audio stream data, sound source localization data, gain and play mode control information is comprised in sound source bag.Multi-acoustical bag is input to core processing module simultaneously and carries out data processing, result be many sound sources walk abreast voice signal synthesis stereo data.
Core processing module is the core component of this system.Its function is according to sound meeting point parameter, collecting and distributing parameter and stream positional parameter, uses stereophonics theoretical compound stereoscopic sound data.This module utilizes spatial sound source location technology and stereo-mixing technology, compose operation when putting into effect to multi-acoustical bag.Operation result generates stereo audio data, and data are sent to output interface module.
Output interface module is the same with input interface module, all for core processing module.Output interface module comprises audio interface administration module and common interface administration module.Wherein audio interface administration module coordinates the exchanges data of the audio frequency apparatus management interface of core processing module and operating system.The stereo data generated by core processing module is shown to user by audio interface administration module.The mode of showing has two-channel sterearphone, or stereophony bluetooth earphone etc.Common interface administration module provides common interface for operating system and application program, and common interface provides the data such as parameter, bottom buffer state of user's control procedure to operating system and application program, activated user Action Events.
This invention as the system of complete set, the reciprocal process between completing user and operating system.Converged by sound control, the coordination such as mutual of the operation such as distribute control and stream location, form friendly User Interface.The displaying of this system implements parallel information and control, become a kind of new multimedia user interface.
Accompanying drawing illustrates: Fig. 1 is stereophonics user interface system structural drawing.
Claims (3)
1. this invention is as novel multimedia user interface, is different from other multimedia user interfaces such as graphic user interface, it is characterized in that adopting sound as medium delivery of system information, and user take the sense of hearing as obtaining information and completes mutual Main Means.
2. this invention is that the Main Means that medium transmits for information is different from other audio frequency broadcast system with sound, it is characterized in that using stereophonics theory and correlation technique to realize parallel acoustic information transmission, the multiple independently audio data stream of same Time Transmission.
3. the stereo ways of presentation of this invention is different from the exhibition method of stereo playing system, it is characterized in that dynamic stereo displaying, employing sound remittance control, distribute control and stream positioning control realize stereo information controlled in real time and show, user is coordinated mutually by these control operations and stereo displaying, completing user and operating system mutual.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510045965.7A CN104731059A (en) | 2015-01-29 | 2015-01-29 | Stereophonic user interface |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510045965.7A CN104731059A (en) | 2015-01-29 | 2015-01-29 | Stereophonic user interface |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104731059A true CN104731059A (en) | 2015-06-24 |
Family
ID=53455053
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510045965.7A Pending CN104731059A (en) | 2015-01-29 | 2015-01-29 | Stereophonic user interface |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104731059A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1295758A (en) * | 1998-04-03 | 2001-05-16 | 美商·提维股份有限公司 | Method and apparatus implementing random access and time-based functions on continuos stream of formatted digital data |
| CN201489754U (en) * | 2009-06-05 | 2010-05-26 | 上海宽洋数码科技有限公司 | Wireless touch type multimedia information terminal |
| CN102484667A (en) * | 2009-09-22 | 2012-05-30 | 阿瓦雅公司 | Method and system for controlling audio in a collaboration environment |
| CN102480671A (en) * | 2010-11-26 | 2012-05-30 | 华为终端有限公司 | Audio processing method and device in video communication |
| CN202334783U (en) * | 2011-11-22 | 2012-07-11 | 中国船舶重工集团公司第七○九研究所 | Video encoder integrating stereo acquisition and stereo replay functions |
-
2015
- 2015-01-29 CN CN201510045965.7A patent/CN104731059A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1295758A (en) * | 1998-04-03 | 2001-05-16 | 美商·提维股份有限公司 | Method and apparatus implementing random access and time-based functions on continuos stream of formatted digital data |
| CN201489754U (en) * | 2009-06-05 | 2010-05-26 | 上海宽洋数码科技有限公司 | Wireless touch type multimedia information terminal |
| CN102484667A (en) * | 2009-09-22 | 2012-05-30 | 阿瓦雅公司 | Method and system for controlling audio in a collaboration environment |
| CN102480671A (en) * | 2010-11-26 | 2012-05-30 | 华为终端有限公司 | Audio processing method and device in video communication |
| CN202334783U (en) * | 2011-11-22 | 2012-07-11 | 中国船舶重工集团公司第七○九研究所 | Video encoder integrating stereo acquisition and stereo replay functions |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7275227B2 (en) | Recording virtual and real objects in mixed reality devices | |
| US9645648B2 (en) | Audio computer system for interacting within a virtual reality environment | |
| EP2922313A1 (en) | Audio signal processing device, position information acquisition device, and audio signal processing system | |
| US20140215332A1 (en) | Virtual microphone selection corresponding to a set of audio source devices | |
| US20140064519A1 (en) | Distributed, self-scaling, network-based architecture for sound reinforcement, mixing, and monitoring | |
| CN103024634B (en) | A kind of processing method and processing device of audio signal | |
| CN107533843A (en) | System and method for capturing, encoding, being distributed and decoding immersion audio | |
| CN106790940B (en) | Recording method, recording playing method, device and terminal | |
| US20140153753A1 (en) | Object Based Audio Rendering Using Visual Tracking of at Least One Listener | |
| JP6246922B2 (en) | Acoustic signal processing method | |
| CN104270700A (en) | Method and system for generating mobile sound source in 3D audio frequency and device | |
| Kronlachner | Ambisonics plug-in suite for production and performance usage | |
| CN203839030U (en) | Real-time interactive system between karaoke private rooms | |
| CN103581308A (en) | Music playing system and method | |
| JP2014103456A (en) | Audio amplifier | |
| Kasuya et al. | LiVRation: Remote VR live platform with interactive 3D audio-visual service | |
| CN104731059A (en) | Stereophonic user interface | |
| CN112492506A (en) | Audio playing method and device, computer readable storage medium and robot | |
| CN111050270A (en) | Multi-channel switching method and device for mobile terminal, mobile terminal and storage medium | |
| CN104735582A (en) | Sound signal processing method, equipment and device | |
| CN203839029U (en) | High-quality human voice real-time bidirectional network transmission device | |
| Paterson et al. | Immersive audio post-production for 360 video: workflow case studies | |
| CN105307086A (en) | Method and system for simulating surround sound for two-channel headset | |
| CN105828172B (en) | Control method for playing back and device in audio-video frequency playing system | |
| CN111988721A (en) | Sound amplification method, device, system, medium and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150624 |