CN114095548A - Multi-person voice collaboration system based on communication network - Google Patents
Multi-person voice collaboration system based on communication network Download PDFInfo
- Publication number
- CN114095548A CN114095548A CN202111365463.4A CN202111365463A CN114095548A CN 114095548 A CN114095548 A CN 114095548A CN 202111365463 A CN202111365463 A CN 202111365463A CN 114095548 A CN114095548 A CN 114095548A
- Authority
- CN
- China
- Prior art keywords
- network
- module
- component
- game
- voice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
- G09B5/10—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations all student stations being capable of presenting the same information simultaneously
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M9/00—Arrangements for interconnection not involving centralised switching
- H04M9/08—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic
- H04M9/082—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic using echo cancellers
Abstract
A multi-person voice collaboration system based on a communication network comprises: the bottom API module is used for data transmission and bottom configuration; sending information and information serialization to a connection management module through a bottom API module, wherein the connection management module is used for taking charge of network client management and network server management; the object state and behavior module is used for processing the network identity and the network behavior; the object life cycle module is used for managing network scenes and client scenes; the engine integration module is used for integrating all components including the network position component, the network animation component and the network distance checking component; the technical key points are that a vivid voice interaction scene is established and is presented through an audio equipment system on a computer to give the students a feeling of being personally on the scene, so that the learning interest of the students is stimulated, and the manual operation capability of the students is improved; the system supports multiple persons to study on the spot at the same time, breaks through the limitation of traditional education and improves teaching efficiency.
Description
Technical Field
The invention belongs to the technical field of digital media, and particularly relates to a multi-user voice collaboration system based on a communication network.
Background
With the continuous development of virtual reality technology and digital media technology, the attention of the game industry is increasing, the digital game economy has a certain proportion in the overall economy, a plurality of engine platforms are developed at present, and unity is favored by the market due to the characteristics of cross-platform property, easy operability, excellent performance and the like.
Currently, the gaming industry is evolving from traditional 2D/2.5D games, stand-alone games, to emerging 3D games and online network games, with the rise in 3D games and online games accompanied by changes in technology and algorithms. The traditional 2D path searching method is not suitable for 3D scenes, so that the corresponding path searching method needs to be changed or redesigned.
The game digital industry plays an important role in the development of digital economy, the current design and development of single games are more, the design of multi-player online 3D network games is relatively less, the network communication principle is combined, the unity3D is used as the basis, the MVC architecture is adopted, and the multi-player online games are designed and realized. Aiming at the problem of consistency of online player scenes, communication protocols such as position synchronization and scene synchronization are provided. Due to network delays, it is difficult for the system to achieve real-time, accurate player position synchronization.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provides a multi-user voice collaboration system based on a communication network.
In order to achieve the purpose, the invention adopts the following technical scheme:
a multi-person voice collaboration system based on a communication network comprises:
the bottom API module is used for data transmission and bottom configuration;
sending information and information serialization to a connection management module through a bottom API module, wherein the connection management module is used for taking charge of network client management and network server management;
the object state and behavior module is used for processing the network identity and the network behavior;
the object life cycle module is used for managing network scenes and client scenes;
the engine integration module is used for integrating all components including the network position component, the network animation component and the network distance checking component; and
a voice system module comprising a hardware detection component, an active call component, and an echo cancellation component.
Preferably, in the underlying API module,
the method supports the following modes for carrying out bottom layer transmission, and the specific modes comprise: TCP, UDP, and data streaming.
Preferably, in the connection management module,
when the system is in charge of network client management and network server management, the system comprises the use, synthesis and coordination of hardware and software, and can monitor, test, configure, analyze, evaluate and control network resources.
Preferably, in the object lifecycle module,
the game object in the scene controls the concrete behavior through the script, the game needs to be operated through the connection management module when controlling the game, the game needs to be managed through the network hall when controlling the player, the management of the network hall is taken as a temporary transfer area before the player formally enters the game,
in this zone, the specific actions controlled by the player are: setting options and preparing before starting the game; meanwhile, the network lobby management can limit the number of the players to join, support other players with limited numbers on each client in the multi-player game, prevent the players from joining when the game is in progress, ensure the preparation state of each player, start the game under the condition that the players are prepared, and set data of each player, rejoin the network lobby when the game is finished, provide virtual functions of events of the network lobby for developers to develop custom logic, and provide user interfaces for interaction of the network lobby.
Preferably, in the engine integration module,
a network location component: an object in the scene between each player that requires synchronization information, including but not limited to position, animated objects, that collects the information and synchronizes the information between multiple players;
a network animation component: the system is used for making dynamic pictures and static pictures in a game scene;
a network distance checking component: for detecting spacing information between two or more players.
Preferably, in the speech system module,
hardware detection component: after a program in a communication network starts to execute, calling a system interface in a background, detecting hardware equipment connected with the current computer equipment, finding the hardware equipment responsible for audio input and output, and accessing the hardware equipment into software;
activating the call component: activating a conversation function through a keyboard key, activating voice when the key is pressed down, and releasing the key to disable the voice;
an echo cancellation component: a silence compression technique is employed for echo cancellation in voice calls.
Compared with the prior art, the invention provides a multi-user voice cooperative system based on a communication network, which has the following beneficial effects:
the invention adopts low-delay, real-time voice communication and high-efficiency voice coding, so that a plurality of chat processes coexist, the private message function sends information to individual players, the voice is started to close and close the function, and the push button is pressed to activate the communication, so that echo is eliminated.
Firstly, a vivid voice interaction scene is established and presented through an audio equipment system on a computer, and a student feels personally on the scene, so that the learning interest of the student is stimulated, and the hands-on operation capability of the student is improved;
secondly, the system supports multiple people (can satisfy 100 people) to study on the spot at the same time, breaks through the limitation of traditional education, and improves the teaching efficiency.
Drawings
FIG. 1 is a schematic diagram of a communication network architecture according to the present invention;
FIG. 2 is a diagram illustrating a user communication state according to the present invention;
fig. 3 is a second schematic diagram of the user communication state in the present invention.
Detailed Description
The following further describes a specific embodiment of the multi-user voice collaboration system based on the communication network according to fig. 1. The multi-user voice collaboration system based on the communication network of the present invention is not limited to the following description of the embodiments.
This embodiment provides a specific structure of a multi-user voice collaboration system based on a communication network, as shown in fig. 1, a multi-user voice collaboration system based on a communication network includes:
the bottom API module is used for data transmission and bottom configuration;
sending information and information serialization to a connection management module through a bottom API module, wherein the connection management module is used for taking charge of network client management and network server management;
transmitting information and information serialization: the data reading and writing device is responsible for communication connection, data reading and data writing;
serialization: which is a process of converting state information of an object into a form that can be stored or transmitted. During serialization, the object writes its current state to a temporary or persistent store; the object may later be recreated by reading or deserializing the state of the object from storage.
The object state and behavior module is used for processing the network identity and the network behavior;
the object life cycle module is used for managing network scenes and client scenes;
the engine integration module is used for integrating all components including the network position component, the network animation component and the network distance checking component; and
a voice system module comprising a hardware detection component, an active call component, and an echo cancellation component.
By adopting the technical scheme:
the invention adopts low-delay, real-time voice communication and high-efficiency voice coding, so that a plurality of chat processes coexist, the private message function sends information to individual players, the voice is started to close and close the function, and the push button is pressed to activate the communication, so that echo is eliminated.
Firstly, a vivid voice interaction scene is established and is presented through an audio equipment system on a computer, and students are provided with a feeling of being personally on the scene, so that the learning interest of the students is stimulated, and the manual operation capability of the students is improved;
secondly, the system supports multiple people (can satisfy 100 people) to study on the spot at the same time, breaks through the limitation of traditional education, and improves the teaching efficiency.
In particular, the method comprises the following steps of,
by adopting a communication network architecture and a real-time voice system, the network becomes simple, concise and maintainable;
the local area network type network is supported, the coverage area of the local area network is generally within thousands of meters of a square circle, and the local area network type network has the characteristics of convenience and quickness in installation, cost saving, convenience in expansion and the like, so that the local area network type network is widely applied to various offices;
the local area network can realize functions of file management, application software sharing, printer sharing and the like, and can effectively protect data security and ensure normal and stable operation of the local area network by maintaining the security of the local area network in the using process;
a server may support hundreds of clients running simultaneously.
In the bottom-level API module, the API module,
the method supports the following modes for carrying out bottom layer transmission, and the specific modes comprise: TCP, UDP, and data streaming; the method specifically comprises the following steps:
TCP: the transmission control protocol is a connection-oriented, reliable, byte stream-based transport layer communication protocol, defined by RFC 793 of the IETF;
TCP aims to adapt to layered protocol hierarchies that support multi-network applications; reliable communication services are provided by means of TCP between pairs of processes in host computers connected to different but interconnected computer communication networks; TCP assumes that it can obtain simple, possibly unreliable datagram service from lower level protocols; in principle, TCP should be able to operate over a variety of communication systems connected from hard wire to packet switched or circuit switched networks;
UDP: the Internet protocol suite supports a connectionless transport protocol known as the user datagram protocol; UDP provides a method for applications to send encapsulated IP packets without establishing a connection;
data stream transmission: a data stream is an ordered set of data sequences of bytes having a start point and an end point; including an input stream and an output stream.
Data streams were originally conceived as a concept used in the field of communications and represent a sequence of digitally encoded signals of information used in transmission.
In the connection management module,
when the system is in charge of network client management and network server management, the system comprises the use, synthesis and coordination of hardware and software, and can monitor, test, configure, analyze, evaluate and control network resources.
This allows to meet some requirements of the network, such as real-time performance, quality of service, etc., at a reasonable price. In addition, when the network fails, the system can report and process in time, and can coordinate and maintain the efficient operation of the network system.
In the object life-cycle module,
the game object in the scene controls the concrete behavior through the script, the game needs to be operated through the connection management module when controlling the game, the game needs to be managed through the network hall when controlling the player, the management of the network hall is taken as the temporary transfer area before the player formally enters the game,
in this zone, the specific actions controlled by the player are: setting options and preparing before starting the game; meanwhile, the network lobby management can limit the number of the players to join, support other players with limited numbers on each client in the multi-player game, prevent the players from joining when the game is in progress, ensure the preparation state of each player, start the game under the condition that the players are prepared, and set data of each player, rejoin the network lobby when the game is finished, provide virtual functions of events of the network lobby for developers to develop custom logic, and provide user interfaces for interaction of the network lobby.
In the engine-integration module,
a network location component: an object in the scene between each player that requires synchronization information, including but not limited to position, animated objects, that collects the information and synchronizes the information between multiple players;
a network animation component: the system is used for making dynamic pictures and static pictures in a game scene;
a network distance checking component: for detecting spacing information between two or more players.
In the voice system module,
hardware detection component: after a program in a communication network starts to execute, calling a system interface at a background, detecting hardware equipment connected with the current computer equipment, finding out the hardware equipment responsible for audio input and output, and accessing the hardware equipment into software;
specifically, when the player speaks, the software invokes the audio input device, such as: a microphone for receiving a player's voice, the voice being streamed into the software; the data stream is output to an audio output device, such as a speaker, a sound box, or headphones, which outputs sound to the player.
When voice collaboration is carried out, a voice transmission rule is required to be formulated:
by default, when a player speaks, no one will hear them, and you need to set where to send the sound at the speaking end and where to receive the sound at the listening end before the players can communicate. Where to send is controlled by the "voice broadcast trigger" component and where to receive is controlled by the "voice receive trigger" component.
The "voice broadcast trigger" not only controls who sends where, it also controls when the voice is transmitted to a given target. This is called "activation" and is further divided into two parts: whether the user wants to speak and whether the user is allowed to speak.
Activating the call component: activating a conversation function through a keyboard key, activating voice when the key is pressed down, and releasing the key to disable the voice;
in particular, the "active mode" setting on the "voice broadcast trigger" determines how the user indicates whether they want to speak, which can be set as: "none", "voice activation" and "push-to-talk".
The "trigger activation" setting is set by: if the user is allowed to speak, an associated trigger volume may enable and disable the broadcast because of the volume the player moves in and out. This can be used to create areas in the scene that the player needs to stand inside to be heard (e.g., close-range chat).
An echo cancellation component: a mute compression technology is adopted for eliminating echo in voice call;
in particular, echo cancellation is a process of canceling echo in a voice call to improve call quality. Echo cancellation is often required due to echo generation by voice compression techniques and packet processing delays. Both types of voiced echo and mixed echo.
Echo cancellation not only improves speech quality, but also reduces the bandwidth occupied by the application of silence compression techniques.
As shown in fig. 2, the figure specifically describes the process of two users making a call by voice;
as shown in fig. 3, from which follows: user 1 and user 2 talk, user 2 and user 3 talk, and user 1 and user 3 cannot talk.
The foregoing is a more detailed description of the invention in connection with specific preferred embodiments and it is not intended that the invention be limited to these specific details. For those skilled in the art to which the invention pertains, several simple deductions or substitutions can be made without departing from the spirit of the invention, and all shall be considered as belonging to the protection scope of the invention.
Claims (6)
1. A multi-user voice collaboration system based on a communication network is characterized by comprising:
the bottom API module is used for data transmission and bottom configuration;
sending information and information serialization to a connection management module through a bottom API module, wherein the connection management module is used for taking charge of network client management and network server management;
the object state and behavior module is used for processing the network identity and the network behavior;
the object life cycle module is used for managing network scenes and client scenes;
the engine integration module is used for integrating all components including the network position component, the network animation component and the network distance checking component; and
a voice system module comprising a hardware detection component, an active call component, and an echo cancellation component.
2. The multi-user voice collaboration system as claimed in claim 1, wherein: in the underlying API module in question,
the method supports the following modes for carrying out bottom layer transmission, and the specific modes comprise: TCP, UDP, and data streaming.
3. The multi-user voice collaboration system as claimed in claim 1, wherein: in the connection management module, the connection management module is provided with a connection management module,
when the system is in charge of network client management and network server management, the system comprises the use, synthesis and coordination of hardware and software, and can monitor, test, configure, analyze, evaluate and control network resources.
4. The multi-user voice collaboration system as claimed in claim 1, wherein: in the object life-cycle module,
the game object in the scene controls the concrete behavior through the script, the game needs to be operated through the connection management module when controlling the game, the game needs to be managed through the network hall when controlling the player, the management of the network hall is taken as the temporary transfer area before the player formally enters the game,
in this zone, the specific actions controlled by the player are: setting options and preparing before starting the game; meanwhile, the network lobby management can limit the number of the players to join, support other players with limited numbers on each client in the multi-player game, prevent the players from joining when the game is in progress, ensure the preparation state of each player, start the game under the condition that the players are prepared, and set data of each player, rejoin the network lobby when the game is finished, provide virtual functions of events of the network lobby for developers to develop custom logic, and provide user interfaces for interaction of the network lobby.
5. The multi-user voice collaboration system as claimed in claim 1, wherein: in the engine-integration module,
a network location component: an object in the scene between each player that requires synchronization information, including but not limited to position, animated objects, that collects the information and synchronizes the information between multiple players;
a network animation component: the system is used for making dynamic pictures and static pictures in a game scene;
a network distance checking component: for detecting spacing information between two or more players.
6. A multi-user voice collaboration system as claimed in claim 1 wherein: in the voice system module, the voice system module is provided with a voice input module,
hardware detection component: after a program in a communication network starts to execute, calling a system interface at a background, detecting hardware equipment connected with the current computer equipment, finding out the hardware equipment responsible for audio input and output, and accessing the hardware equipment into software;
activating the call component: activating a conversation function through a keyboard key, activating voice when the key is pressed down, and releasing the key to disable the voice;
an echo cancellation component: a silence compression technique is employed for echo cancellation in voice calls.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111365463.4A CN114095548A (en) | 2021-11-18 | 2021-11-18 | Multi-person voice collaboration system based on communication network |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111365463.4A CN114095548A (en) | 2021-11-18 | 2021-11-18 | Multi-person voice collaboration system based on communication network |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114095548A true CN114095548A (en) | 2022-02-25 |
Family
ID=80301850
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111365463.4A Pending CN114095548A (en) | 2021-11-18 | 2021-11-18 | Multi-person voice collaboration system based on communication network |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114095548A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114653054A (en) * | 2022-05-23 | 2022-06-24 | 科大讯飞(苏州)科技有限公司 | Game boot device, related method and computer-readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1848892A (en) * | 2005-04-04 | 2006-10-18 | 英华达（南京）科技有限公司 | Method for realizing talking during pair-playing games by mobile communication apparatus |
| CN102262534A (en) * | 2011-07-12 | 2011-11-30 | 红石娱动网络科技(北京)有限公司 | System and method for developing computer online games based on Internet browser/server (B/S) structure |
| CN111427453A (en) * | 2020-03-30 | 2020-07-17 | 上海盛翔信息科技有限公司 | Method for multi-person collaborative interaction and perception in medical virtual reality training scene |
| CN113413613A (en) * | 2021-06-17 | 2021-09-21 | 网易（杭州）网络有限公司 | Method and device for optimizing voice chat in game, electronic equipment and medium |
-
2021
- 2021-11-18 CN CN202111365463.4A patent/CN114095548A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1848892A (en) * | 2005-04-04 | 2006-10-18 | 英华达（南京）科技有限公司 | Method for realizing talking during pair-playing games by mobile communication apparatus |
| CN102262534A (en) * | 2011-07-12 | 2011-11-30 | 红石娱动网络科技(北京)有限公司 | System and method for developing computer online games based on Internet browser/server (B/S) structure |
| CN111427453A (en) * | 2020-03-30 | 2020-07-17 | 上海盛翔信息科技有限公司 | Method for multi-person collaborative interaction and perception in medical virtual reality training scene |
| CN113413613A (en) * | 2021-06-17 | 2021-09-21 | 网易（杭州）网络有限公司 | Method and device for optimizing voice chat in game, electronic equipment and medium |
Non-Patent Citations (3)
| Title |
|---|
| 月神天: "U n i t y⽹络教程翻译（三）多⼈游戏⼤厅", pages 1 - 6, Retrieved from the Internet <URL:https://blog.51cto.com/abyss/1769697> * |
| 月神天: "Unity网络教程翻译（二）如何使用NetworkManager", pages 1 - 9, Retrieved from the Internet <URL:https://blog.51cto.com/abyss/1769034> * |
| ⽉神天: "U n i t y⽹络教程翻译（⼀）从零开始编写⼀个⽹络游戏", Retrieved from the Internet <URL:https://blog.51cto.com/abyss/1768721> * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114653054A (en) * | 2022-05-23 | 2022-06-24 | 科大讯飞(苏州)科技有限公司 | Game boot device, related method and computer-readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10335691B2 (en) | System and method for managing audio and video channels for video game players and spectators | |
| CN101001678B (en) | SIP based VOIP multiplayer network games | |
| US7346654B1 (en) | Virtual meeting rooms with spatial audio | |
| US8559646B2 (en) | Spatial audio teleconferencing | |
| US8526587B2 (en) | Web guided collaborative audio | |
| US20190314728A1 (en) | System and Method for Managing Audio and Video Channels for Video Game Players and Spectators | |
| US20090089439A1 (en) | Communication between a real world environment and a virtual world environment | |
| US20090106670A1 (en) | Systems and methods for providing services in a virtual environment | |
| WO2008125593A2 (en) | Virtual reality-based teleconferencing | |
| US20080294721A1 (en) | Architecture for teleconferencing with virtual representation | |
| EP2349514B1 (en) | Data stream processing | |
| CN109728994B (en) | Call method, device and computer readable storage medium | |
| CN114095548A (en) | Multi-person voice collaboration system based on communication network | |
| CN107666396B (en) | Multi-terminal conference processing method and device | |
| US20080256452A1 (en) | Control of an object in a virtual representation by an audio-only device | |
| WO2009014777A1 (en) | Communication system for oil and gas platforms | |
| CN114979545A (en) | Multi-terminal call method, storage medium and electronic device | |
| Triebel et al. | Peer-to-peer voice communication for massively multiplayer online games | |
| Yasumoto et al. | Ravitas: Realistic voice chat framework for cooperative virtual spaces | |
| US11871208B2 (en) | Methods and systems for spatial rendering of multi-user voice communication | |
| Goose et al. | Conferencing3: 3D audio conferencing and archiving services for handheld wireless devices | |
| CN113542511A (en) | Processing method of multi-channel audio mixing, mixing device and readable storage medium | |
| CN101753325A (en) | Network voice communication system and method thereof | |
| Blum | Evaluating the applications of spatial audio in telephony | |
| Sánchez Pardo | Spatial Audio for the Mobile User |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |