CN109981575A - Speech room under virtualized environment - Google Patents
Speech room under virtualized environment Download PDFInfo
- Publication number
- CN109981575A CN109981575A CN201910132022.6A CN201910132022A CN109981575A CN 109981575 A CN109981575 A CN 109981575A CN 201910132022 A CN201910132022 A CN 201910132022A CN 109981575 A CN109981575 A CN 109981575A
- Authority
- CN
- China
- Prior art keywords
- terminal
- speech
- student
- execution module
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
- H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
- H04L12/185—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast with management of multicast group membership
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
- H04L65/611—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for multicast or broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/08—Protocols specially adapted for terminal emulation, e.g. Telnet
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Telephonic Communication Services (AREA)
Abstract
The present invention provides the speech rooms under a kind of virtualized environment, comprising: control network and data network, wherein control network is built-up by disposing control module in virtual desktop, and the data network is built-up by deployment execution module in the terminal；The control module is for display interface and responds user's operation, control multi-person speech to the foundation of screen broadcasting session of making peace, be added, exit and destroy；The execution module is responsible for acquisition, coding, transmission, decoding, broadcasting and display of voice and screen broadcasting data etc.；Voice data is sent directly to other terminals from a terminal and is no longer transferred in virtual machine and is handled by the execution module；The terminal is broadcasted other terminals after receiving normal screen picture, is then displayed on the screen after decoding.The present invention reduces when using speech talkback function, the forwarded and encoding and decoding number of voice data reduce mouth-to-ear delay and distortion, improve the quality of speech talkback；Unnecessary encoding-decoding process when using screen broadcasting is eliminated, the load of server is reduced, saves IT hardware cost.
Description
Technical field
Speech room the present invention relates to virtual speech instructional technology field, in particular under a kind of virtualized environment.
Background technique
After speech room is in conjunction with virtualization technology, it can use a server and be created that more virtual machines, greatly save
IT hardware cost has been saved, and can unify easily to manage virtual machine, has mitigated the workload of management significantly.But speech room is as existing
The language teaching facility of generationization, the multi-person speech of core but show to be not so good as to screen broadcasting function is made peace under virtualized environment
People's will hinders virtualization technology in the popularization of speech room scene significantly.
Under virtualized environment, the process of multi-person speech intercommunication in the prior art is as shown in Figure 1, detailed process is as follows:
The terminal of student 1 is after acquiring sound, by encoded speech data, the clothes that are then sent to by Transmission Control Protocol where virtual desktop
Business device；After server receives encoded voice data, decodes it and pass to virtual desktop；Voice in virtual desktop
Intercommunication program obtains decoded audio data from operating system, then encodes it again, and passes through RTP/RTCP etc.
Agreement is sent to the speech talkback program in the virtual desktop of student 2；The speech talkback program of student 2 is decoded from student's 1
After the voice data of speech talkback program, decoded voice data is consigned to the operating system of virtual desktop；The behaviour of student 2
Make system and decoded voice data be transmitted to virtual machine process, then virtual machine process to decoded voice data again
Coding, is then sent to the terminal of student 2；It after the terminal of student 2 receives encoded voice data, decodes and plays, learn
Raw 2 can hear the voice of student 1.
It can be seen that under virtualization scene from above-mentioned process, when multi-person speech intercommunication, voice data is reached from a user
Another user needs process, which is transmitted several times, and encoding and decoding are so that the delay increase of speech talkback, distortion rate increase leads to language
Sound quality decline, is unable to satisfy the demand of language teaching.And speech talkback program needs to return voice data toward contact
The operation such as sound elimination, noise suppressed, under the scene of more people's intercommunications, can obviously increase the load of server, further deteriorate language
Sound quality, and reduce the band machine quantity of server.
Under virtualized environment, the process of screen broadcasting in the prior art is as shown in Fig. 2, detailed process is as follows: virtual
The screen picture of desktop is sent to terminal after coding in virtualization program, then decodes and is displayed on the screen；Teacher
Or after student 1 starts screen broadcasting program, the screen picture and coding of virtual desktop can be periodically intercepted, RTP/RTCP is then passed through
Agreement is sent to the reception program of other virtual desktops；After the screen broadcasting reception program of virtual desktop receives data, decoding
It data and is shown in virtual desktop by the API of system.
But it is different from voice data, the encoding and decoding of screen picture can consume a large amount of system resource, lead to system response
Slowly, it greatly affected user experience, and seriously reduce the band machine quantity of server.
Summary of the invention
The present invention provides the speech rooms under a kind of virtualized environment, to solve at least one above-mentioned technical problem.
To solve the above problems, as one aspect of the present invention, the speech room under a kind of virtualized environment, packet are provided
It includes: control network and data network, wherein control network is built-up by disposing control module in virtual desktop, described
Data network is built-up by deployment execution module in the terminal；The control module is for display interface and responds user
Operation, control multi-person speech to the foundation of screen broadcasting session of making peace, be added, exit and destroy；The execution module is responsible for
Acquisition, coding, transmission, decoding, broadcasting and display of voice and screen broadcasting data etc.；The execution module voice data from
One terminal is sent directly to other terminals and is no longer transferred in virtual machine and is handled；The terminal is receiving normally
After screen picture, other terminals are broadcasted, are then displayed on the screen after decoding.
Preferably, the process of the multi-person speech intercommunication is as follows:
Step 1, control module is installed in the virtual desktop of student, converts order for the operation of student；Student's
Execution module is installed, for completing acquisition, coding, transmission, decoding and the broadcasting of voice data in terminal；
Step 2, it is operated on the interface of control module of the student in virtual desktop, is added or exits multi-person speech to lecture
Words, these operations are converted corresponding order by control module, then these orders are sent to the student by Transmission Control Protocol and are corresponded to
Terminal in execution module；
Step 3, after the execution module of the student terminal receives addition order, the corresponding ip multicast of speech talkback session is added
Group exits command if received, and exits from corresponding ip multicast group；
Step 4, after which is successfully joined ip multicast group, execution module acquires sound simultaneously from the sound card of terminal
Echo cancellation and noise suppressed are carried out, then coded voice data, sends speech data to multicast group with RTP/RTCP agreement
In, and it is transferred to the execution module of other student terminals；
Step 5, the execution module of other student terminals receives the voice transmitted with RTP/RTCP agreement from multicast group
After data, it is decoded, and is played by the sound card of terminal.
Preferably, the process of the screen broadcasting is as follows:
Step 1, control module is installed in virtual desktop, converts order for the operation of user；Installation is held in the terminal
Row module, for completing the reception and forwarding of image data；
Step 2, when promoter as teacher or student as screen broadcasting, by terminal from the virtualization process institute of server
The image data forwarding portion received is into multicast group；
Step 3, the recipient of screen broadcasting is considered as corresponding from terminal after receiving image data in multicast group
The data that virtual desktop receives, into normal decoding, flow for displaying.
The solution of the present invention is compared with current deployment configuration scheme, by the virtualized environment of speech room be divided into control network and
Data network two parts dispose control module in virtual desktop, constitute control network, and dispose execution module in the terminal,
Constitute data network.Control module is only responsible for the foundation of management speech talkback and screen broadcasting session, is added, exits, destroying
The functions such as acquisition, encoding and decoding, broadcasting, the display of administrative functions, voice and image data are then real by the execution module in terminal
It is existing, reduce when using speech talkback function, the forwarded and encoding and decoding number of voice data, reduce mouth-to-ear delay and
Distortion, improves the quality of speech talkback；Unnecessary encoding-decoding process when using screen broadcasting is eliminated, server is reduced
Load, save IT hardware cost.
Detailed description of the invention
Fig. 1 schematically shows the flow chart of multi-person speech intercommunication in the prior art；
Fig. 2 schematically shows the flow charts of screen broadcasting in the prior art；
Fig. 3 schematically shows the flow chart of the multi-person speech intercommunication in the present invention；
Fig. 4 schematically shows the flow charts of the screen broadcasting in the present invention.
Specific embodiment
The embodiment of the present invention is described in detail below in conjunction with attached drawing, but the present invention can be defined by the claims
Implement with the multitude of different ways of covering.
The term being related in the present invention is explained as follows:
(1) virtualized environment (Virtualization environment): what virtualized environment described in text referred to
The technology that is virtualized using a server by utilizing to create more virtual machines, each virtual machine as one of server into
Journey is being run, and each virtual machine runs the operating system of oneself, and server is that virtual machine virtually dissolves various virtual hardware resources
(including CPU, RAM, hard disk and network controller), so that running multiple mutually independent operations in a physical machine
System.
(2) terminal (Terminal): terminal described in text, which refers to, to be linked into using virtual desktop display protocol by void
The client of the virtual machine created under quasi-ization environment, so that access virtual desktop and the PC using local reach the consistent effect of experience
Fruit, terminal can be PC, cloud terminal, zero client computer or thin client etc..
(3) speech room (Language lab): speech room described in text refers to using voice and image as supplementary means
Modern languages teaching facilities.
(4) speech talkback (Intercom): speech talkback described in text refers in same building or adjacent building
Between carry out the behavior of real time phone call by the network technologies such as local area network, the voice conferencing being common in enterprise, the voice in school
The scenes such as teaching and voice-enabled chat.
(5) screen broadcasting (Screen broadcast): screen broadcasting described in text refers to interception virtual desktop
The function of being encoded after screen-picture, be sent to other virtual desktops and show.
To solve the above-mentioned problems, the virtualized environment of speech room is divided into control network and data network two by the present invention
Point, control module is disposed in virtual desktop, constitutes control network, and execution module is disposed in the terminal, constitute data network.
Control module is responsible for display interface and responds user's operation, controls multi-person speech to screen broadcasting session of making peace
It establishes, be added, exit and destroy；Execution module is responsible for the acquisition of voice and screen broadcasting data, coding, transmission, decodes, broadcasts
The functions such as put and show.
By the way that voice data is sent directly to other terminals from terminal, it is no longer transferred in virtual machine and is handled, incited somebody to action
Transmission and the encoding and decoding number that voice data can be reduced, to improve the sound quality of speech talkback.Terminal is receiving normally
Screen picture after, be broadcasted other terminals, be then displayed on the screen after decoding, eliminate unnecessary volumes and solve
Code process, reduces the load of server.So virtualization technology can will meet well language after using the present invention
High quality, the modernizing teaching demand of low-load of tone chamber.
As shown in figure 3, multi-person speech intercommunication technical solution process of the invention is as follows:
1. installing control module in the virtual desktop of student, order is converted by the operation of student；In the terminal of student
Middle installation execution module, for completing acquisition, coding, transmission, decoding and the broadcasting of voice data；
2. operating on the interface of control module of the student in virtual desktop, it is added or exits multi-person speech intercommunication session,
These operations are converted corresponding order by control module, then that these orders by Transmission Control Protocol are sent to the student is corresponding
Execution module in terminal；It is sent to the execution module in terminal from the control module in virtual desktop, is same
3. after the execution module of student terminal receives addition order, the corresponding ip multicast group of speech talkback session being added, receives
To exiting command, then exited from corresponding ip multicast group；
4. after student terminal is successfully joined ip multicast group, execution module acquires sound from the sound card of terminal and carries out echo
Elimination and noise suppressed, then coded voice data, is sent speech data in multicast group, and transmit with RTP/RTCP agreement
To the execution module of other student terminals；
5. the execution module of other student terminals receives the voice data transmitted with RTP/RTCP agreement from multicast group
Afterwards, it is decoded, and is played by the sound card of terminal.
By the way that the control of multi-person speech intercommunication program and execution function to be deployed in virtual desktop and terminal respectively, reduce
The encoding and decoding of voice data and the number of transmissions meet high quality requirement of the speech room to multi-person speech intercommunication with this.
As shown in figure 4, the screen broadcasting technical solution process in the present invention is as follows:
1. installing control module in virtual desktop, order is converted by the operation of user；Installation executes mould in the terminal
Block, for completing the reception and forwarding of image data；
2. terminal is received from the virtualization process of server as promoter as screen broadcasting of teacher or student
Image data forwarding portion into multicast group；
3. the recipient of screen broadcasting after receiving image data in multicast group, is considered as corresponding virtual from terminal
The data that desktop receives, into normal decoding, flow for displaying.
By the image data in forwarding normal flow, unnecessary encoding-decoding process is eliminated, server is reduced with this and is existed
Load when using screen broadcasting function.
The solution of the present invention is compared with current deployment configuration scheme, by the virtualized environment of speech room be divided into control network and
Data network two parts dispose control module in virtual desktop, constitute control network, and dispose execution module in the terminal,
Constitute data network.Control module is only responsible for the foundation of management speech talkback and screen broadcasting session, is added, exits, destroying
The functions such as acquisition, encoding and decoding, broadcasting, the display of administrative functions, voice and image data are then real by the execution module in terminal
It is existing, reduce when using speech talkback function, the forwarded and encoding and decoding number of voice data, reduce mouth-to-ear delay and
Distortion, improves the quality of speech talkback；Unnecessary encoding-decoding process when using screen broadcasting is eliminated, server is reduced
Load, save IT hardware cost.
The foregoing is only a preferred embodiment of the present invention, is not intended to restrict the invention, for the skill of this field
For art personnel, the invention may be variously modified and varied.All within the spirits and principles of the present invention, made any to repair
Change, equivalent replacement, improvement etc., should all be included in the protection scope of the present invention.
Claims (3)
1. the speech room under a kind of virtualized environment characterized by comprising control network and the data network, wherein control
Network processed is built-up by disposing control module in virtual desktop, and the data network executes mould by deployment in the terminal
Block is built-up；
The control module is for display interface and responds user's operation, controls multi-person speech to screen broadcasting session of making peace
It establishes, be added, exit and destroy；
The execution module is responsible for acquisition, coding, transmission, decoding, broadcasting and display of voice and screen broadcasting data etc.；
The execution module voice data be sent directly to other terminals from a terminal and be no longer transferred in virtual machine into
Row processing；
The terminal is broadcasted other terminals after receiving normal screen picture, is then shown in after decoding
On screen.
2. the speech room under virtualized environment according to claim 1, which is characterized in that the stream of the multi-person speech intercommunication
Journey is as follows:
Step 1, control module is installed in the virtual desktop of student, converts order for the operation of student；In the terminal of student
Middle installation execution module, for completing acquisition, coding, transmission, decoding and the broadcasting of voice data；
Step 2, it is operated on the interface of control module of the student in virtual desktop, is added or exits multi-person speech intercommunication session,
These operations are converted corresponding order by control module, then that these orders by Transmission Control Protocol are sent to the student is corresponding
Execution module in terminal；
Step 3, after the execution module of the student terminal receives addition order, the corresponding ip multicast group of speech talkback session is added,
It exits command if received, is exited from corresponding ip multicast group；
Step 4, after which is successfully joined ip multicast group, execution module acquires sound and is carried out from the sound card of terminal
Echo cancellation and noise suppressed, then coded voice data, is sent speech data in multicast group with RTP/RTCP agreement, and
It is transferred to the execution module of other student terminals；
Step 5, the execution module of other student terminals receives the voice data transmitted with RTP/RTCP agreement from multicast group
Afterwards, it is decoded, and is played by the sound card of terminal.
3. the speech room under virtualized environment according to claim 1, which is characterized in that the process of the screen broadcasting is such as
Under:
Step 1, control module is installed in virtual desktop, converts order for the operation of user；Installation executes mould in the terminal
Block, for completing the reception and forwarding of image data；
Step 2, when promoter as teacher or student as screen broadcasting, terminal is received from the virtualization process of server
Image data forwarding portion into multicast group；
Step 3, the recipient of screen broadcasting is considered as corresponding virtual from terminal after receiving image data in multicast group
The data that desktop receives, into normal decoding, flow for displaying.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910132022.6A CN109981575A (en) | 2019-02-22 | 2019-02-22 | Speech room under virtualized environment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910132022.6A CN109981575A (en) | 2019-02-22 | 2019-02-22 | Speech room under virtualized environment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109981575A true CN109981575A (en) | 2019-07-05 |
Family
ID=67077237
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910132022.6A Pending CN109981575A (en) | 2019-02-22 | 2019-02-22 | Speech room under virtualized environment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109981575A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110706718A (en) * | 2019-09-27 | 2020-01-17 | 武汉噢易云计算股份有限公司 | Audio peripheral denoising processing method and system based on desktop virtualization |
| CN111028588A (en) * | 2020-01-08 | 2020-04-17 | 李娜 | System for studying and communicating minority languages by using Internet |
| CN111046454A (en) * | 2019-12-20 | 2020-04-21 | 武昌首义学院 | Three-dimensional virtual indoor design simulation system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102932566A (en) * | 2012-10-16 | 2013-02-13 | 福建升腾资讯有限公司 | Method for reducing voice distortion in VOIP (Voice over Internet Protocol) phone call under VDI (Virtual Desktop Infrastructure) environment |
| US20150074556A1 (en) * | 2013-09-10 | 2015-03-12 | Minerva Project, Inc. | Registering and Displaying Visual Attention MetaData in a Web Video Conferencing and Seminar System |
| CN106101794A (en) * | 2016-06-22 | 2016-11-09 | 杭州华三通信技术有限公司 | The processing method of a kind of virtual desktop video data, Apparatus and system |
| CN106959854A (en) * | 2017-03-23 | 2017-07-18 | 江苏磐数信息科技有限公司 | Cloud terminal virtualization system |
-
2019
- 2019-02-22 CN CN201910132022.6A patent/CN109981575A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102932566A (en) * | 2012-10-16 | 2013-02-13 | 福建升腾资讯有限公司 | Method for reducing voice distortion in VOIP (Voice over Internet Protocol) phone call under VDI (Virtual Desktop Infrastructure) environment |
| US20150074556A1 (en) * | 2013-09-10 | 2015-03-12 | Minerva Project, Inc. | Registering and Displaying Visual Attention MetaData in a Web Video Conferencing and Seminar System |
| CN106101794A (en) * | 2016-06-22 | 2016-11-09 | 杭州华三通信技术有限公司 | The processing method of a kind of virtual desktop video data, Apparatus and system |
| CN106959854A (en) * | 2017-03-23 | 2017-07-18 | 江苏磐数信息科技有限公司 | Cloud terminal virtualization system |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110706718A (en) * | 2019-09-27 | 2020-01-17 | 武汉噢易云计算股份有限公司 | Audio peripheral denoising processing method and system based on desktop virtualization |
| CN111046454A (en) * | 2019-12-20 | 2020-04-21 | 武昌首义学院 | Three-dimensional virtual indoor design simulation system |
| CN111046454B (en) * | 2019-12-20 | 2024-01-12 | 武昌首义学院 | Three-dimensional virtual indoor design simulation system |
| CN111028588A (en) * | 2020-01-08 | 2020-04-17 | 李娜 | System for studying and communicating minority languages by using Internet |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102017513B (en) | Method for real time network communication as well as method and system for real time multi-lingual communication | |
| CN112543297B (en) | Video conference live broadcast method, device and system | |
| CN106462573B (en) | It is translated in call | |
| US8660039B2 (en) | Multi-channel multi-access voice over IP intercommunication systems and methods | |
| CN109981575A (en) | Speech room under virtualized environment | |
| US20070206091A1 (en) | System and method for displaying participants in a videoconference between locations | |
| CN101557496B (en) | Built-in video conference cooperative operation system | |
| CN102883135A (en) | Screen sharing and control method thereof | |
| JP7023274B2 (en) | Caller queue methods and systems to manage incoming video callers | |
| CN103384235A (en) | Method, server and system used for data presentation during conversation of multiple persons | |
| CN101477754A (en) | Wireless classroom system | |
| CN110677406A (en) | Simultaneous interpretation method and system based on network | |
| US20120259924A1 (en) | Method and apparatus for providing summary information in a live media session | |
| CN103051864A (en) | Mobile video conference method and system thereof | |
| CN1411278A (en) | IP network TV conference system | |
| CN101426121A (en) | PSTN speech and IP video visible telephone having embedded browser | |
| CN103139202A (en) | Thin client, communication method and device thereof | |
| CN107592429A (en) | A kind of more seat multimedia dispatching systems | |
| CN102306430B (en) | Self-help system and equipment for realizing AV (audio/video) integration | |
| CN102055857A (en) | Packet switching-based digital multi-channel director system and control method thereof | |
| CN101502043B (en) | Method for carrying out a voice conference, and voice conference system | |
| US20220191330A1 (en) | Method and system for making context based announcements during a communication session | |
| CN205647777U (en) | Meeting multi -media network communication of enterprise framework | |
| CN100407682C (en) | Multiside speaking system | |
| CN102172018B (en) | For the method and apparatus connecting at least one data source that at least one personal-machine interface is connected with video conferencing system in the range of video conference with operation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190705 |