CN111083427B - Data processing method of embedded terminal and 4K video conference system - Google Patents
Data processing method of embedded terminal and 4K video conference system Download PDFInfo
- Publication number
- CN111083427B CN111083427B CN201911377836.2A CN201911377836A CN111083427B CN 111083427 B CN111083427 B CN 111083427B CN 201911377836 A CN201911377836 A CN 201911377836A CN 111083427 B CN111083427 B CN 111083427B
- Authority
- CN
- China
- Prior art keywords
- conference
- embedded terminal
- terminal
- media
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/155—Conference systems involving storage of or access to video conference sessions
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention discloses an embedded terminal and a data processing method of a 4K video conference system, wherein the embedded terminal has simple functions, video acquisition and compression coding are carried out in a 4K camera in a video conference, decoding and display are carried out in a 4K display terminal, and the embedded terminal is only responsible for single media stream transmission and conference management, so the embedded terminal is convenient to design, has a simple structure and low implementation cost, has a local proxy function, can change public network media stream transmission into local network media stream transmission in a plurality of scenes on the premise of keeping the functions unchanged, improves network transmission quality, improves the audio and video quality and experience of the video conference, simultaneously reduces the occupation of public network bandwidth, and saves the network bandwidth cost for using the video conference.
Description
Technical Field
The invention relates to the technical field of network video conferences, in particular to a data processing method of an embedded terminal and a 4K video conference system.
Background
With the rapid development of internet and multimedia technologies, more and more users are beginning to use internet-based video conferencing. Each user can access the conference at any time by using a mobile phone, a computer, a conference room terminal and other equipment no matter in any place as long as the Internet exists. In a network video conference product, each participating terminal is connected to a background server through the internet and transmits signaling and media data, so that audio and video calls of multi-point and multi-person conferences are realized. The special terminal equipment for the conference room can provide conference meeting experience with higher definition and quality.
The rapid development of the internet also brings new changes to the video conference, and the video conference with ultrahigh definition is more and more favored by users. The resolution of the 4K video is enlarged by 4 times than that of the 1080P video, and the resolution of the 8K video is enlarged by 16 times than that of the 1080P video; while a video frame rate of 30 frames per second may not meet the user's needs in some scenarios, 60 frames per second is moving towards more user and application scenarios. The increase of the resolution and the increase of the frame rate lead to the increase of the data quantity to be processed by the video conference terminal and the background, and the computation quantity of the coding compression algorithm of the video image is greatly increased; in order to achieve a clearer viewing effect, the video bitrate is also increased. For example, from 1080P to 4K videos, the encoding operation amount under the same frame rate is increased by 4 times, HEVC is used for replacing H264/AVC, the encoder complexity is increased by more than 4 times, and the code rate is increased to more than 4Mbps or even 16 Mbps.
Compared with individual users, enterprise users generally have a plurality of conference rooms inside the enterprise, and in order to obtain a better video conference effect, each conference room needs to be provided with a set of video conference room terminal equipment. Meanwhile, the enterprise user is generally in an office place, the bought or rented internet bandwidth is far lower than the local area network bandwidth, and when there are more people participating in the enterprise at the same time, the internet exit bandwidth may become a bottleneck or the video quality is obviously reduced.
The existing 4K video conference room terminal generally comprises functional modules such as video acquisition, compression coding, network transmission, decoding display and the like, and one or more board cards are used for processing audio and video data of the whole terminal. The 4K video data can be acquired to the processing board card through an HDMI interface, a USB interface and a network interface, and is transmitted to background services through a network after being encoded and compressed; and the background video code stream received from the network completes decoding and video display by using the integrated board card. The following problems exist in the prior art: the main functional modules of the first, video acquisition, compression coding, decoding display and the like are centralized in one embedded device, and the 4K video has huge data volume to be processed, so that the design complexity and the cost of the terminal are high. And does not facilitate flexible configuration of functions and performance; secondly, in order to obtain better video quality, the coding rate of the 4K video is generally higher, and the required network bandwidth is also higher. When a plurality of 4K terminals participate in the conference simultaneously in the local area network of the same enterprise, the internet bandwidth required by the enterprise is large, the audio and video quality is obviously reduced, and the conference effect is even influenced. Thirdly, the video definition is continuously improved, hardware is difficult to upgrade, along with the improvement of the video resolution, the video compression algorithm with better compression efficiency and higher operation complexity is also gradually upgraded, and the existing 4K terminal is difficult to support a new technology by depending on software upgrading.
The information disclosed in this background section is only for enhancement of understanding of the general background of the invention and should not be taken as an acknowledgement or any form of suggestion that this information forms the prior art already known to a person skilled in the art.
Disclosure of Invention
The invention aims to provide an embedded terminal and a data processing method of a 4K video conference system, wherein the embedded terminal has simple functions, video acquisition and compression coding are carried out in a 4K camera in a video conference, decoding and display are carried out in a 4K display terminal, the embedded terminal is only responsible for single media stream transmission and conference management, the embedded terminal is convenient to design, simple in structure and low in implementation cost, and has a local proxy function, and public network media stream transmission can be changed into local area network media stream transmission under a plurality of scenes on the premise of keeping the functions unchanged, so that the network transmission quality is improved, the audio and video quality and experience of the video conference are improved, the occupation of public network bandwidth is reduced, and the network bandwidth cost of the video conference is saved.
In order to achieve the above object, the present invention provides a 4K network camera, including: hardware code and a first central processing unit. And the hardware encoder is used for compressing the acquired YUV video frames into HEVC code streams. The first central processing unit is used for compressing the collected voice into an OPUS audio code stream, and multiplexing each compressed HEVC code stream frame and each OPUS audio code stream frame into a single media stream according to respective collecting time stamps, so that the synchronism of each HEVC code stream frame and each OPUS audio code stream frame is ensured.
The present invention also provides an embedded terminal, which includes: a conference management module and a media stream transmission module. The conference management module is used for receiving a control signaling of the conference control cloud service platform to realize management of the network conference, wherein the management of the network conference by the conference management module comprises: managing the registration and login behaviors of other terminals to the embedded terminal, establishing a conference, deleting the conference and/or establishing and updating a media data transmission routing table. And the media stream transmission module is coupled with the conference management module and is used for transmitting a media stream according to the signaling of the conference management module, wherein the media stream is formed by synchronously multiplexing each frame of HEVC code stream and each frame of OPUS audio code stream.
The present invention also provides a 4K display terminal, which includes: the device comprises a media stream de-multiplexing module, a video decoding module, a second central processing unit, a display screen and a loudspeaker. The media stream de-multiplexing module is used for de-multiplexing the received media stream data so as to obtain an HEVC code stream and an OPUS audio code stream. And the video decoding module is used for decoding the HEVC code stream so as to obtain video data. And the second central processing unit is used for decoding the OPUS audio code stream and carrying out multi-path sound mixing. The display screen is coupled with the video decoding module and used for displaying the video data. The loudspeaker is coupled with the second central processing unit and used for outputting the audio data of the multi-channel audio mixing.
The invention also provides a 4K video conference system, which comprises: the 4K network camera, the embedded terminal, the 4K display terminal, the conference control cloud service platform and the conference media cloud service platform are arranged on the mobile terminal.
The invention also provides a data processing method of the 4K video conference system, and the 4K video conference system comprises the following steps: the conference system comprises the 4K network camera, the embedded terminal, the 4K display terminal, a conference control cloud service platform and a conference media cloud service platform, wherein the 4K network camera and the 4K display terminal are connected to the embedded terminal through the same local area network, and the embedded terminal is connected to the conference control cloud service platform and the conference media cloud service platform through a public network.
The data processing method of the 4K video conference system comprises the following steps: the embedded terminal adds the IP addresses of the 4K network camera and the 4K display terminal connected with the embedded terminal into a conference equipment list, and establishes a local media data transmission routing table; the embedded terminal starts a local video conference and updates the local media data transmission routing table in real time; and the embedded terminal transmits the media stream of the 4K network camera to the appointed 4K display terminal according to the information of the local media data transmission routing table.
The invention also provides a data processing method of the 4K video conference system, wherein the 4K video conference system comprises the 4K network camera, the embedded terminal, the 4K display terminal, a conference control cloud service platform and a conference media cloud service platform; the 4K network camera and the 4K display terminal are connected to the embedded terminals through the same local area network; the embedded terminals are connected to the conference control cloud service platform and the conference media cloud service platform through a public network, and one embedded terminal in all the embedded terminals is designated as a host role.
The data processing method of the 4K video conference system comprises the following steps: each embedded terminal adds the IP addresses of the 4K network camera and the 4K display terminal connected with the embedded terminal into a conference equipment list, establishes a local media data transmission routing table and sends the information of the local media data transmission routing table to the embedded terminal which is in the role of a host; the embedded terminal which is taken as a host role establishes a local media data transmission routing table, opens a local conference, invites other embedded terminals to join the conference, and updates the local media data transmission routing table of the embedded terminal in real time; the embedded terminal which is taken as a host role receives media streams sent by other embedded terminals and forwards the media streams to the corresponding embedded terminals according to a local media data transmission routing table of the embedded terminal; and the embedded terminal receiving the media stream forwards the media stream to the corresponding 4K display terminal according to the local media data transmission routing table of the embedded terminal.
The invention also provides a data processing method of the 4K video conference system, and the 4K video conference system comprises the following steps: the conference control system comprises a first subsystem, a second subsystem, a conference control cloud service platform and a conference media cloud service platform, wherein the first subsystem comprises the 4K network camera, the embedded terminal and a plurality of the 4K display terminals, and the 4K network camera and the 4K display terminal in the first subsystem are connected to the embedded terminal in the first subsystem through the same or different local area networks; the second subsystem comprises the 4K network camera, the embedded terminal and the 4K display terminal, wherein the 4K network camera and the 4K display terminal in the second subsystem are connected to the embedded terminal in the second subsystem through a public network.
The data processing method of the 4K video conference system comprises the following steps: each embedded terminal adds the IP addresses of each 4K network camera and the 4K display terminal connected with the embedded terminal into a respective conference equipment list, establishes a respective local media data transmission routing table, and sends the information of the respective local media data transmission routing table to the conference control cloud service platform; the conference control cloud service platform issues signaling to inform all participating embedded terminals to join in the conference, and one embedded terminal is designated as a proxy embedded terminal in each local area network; the conference control cloud service platform issues a media data transmission routing table to the agent embedded terminal; when the embedded terminal in the public network selects the media stream in the local area network, the conference control cloud service platform informs the proxy embedded terminal in the local area network of forwarding the selected media stream data to the conference media cloud service platform through a signaling, and then the conference media cloud service platform forwards the media stream data to the corresponding embedded terminal in the public network.
In an embodiment of the present invention, the data processing method further includes: when the embedded terminal in the local area network selects the media stream in the public network, the conference control cloud service platform informs the agent embedded terminal in the local area network through a signaling, and the conference media cloud service platform forwards the media stream in the public network to the agent embedded terminal in the local area network, and then the agent embedded terminal forwards the media stream to the corresponding embedded terminal in the local area network.
In an embodiment of the present invention, the data processing method further includes: and the embedded terminal receiving the media stream forwards the media stream to the corresponding 4K display terminal according to the local media data transmission routing table of the embedded terminal.
Based on the same inventive concept, the present invention also provides a computer-readable storage medium for executing the data processing method of the 4K video conference system according to any one of the above embodiments.
Compared with the prior art, according to the data processing method of the embedded terminal and the 4K video conference system, 4K videos are compressed into HEVC code streams inside the 4K network camera; meanwhile, the decoding and display of the 4K video are centralized on the 4K display terminal, the transmission of YUV original image data is reduced, the design difficulty of the embedded terminal is reduced, the structures of the embedded terminal and the 4K video conference system are simplified, and the costs of the embedded terminal and the 4K video conference system are reduced. And the embedded terminal in the local area network has the local proxy function, and can change public network media stream transmission into local area network media stream transmission under a plurality of scenes on the premise of unchanging the function, so that the network transmission quality is improved, the audio and video quality and experience of the video conference are finally improved, the occupation of public network bandwidth is reduced, and the network bandwidth cost of using the video conference is saved. And the 4K network camera multiplexes the audio and video code stream into a single media stream according to the acquisition timestamp, and the audio and video can be accurately synchronized, so that audio and video desynchronization caused in the network transmission process is avoided, and audio and video synchronization experience in a conference is ensured.
Drawings
FIG. 1 is a 4K webcam according to an embodiment of the present invention;
fig. 2 is an embedded terminal according to an embodiment of the present invention;
FIG. 3 is a 4K display terminal according to an embodiment of the present invention;
FIG. 4 is a 4K video conferencing system according to an embodiment of the present invention;
fig. 5 is a data processing method of a 4K video conference system according to an embodiment of the present invention;
FIG. 6 is a 4K video conferencing system according to an embodiment of the present invention;
fig. 7 is a data processing method of a 4K video conference system according to an embodiment of the present invention;
FIG. 8 is a 4K video conferencing system according to an embodiment of the present invention;
fig. 9 is a data processing method of a 4K video conference system according to an embodiment of the present invention.
Detailed Description
The following detailed description of the present invention is provided in conjunction with the accompanying drawings, but it should be understood that the scope of the present invention is not limited to the specific embodiments.
Throughout the specification and claims, unless explicitly stated otherwise, the word "comprise", or variations such as "comprises" or "comprising", will be understood to imply the inclusion of a stated element or component but not the exclusion of any other element or component.
Fig. 1 is a 4K network camera according to an embodiment of the present invention. The 4K network camera 100 includes: a hardware encoder 11 and a first central processor 12.
The hardware encoder 11 is configured to compress the acquired YUV video frames into an HEVC code stream.
The first central processing unit 12 is configured to compress the acquired speech into an OPUS audio code stream, and multiplex each compressed HEVC code stream frame and each compressed OPUS audio code stream frame into a single media stream according to respective acquisition timestamps, so as to ensure synchronization of each HEVC code stream frame and each OPUS audio code stream frame.
The 4K network camera reduces the transmission of YUV original image data, reduces the design difficulty of a subsequent embedded terminal for forwarding media stream data, is beneficial to simplifying the structure of the embedded terminal and reduces the cost of the embedded terminal.
Fig. 2 is an embedded terminal according to an embodiment of the present invention. The embedded terminal 200 includes a conference management module 21 and a media streaming module 22.
The conference management module 21 is configured to manage the network conference, where the management of the network conference by the conference management module 21 includes: managing the registration and login behavior of other terminals to the embedded terminal, establishing a conference, deleting a conference and/or establishing and updating a media data transmission routing table.
The media stream transmission module 22 is coupled to the conference management module 21, and is configured to transmit the media stream according to the signaling of the conference management module. The media stream is formed by synchronously multiplexing each frame of HEVC code stream and each frame of OPUS audio code stream.
The embedded terminal 200 is only used for managing the network conference and forwarding the media stream, and is convenient to design, simple in structure and low in implementation cost.
Fig. 3 is a 4K display terminal according to an embodiment of the present invention, the 4K display terminal 300 including: a media stream de-multiplexing module 31, a video decoding module 32, a second central processor 33, a display 34 and a speaker 35.
The media stream de-multiplexing module 31 is configured to de-multiplex the received media stream data to obtain an HEVC code stream and an OPUS audio code stream.
The video decoding module 32 is coupled to the media stream demultiplexing module 31, and is configured to decode the HEVC code stream to obtain video data.
The second central processor 33 is coupled to the media stream demultiplexing module 31, and is configured to decode the OPUS audio code stream and perform multi-channel audio mixing.
A display screen 34 is coupled to the video decoding module 32 for displaying the video data.
The speaker 35 is coupled to the second central processor 33 for outputting the multi-mixed audio data.
In an embodiment of the present invention, the 4K video conference system is constructed by the 4K network camera 100, the embedded terminal 200, the 4K display terminal 300, the conference control cloud service platform 400, and the conference media cloud service platform 500.
Specifically, as shown in fig. 4, the 4K video conference system according to an embodiment includes: the conference control system comprises 2 4K network cameras 100, 1 embedded terminal 200, 2 4K display terminals 300, a conference control cloud service platform 400 and a conference media cloud service platform 500, wherein the 4K network cameras 100 and the 4K display terminals 300 are connected to the embedded terminal 200 through the same local area network, and the embedded terminal 200 is connected to the conference control cloud service platform 400 and the conference media cloud service platform 500 through a public network.
As shown in fig. 5, the data processing method of the 4K video conference system includes: step S11 to step S14.
In step S11, the embedded terminal establishes a local media data transmission routing table. The embedded terminal 200 adds the IP addresses of the 4K network camera 100 and the 4K display terminal 300 connected to itself to the conference device list, and establishes a local media data transmission routing table.
In step S12, the embedded terminal starts the local video conference and updates the local media data transmission routing table in real time.
In step S13, the embedded terminal transmits the media stream. The embedded terminal 200 transmits the media stream of the 4K network camera 100 to the designated 4K display terminal 300 according to the information of the local media data transmission routing table.
In step S14, the 4K display terminal plays the media stream. The 4K display terminal 300 performs demultiplexing on the received media stream, then decodes the audio stream, selects multiple audio data to mix and output to a speaker, and simultaneously decodes the video stream, and closes the screen according to the conference layout and outputs to the display screen.
The embedded terminal 200 can update the conference layout and the local media data transmission routing table through the conference console or the web of the embedded terminal 200 at any time during the conference.
As shown in fig. 6, a 4K video conference system according to an embodiment includes: the conference control system comprises 2 4K network cameras 100, 2 embedded terminals 200, 2 4K display terminals 300, a conference control cloud service platform 400 and a conference media cloud service platform 500; the system comprises 2 4K network cameras 100, 2 embedded terminals 200 and 2 4K display terminals 300, wherein the 2 4K network cameras, the 2 embedded terminals and the 2 4K display terminals are connected through the same local area network; 2 embedded terminals 200 are connected to the conference control cloud service platform 400 and the conference media cloud service platform 500 through a public network, and one embedded terminal 200 of all embedded terminals 200 is designated as a moderator role.
As shown in fig. 7, the data processing method of the 4K video conference system includes steps S21 to S25.
In step S21, the embedded terminal establishes a local media data transmission routing table. Each embedded terminal 200 adds the IP addresses of the 4K network camera 100 and the 4K display terminal 300 connected to itself to the conference device list, establishes a local media data transmission routing table, and sends the local media data transmission routing table information of each embedded terminal 200 serving as a host role.
In step S22, the embedded terminal, which is the moderator role, opens the conference. The embedded terminal 200, which is in a host role, establishes a local media data transmission routing table, opens a local conference, invites other embedded terminals 200 to join the conference, and updates the local media data transmission routing table of itself in real time.
In step S23, the embedded terminal in the host role performs media stream forwarding. The embedded terminal 200, which is in a moderator role, receives the media streams sent by other embedded terminals 200, and forwards the media streams to the corresponding embedded terminals 200 according to the local media data transmission routing table of the embedded terminal 200.
In step S24, the embedded terminal transmits the media stream. The embedded terminal 200 receiving the media stream forwards the media stream to the corresponding 4K display terminal 300 according to its own local media data transmission routing table.
In step S25, the 4K display terminal plays the media stream. The 4K display terminal 300 performs demultiplexing on the received media stream, then decodes the audio stream, selects multiple audio data to mix and output to a speaker, and simultaneously decodes the video stream, and closes the screen according to the conference layout and outputs to the display screen.
The embedded terminal 200 can update the conference layout and the local media data transmission routing table through the conference console or the web of the embedded terminal 200 at any time during the conference.
As shown in fig. 8, a 4K video conference system according to an embodiment includes: a first subsystem 600, a second subsystem 700, a conference control cloud service platform 400, and a conference media cloud service platform 500. The first subsystem 600 includes 2 4K network cameras 100, 2 embedded terminals 200, and 2 4K display terminals 300, where the 4K network cameras 100 and the 4K display terminals 300 in the first subsystem 600 are connected to the embedded terminals 200 in the first subsystem 600 through the same or different local area networks; the second subsystem 700 includes 1 4K network camera 100, 1 embedded terminal 200, and 1 4K display terminal 300, where the 4K network camera 100 and the 4K display terminal 300 in the second subsystem are connected to the embedded terminal 200 in the second subsystem through a public network.
As shown in fig. 9, the data processing method of the 4K video conference system includes: step 31 to step 36.
In step S31, the embedded terminal establishes a local media data transmission routing table. Each embedded terminal 200 adds the IP addresses of each 4K network camera 100 and 4K display terminal 300 connected to itself to its own conference device list, establishes its own local media data transmission routing table, and sends its own local media data transmission routing table information to the conference control cloud service platform 400.
In step S32, the conference control cloud service platform opens the conference. The conference control cloud service platform 400 issues signaling to notify all participating embedded terminals 200 to join the conference, and designates one embedded terminal 200 as a proxy embedded terminal in each local area network.
In step S33, the conference control cloud service platform issues a media data transmission routing table to the proxy embedded terminal.
In step S34, the proxy embedded terminal and the conference media cloud service platform forward the media stream.
Specifically, when the embedded terminal 200 in the public network selects to watch the media stream in the local area network, the conference control cloud service platform 400 notifies the proxy embedded terminal in the local area network to forward the selected media stream data to the conference media cloud service platform 500 through a signaling, and then the conference media cloud service platform 500 forwards the media stream data to the corresponding embedded terminal 200 in the public network.
When the embedded terminal 200 in the local area network selects to view the media stream in the public network, the conference control cloud service platform 400 notifies the proxy embedded terminal in the local area network through a signaling, and the conference media cloud service platform 500 forwards the media stream in the public network to the proxy embedded terminal in the local area network, and then the proxy embedded terminal forwards the media stream to the corresponding embedded terminal 200 in the local area network.
In step S35, the embedded terminal transmits the media stream. The embedded terminal 200 transmits the media stream of the 4K network camera 100 to the designated 4K display terminal 300 according to the information of the local media data transmission routing table.
In step S36, the 4K display terminal plays the media stream. The 4K display terminal 300 performs demultiplexing on the received media stream, then decodes the audio stream, selects multiple audio data to mix and output to a speaker, and simultaneously decodes the video stream, and closes the screen according to the conference layout and outputs to the display screen.
The embedded terminal 200 can update the conference layout and the local media data transmission routing table through the conference console or the web of the embedded terminal 200 at any time during the conference.
Based on the same inventive concept, the present invention also provides a computer-readable storage medium for executing the data processing method of the 4K video conference system according to any one of the above embodiments.
In summary, according to the embedded terminal, the data processing method of the 4K video conference system, and the computer storage medium of the embodiment, the 4K video is compressed into the HEVC code stream inside the 4K network camera; meanwhile, the decoding and display of the 4K video are centralized on the 4K display terminal, the transmission of YUV original image data is reduced, the design difficulty of the embedded terminal is reduced, the structures of the embedded terminal and the 4K video conference system are simplified, and the costs of the embedded terminal and the 4K video conference system are reduced. And the embedded terminal in the local area network has the local proxy function, and can change public network media stream transmission into local area network media stream transmission under a plurality of scenes on the premise of unchanging the function, so that the network transmission quality is improved, the audio and video quality and experience of the video conference are finally improved, the occupation of public network bandwidth is reduced, and the network bandwidth cost of using the video conference is saved. And the 4K network camera multiplexes the audio and video code stream into a single media stream according to the acquisition timestamp, and the audio and video can be accurately synchronized, so that audio and video desynchronization caused in the network transmission process is avoided, and audio and video synchronization experience in a conference is ensured.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The foregoing descriptions of specific exemplary embodiments of the present invention have been presented for purposes of illustration and description. It is not intended to limit the invention to the precise form disclosed, and obviously many modifications and variations are possible in light of the above teaching. The exemplary embodiments were chosen and described in order to explain certain principles of the invention and its practical application to enable one skilled in the art to make and use various exemplary embodiments of the invention and various alternatives and modifications as are suited to the particular use contemplated. It is intended that the scope of the invention be defined by the claims and their equivalents.
Claims (5)
1. A data processing method of a 4K video conference system is characterized in that the 4K video conference system comprises the following steps: the conference control system comprises a first subsystem, a second subsystem, a conference control cloud service platform and a conference media cloud service platform, wherein the first subsystem comprises a 4K network camera, an embedded terminal and a 4K display terminal, and the 4K network camera and the 4K display terminal in the first subsystem are connected to the embedded terminal in the first subsystem through the same or different local area networks; the second subsystem comprises a 4K network camera, an embedded terminal and a 4K display terminal, wherein the 4K network camera and the 4K display terminal in the second subsystem are connected to the embedded terminal in the second subsystem through a public network;
the data processing method of the 4K video conference system comprises the following steps:
each embedded terminal adds the IP addresses of each 4K network camera and the 4K display terminal connected with the embedded terminal into a respective conference equipment list, establishes a respective local media data transmission routing table, and sends the information of the respective local media data transmission routing table to the conference control cloud service platform;
the conference control cloud service platform issues signaling to inform all participating embedded terminals to join in the conference, and one embedded terminal is designated as a proxy embedded terminal in each local area network;
the conference control cloud service platform issues a media data transmission routing table to the agent embedded terminal; and
when the embedded terminal in the public network selects the media stream in the local area network, the conference control cloud service platform informs the proxy embedded terminal in the local area network of forwarding the selected media stream data to the conference media cloud service platform through signaling, and then the conference media cloud service platform forwards the media stream data to the corresponding embedded terminal in the public network,
wherein, the embedded terminal includes:
the conference management module is used for receiving a control signaling of a conference control cloud service platform to realize management of the network conference, wherein the management of the network conference by the conference management module comprises: managing the behaviors of other terminals for registering and logging in the embedded terminal, establishing a conference, deleting the conference and/or establishing and updating a media data transmission routing table; and
and the media stream transmission module is coupled with the conference management module and is used for transmitting a media stream according to the signaling of the conference management module, wherein the media stream is a single media stream formed by synchronously multiplexing each frame of HEVC code stream and each frame of OPUS audio code stream.
2. The data processing method of the 4K video conference system as claimed in claim 1, wherein the data processing method further comprises:
when the embedded terminal in the local area network selects the media stream in the public network, the conference control cloud service platform informs the agent embedded terminal in the local area network through a signaling, and the conference media cloud service platform forwards the media stream in the public network to the agent embedded terminal in the local area network, and then the agent embedded terminal forwards the media stream to the corresponding embedded terminal in the local area network.
3. The data processing method of the 4K video conference system as claimed in claim 2, wherein the data processing method further comprises:
and the embedded terminal receiving the media stream forwards the media stream to the corresponding 4K display terminal according to the local media data transmission routing table of the embedded terminal.
4. The data processing method of the 4K video conference system according to claim 3, wherein the data processing method further comprises:
and the 4K display terminal performs demultiplexing operation on the received media stream, then decodes the audio stream, selects multi-channel audio data for mixing and then outputs the mixed audio data to a loudspeaker, and simultaneously decodes the video stream, and closes the screen according to the conference layout and then outputs the video stream to a display screen.
5. A computer-readable storage medium for performing the data processing method of the 4K video conference system according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911377836.2A CN111083427B (en) | 2019-12-27 | 2019-12-27 | Data processing method of embedded terminal and 4K video conference system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911377836.2A CN111083427B (en) | 2019-12-27 | 2019-12-27 | Data processing method of embedded terminal and 4K video conference system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111083427A CN111083427A (en) | 2020-04-28 |
| CN111083427B true CN111083427B (en) | 2021-05-18 |
Family
ID=70318627
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911377836.2A Active CN111083427B (en) | 2019-12-27 | 2019-12-27 | Data processing method of embedded terminal and 4K video conference system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111083427B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113038062B (en) * | 2021-03-12 | 2022-09-09 | 随锐科技集团股份有限公司 | Video communication method and system |
| CN113965571B (en) * | 2021-10-29 | 2023-09-15 | 北京锐安科技有限公司 | Management method, device, equipment and medium of distributed embedded equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1976434A (en) * | 2006-12-01 | 2007-06-06 | 王先来 | Method and system for realizing on-line video-frequency conference |
| CN101287094A (en) * | 2007-04-09 | 2008-10-15 | 中国移动通信集团公司 | Method and system for implementing media operation of multimedia meetings |
| CN101867586A (en) * | 2010-06-29 | 2010-10-20 | 中兴通讯股份有限公司 | Method and system for realizing cross network segment signaling interworking of videoconference system |
| CN203206277U (en) * | 2013-04-29 | 2013-09-18 | 熔点网讯(北京)科技有限公司 | Gateway used for video conferences |
| CN103841360A (en) * | 2013-12-11 | 2014-06-04 | 三亚中兴软件有限责任公司 | Distributed video conference achieving method and system, video conference terminal and audio and video integrated device |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8659636B2 (en) * | 2003-10-08 | 2014-02-25 | Cisco Technology, Inc. | System and method for performing distributed video conferencing |
| CN1889676A (en) * | 2006-06-01 | 2007-01-03 | 上海交通大学 | Video frequency session system based on P2P and SIP and realizing method thereof |
| US9516268B2 (en) * | 2014-03-28 | 2016-12-06 | International Business Machines Corporation | Maintaining audio video conference continuity |
| US9232190B1 (en) * | 2015-04-01 | 2016-01-05 | Ringcentral, Inc. | Systems and methods for managing multimedia conference calls |
| CN109688364A (en) * | 2018-08-21 | 2019-04-26 | 平安科技（深圳）有限公司 | Video-meeting method, device, server and storage medium |
| CN109660751A (en) * | 2018-12-28 | 2019-04-19 | 中兴通讯股份有限公司 | A kind of video meeting implementing method and device, video conferencing system, storage medium |
-
2019
- 2019-12-27 CN CN201911377836.2A patent/CN111083427B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1976434A (en) * | 2006-12-01 | 2007-06-06 | 王先来 | Method and system for realizing on-line video-frequency conference |
| CN101287094A (en) * | 2007-04-09 | 2008-10-15 | 中国移动通信集团公司 | Method and system for implementing media operation of multimedia meetings |
| CN101867586A (en) * | 2010-06-29 | 2010-10-20 | 中兴通讯股份有限公司 | Method and system for realizing cross network segment signaling interworking of videoconference system |
| CN203206277U (en) * | 2013-04-29 | 2013-09-18 | 熔点网讯(北京)科技有限公司 | Gateway used for video conferences |
| CN103841360A (en) * | 2013-12-11 | 2014-06-04 | 三亚中兴软件有限责任公司 | Distributed video conference achieving method and system, video conference terminal and audio and video integrated device |
Non-Patent Citations (1)
| Title |
|---|
| 基于SIP视频会议系统设计;沈甜甜;《电脑编程技巧与维护》;20130218(第4期);第53-54页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111083427A (en) | 2020-04-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3562163B1 (en) | Audio-video synthesis method and system | |
| JP5345081B2 (en) | Method and system for conducting resident meetings | |
| US8760485B2 (en) | System and method for displaying participants in a videoconference between locations | |
| CN1929593B (en) | Spatially correlated audio in multipoint videoconferencing | |
| US9521366B2 (en) | Method and apparatus for playing conference signal, video conference terminal, and mobile device | |
| CN101198008A (en) | Method and system for implementing multi-screen and multi-picture | |
| CN102025970A (en) | Method and system for automatically adjusting display mode of video conference | |
| US9743043B2 (en) | Method and system for handling content in videoconferencing | |
| CN111083427B (en) | Data processing method of embedded terminal and 4K video conference system | |
| CN108933914B (en) | Method and system for carrying out video conference by using mobile terminal | |
| CN111147362A (en) | Multi-user instant messaging method, system, device and electronic equipment | |
| CN113542660A (en) | Method, system and storage medium for realizing conference multi-picture high-definition display | |
| US9013537B2 (en) | Method, device, and network systems for controlling multiple auxiliary streams | |
| CN102025973A (en) | Video synthesizing method and video synthesizing system | |
| CN108156413B (en) | Video conference transmission method and device and MCU | |
| CN101540871B (en) | Method and terminal for synchronously recording sounds and images of opposite ends based on circuit domain video telephone | |
| CN102082945A (en) | Method for realizing multi-party video calls, video terminal and system | |
| CN112153321B (en) | Conference recording method, device and system | |
| CN105915837B (en) | A kind of video switching method, device and system | |
| RU2617680C1 (en) | Method, device and system for transmitting multimedia data | |
| CN105227895B (en) | Video layout and processing method in MCU (microprogrammed control Unit) stack | |
| CN112839197B (en) | Image code stream processing method, device, system and storage medium | |
| CN112272281B (en) | Regional distributed video conference system | |
| CN110636244A (en) | Video conference server, system, control method and storage medium | |
| CN115499682A (en) | SFU (Small form-factor Unit) architecture-based video communication method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |