CN113259690A - Inter-network system audio and video real-time online collaboration system and method - Google Patents

Inter-network system audio and video real-time online collaboration system and method Download PDF

Info

Publication number
CN113259690A
CN113259690A CN202110755184.2A CN202110755184A CN113259690A CN 113259690 A CN113259690 A CN 113259690A CN 202110755184 A CN202110755184 A CN 202110755184A CN 113259690 A CN113259690 A CN 113259690A
Authority
CN
China
Prior art keywords
audio
video
user terminal
court trial
code stream
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110755184.2A
Other languages
Chinese (zh)
Inventor
许建峰
孙福辉
陈奇伟
徐国泽
唐文博
于佳
刘芳
卢旭明
王盼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Hangxing Video Information Technology Co ltd
People's Court Information Technology Service Center
Original Assignee
Nanjing Hangxing Video Information Technology Co ltd
People's Court Information Technology Service Center
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Hangxing Video Information Technology Co ltd, People's Court Information Technology Service Center filed Critical Nanjing Hangxing Video Information Technology Co ltd
Priority to CN202110755184.2A priority Critical patent/CN113259690A/en
Publication of CN113259690A publication Critical patent/CN113259690A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2181Source of audio or video content, e.g. local disk arrays comprising remotely distributed storage units, e.g. when movies are replicated over a plurality of video servers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/222Secondary servers, e.g. proxy server, cable television Head-end
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2385Channel allocation; Bandwidth allocation

Abstract

The invention provides a cross-network audio and video real-time online collaboration system and a method, wherein the system comprises: the system comprises an audio and video interaction server, audio and video isolation exchange equipment and an audio and video interaction cloud platform; the audio and video interactive server is used for determining and sending court trial audio and video code streams suitable for the user terminal to the audio and video isolation exchange equipment; sending the user audio and video code stream forwarded by the audio and video isolation exchange equipment to the court trial terminal for playing; the audio and video interaction cloud platform is used for determining and sending an encoding and decoding mode to the user terminal according to the user terminal information; sending the user audio and video code stream uploaded by the user terminal to the audio and video isolation switching equipment; and receiving and sending the court trial audio and video code stream which is transmitted by the audio and video isolation exchange equipment and is suitable for the user terminal to the user terminal for playing. The system can support the access of user terminals of various types and models, meet the requirement of large-capacity online user groups, and improve the user experience.

Description

Inter-network system audio and video real-time online collaboration system and method
Technical Field
The present disclosure relates to the field of inter-network system audio/video encoding and decoding, and in particular, to an inter-network system audio/video real-time online collaboration system and method.
Background
With the deepening and perfecting of informatization of the people's court, the auxiliary role of informatization construction on judicial judgment is increasingly prominent. Science and technology make jurisdictions more equitable, transparent, sunny and efficient. In the technological wave around the world, how to improve the level of cooperative court trial services is a key topic in the construction of the current intelligent court, and particularly, the cooperative data sharing and service cooperation among cooperative departments, different courts and different networks are realized. The method specifically comprises the steps of perfecting the cross-department online handling function of criminal cases, and strengthening the cooperative linkage of the businesses such as official complaint resistance, inspection supervision, clue transfer, mandatory measures, criminal penalty execution, legal assistance, entrustment investigation and the like; and the application functions of case transfer, file retrieval, item entrusting and the like of upper and lower courts and courts across jurisdictions, so that real-time transfer and automatic information synchronization on a service line are realized; particularly, the online collaboration and data sharing between the type cases such as road transaction, finance, labor war, known production and the like and external units; the Internet court trial application is improved, and the cross-network court trial capability of a court officer in a private network and people participating in the court trial in the Internet is formed.
The traditional case management mode requires that a judge, a bookmarker and a party are developed in a centralized way in the same time and space, and the working mode occupies a large amount of time and human resources and is limited by regions; for the appearance of inelegance, such as new crown epidemic situation, people are inconvenient to frequently gather together to do litigation matters, and remote division in an online mode gradually appears, in the post epidemic situation, on one hand, people are prevented from gathering to be a normal state, on the other hand, a few cases are treated in the online mode, unnecessary expenses are saved, meanwhile, the case treatment is more efficient and simpler, and the majority of people can accept the online mode, so that the mode of division in the online mode is continuously developed.
If a conventional online multi-party interactive communication mode is adopted, judges, bookwriters and parties all need to be on the internet, although information interaction can be completed, a great deal of work is added in advance and afterwards undoubtedly by case information synchronization, court trial video guide-back and the like, and the mode causes workload increase and time waste.
In the prior art, the court trial business cooperative processing is mainly realized by the following modes:
1) the SVC technology realizes video collaboration, and the SVC technology encodes a video signal into a layered form, and only transmits and decodes a code stream of a base layer when the bandwidth is insufficient, but the decoded video quality is not high at the moment. When the bandwidth is slowly increased, the code stream of the enhancement layer can be transmitted and decoded to improve the decoding quality of the video.
The layered coding is to divide the video into a plurality of layers of code streams (including a base layer and an enhancement layer) in terms of time, space and quality, and output the multi-layer code streams, where the data of the base layer may enable a decoder to decode the base video content completely and normally, but the video image obtained by the data of the base layer may have a lower frame rate, a lower resolution or a lower quality. When the channel is limited or the channel environment is complex, the decoding end can be ensured to receive the viewable smooth video image. When the channel environment is good or the channel resources are rich, the enhancement layer data can be transmitted to improve the frame rate, or the resolution, or the video quality, and the enhancement layer can be multi-layer coded, which means that the larger the received code rate is, the better the video quality is within the range of the total code rate of the video code stream.
For SVC technology, there are the following drawbacks: for quality classification and spatial classification, roughly 10% more code rate is required for equal quality. The code rate of the temporal hierarchy is improved (actually equivalent to I.P, the expansion of B frame), but for the scene with larger motion intensity, the code rate is increased; for quality classification and spatial classification, the operation amount is increased, and the number of software and hardware encoders is small.
2. The technology is composed of a server and a plurality of terminals, and the SFU does not mix audio and video and directly transmits the audio and video stream to other terminals in a room after receiving the audio and video stream shared by a certain terminal. It is actually an audio-video routing repeater.
The SFU is, for example, a media stream router, receives audio and video streams of a terminal, and forwards the audio and video streams to other terminals as needed. The SFU appears much simpler in structure, just receiving the stream and then forwarding to others.
For the SFU technique, there are the following drawbacks: the participants watch the multi-channel videos at the same time, a lot of troubles are brought to display, rendering and the like of multi-channel video windows, especially, the multi-channel videos are recorded in real-time communication, and the multi-channel streams also bring a lot of playback difficulties.
Disclosure of Invention
The method is used for solving the problems that the existing court trial video recording method is not suitable for cross-network system audio and video real-time online cooperation, and has poor real-time performance, unsmooth communication and limited user access amount.
In order to solve the above technical problem, a first aspect of the present disclosure provides an inter-network audio/video real-time online collaboration system, including: the system comprises an audio and video interaction server, audio and video isolation exchange equipment and an audio and video interaction cloud platform;
the audio and video interactive server is connected with the court trial host and is used for determining and sending the court trial audio and video code stream suitable for the user terminal to the audio and video isolation exchange equipment according to the user terminal information and the court trial audio and video code stream uploaded by the court trial host; sending the user audio and video code stream forwarded by the audio and video isolation switching equipment to a court trial terminal for playing;
the audio and video isolation exchange equipment is connected with the audio and video interaction server and the audio and video interaction cloud platform and is used for establishing a safety channel for real-time data exchange between the audio and video interaction server and the audio and video interaction cloud platform;
the audio and video interaction cloud platform is connected with a user terminal and used for determining and sending an encoding and decoding mode to the user terminal according to the user terminal information; sending the user audio and video code stream uploaded by the user terminal to the audio and video isolation switching equipment; and receiving and sending the court trial audio and video code stream which is forwarded by the audio and video isolation switching equipment and is suitable for the user terminal to the user terminal for playing.
In a further embodiment herein, the audio-video interaction cloud platform comprises: and the cloud service nodes are respectively deployed in different areas and used for accessing the user terminals in the different areas.
In a further embodiment of this document, the determining, by the audio/video interaction server, a court trial audio/video code stream applicable to the user terminal according to the user terminal information and the court trial audio/video code uploaded by the court trial host includes:
if the court trial audio/video code stream uploaded by the court trial host comprises a plurality of layers of code streams, matching the court trial audio/video code stream suitable for the user terminal from the court trial audio/video code stream uploaded by the court trial host according to the information of the user terminal;
if the court trial audio/video code stream uploaded by the court trial host only comprises a code stream with one resolution, determining whether code reduction processing is needed or not according to the information of the user terminal, if so, sending the court trial audio/video code stream uploaded by the court trial host to an audio/video GPU processing server for code reduction processing, and taking the court trial audio/video code stream subjected to the code reduction processing as the court trial audio/video code stream suitable for the user terminal.
In a further embodiment of this document, the determining and sending, by the audio/video interaction cloud platform, the encoding mode to the user terminal according to the user terminal information includes:
determining the audio and video processing capability of the user terminal according to the user terminal information;
judging whether the audio and video processing capability of the user terminal meets the preset soft-editing requirement or not;
if the audio and video processing capability of the user terminal meets the preset soft coding requirement, determining that the coding and decoding mode is an SVC layered coding and decoding mode, and sending the SVC layered coding and decoding mode to the user terminal;
and if the audio and video processing capability of the user terminal does not meet the preset soft coding requirement, determining that the coding and decoding mode is a hardware double coding and decoding mode, and sending the hardware double coding and decoding mode to the user terminal.
In a further embodiment of this document, after determining and sending an encoding and decoding manner according to the user terminal information, the audio/video interaction cloud platform further includes:
acquiring network transmission capability of a user terminal;
judging whether the network transmission capability of the user terminal meets the real-time transmission requirement or not;
if the network transmission capability of the user terminal does not meet the real-time transmission requirement, sending a self-adaptive processing mode to the user terminal; the self-adaptive processing mode comprises the step of processing at least one of code stream, quality and frame rate of the user audio and video code stream.
In a further embodiment of this document, the cross-network audio/video real-time online collaboration system further includes:
and the audio and video GPU processing server is connected with the audio and video interaction server and is used for converging the court trial audio and video code stream and the user audio and video code stream, synthesizing pictures, storing the processed code stream and sending the processed code stream to a court trial live broadcast system for playing.
A second aspect of the present disclosure provides an inter-network audio/video real-time online collaboration method, including:
receiving user terminal information uploaded by a user terminal and court trial audio and video code streams uploaded by a court trial host;
determining and sending court trial audio and video code streams suitable for the user terminal according to the user terminal information and the court trial audio and video code streams uploaded by the court trial host;
receiving a user audio and video code stream uploaded by a user terminal;
and sending the user audio and video code stream to a court trial terminal for playing.
A third aspect of the present disclosure provides an inter-network audio/video real-time online collaboration method, including:
determining and sending an encoding and decoding mode to the user terminal according to the user terminal information;
sending the user audio and video code stream uploaded by the user terminal to an audio and video interaction server;
receiving court trial audio and video code streams which are sent by the audio and video interaction server and are suitable for the user terminal;
and sending the court trial audio and video code stream suitable for the user terminal to the user terminal for playing.
A fourth aspect of the present document provides an audio-visual interaction server, comprising:
the first court trial audio and video processing module is used for receiving the user terminal information uploaded by the user terminal and the court trial audio and video code stream uploaded by the court trial host; determining and sending court trial audio and video code streams suitable for the user terminal according to the user terminal information and the court trial audio and video code streams uploaded by the court trial host;
the first user audio and video processing module is used for receiving a user audio and video code stream uploaded by a user terminal; and sending the user audio and video code stream to a court trial terminal for playing.
A fifth aspect of the present disclosure provides an audio-video interactive cloud platform, including:
the second user audio and video processing module is used for determining and sending an encoding and decoding mode to the user terminal according to the user terminal information; receiving and transmitting a user audio and video code stream uploaded by the user terminal;
the second court trial audio and video processing module is used for receiving court trial audio and video code streams which are sent by the audio and video interaction server and are suitable for the user terminal; and sending the court trial audio and video code stream suitable for the user terminal to the user terminal for playing.
A sixth aspect of the present document provides a computer device comprising a memory, a processor, and a computer program stored on the memory, the computer program, when executed by the processor, performing the instructions of the method of any of the preceding embodiments.
A seventh aspect of the present disclosure provides a computer storage medium having a computer program stored thereon, the computer program being executed by a processor of a computer device to perform the instructions of the method of any of the preceding embodiments.
The inter-network system audio and video real-time online collaboration system and the method thereof determine court trial audio and video code streams suitable for the user terminal according to user terminal information and court trial audio and video code streams uploaded by a court trial host, transmit the court trial audio and video code streams suitable for the user terminal to an audio and video interaction platform through audio and video isolation exchange equipment, and forward the court trial audio and video code streams suitable for the user terminal to the user terminal through the audio and video interaction platform, can reduce broadband occupation from a court special network to the Internet, enable the system to support larger-capacity data bearing and various types and types of user terminal access, meet online large-capacity user groups, and enable off-line case handling to be possible. The encoding and decoding mode is determined and sent to the user terminal through the audio and video interaction cloud platform according to the user terminal information, so that the user terminal can use the optimal encoding and decoding mode, and the experience of the user terminal is improved.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the embodiments or technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 shows a first structural diagram of an audio-video real-time online collaboration system across a network system according to an embodiment of the present disclosure;
fig. 2 shows a first flowchart of a user terminal capability detection process of embodiments herein;
fig. 3 shows a second flowchart of a user terminal capability detection process of embodiments herein;
fig. 4 shows a second structure diagram of the inter-network audio and video real-time online collaboration system according to the embodiment of the present disclosure;
FIG. 5 is a third architectural diagram illustrating an audio-video real-time online collaboration system across a network system according to an embodiment of the disclosure;
fig. 6 shows a flowchart of a cross-network audio and video real-time online collaboration method on the court private network side according to the embodiment of the present disclosure;
fig. 7 shows a flowchart of an inter-network audio and video real-time online collaboration method on the internet side according to an embodiment of the present disclosure;
fig. 8 shows a block diagram of an audio-video interaction server according to an embodiment of the present disclosure;
fig. 9 shows a block diagram of an audio-video interaction cloud platform according to an embodiment of the present disclosure;
fig. 10 shows an interaction flowchart of an audio-video real-time online collaboration system across network systems according to an embodiment of the present disclosure;
FIG. 11 shows a block diagram of a computer device herein.
Description of the symbols of the drawings:
110. an audio and video interaction server;
120. audio and video isolation switching equipment;
130. an audio and video interaction cloud platform;
140. an audio and video GPU processing server;
150. a trial service server;
160. a mobile terminal server;
210. a court trial host;
220. a court trial terminal;
230. a user terminal;
810. a first court trial audio/video processing module;
820. a first user audio and video processing module;
910. a second user audio and video processing module;
920. a second court trial audio/video processing module;
1102. a computer device;
1104. a processor;
1106. a memory;
1108. a drive mechanism;
1110. an input/output module;
1112. an input device;
1114. an output device;
1116. a presentation device;
1118. a graphical user interface;
1120. a network interface;
1122. a communication link;
1124. a communication bus.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments herein without making any creative effort, shall fall within the scope of protection.
The present specification provides method steps as described in the examples or flowcharts, but may include more or fewer steps based on routine or non-inventive labor. The order of steps recited in the embodiments is merely one manner of performing the steps in a multitude of orders and does not represent the only order of execution. When an actual system or apparatus product executes, it can execute sequentially or in parallel according to the method shown in the embodiment or the figures.
The court trial video recording method in the prior art is not suitable for cross-network audio and video real-time online collaboration and has the problems of poor real-time performance, unsmooth communication and limited user access. In order to solve the technical problems, in an embodiment herein, as shown in fig. 1, there is provided a cross-network audio and video real-time online collaboration system, including: the system comprises an audio and video interaction server 110, an audio and video isolation exchange device 120 and an audio and video interaction cloud platform 130;
the audio/video interactive server 110 is connected to the court trial host 210, and is configured to determine and send a court trial audio/video code stream applicable to the user terminal to the audio/video isolation switching device 120 according to the user terminal information and the court trial audio/video code stream uploaded by the court trial host 210; sending the user audio and video code stream forwarded by the audio and video isolation switching device 120 to the court trial terminal 220 for playing;
the audio/video isolation switching device 120 is connected to the audio/video interaction server 110 and the audio/video interaction cloud platform 130, and is configured to establish a secure channel for real-time data exchange between the audio/video interaction server 110 and the audio/video interaction cloud platform 130;
the audio and video interaction cloud platform 130 is connected to the user terminal 230, and is used for determining and sending an encoding and decoding mode to the user terminal 230 according to the user terminal information; sending the user audio/video code stream uploaded by the user terminal to the audio/video isolation switching device 120; and receiving and sending the court trial audio and video code stream suitable for the user terminal forwarded by the audio and video isolation switching device 120 to the user terminal 230 for playing. Specifically, the audio/video interactive cloud platform 130 is further configured to send the user audio/video code stream uploaded by any user terminal accessing the same court trial to other user terminals for playing, for example, forward the original reporting audio/video code stream to the notified terminal, forward the notified audio/video code stream to the original reporting terminal, and the like.
In the embodiment, the audio and video interactive server is configured to determine the court trial audio and video code stream suitable for the user terminal according to the user terminal information and the court trial audio and video code stream uploaded by the court trial host, the court trial audio and video code stream suitable for the user terminal is transmitted to the audio and video interactive platform through the audio and video isolation exchange device, and the audio and video interactive platform forwards the court trial audio and video code stream suitable for the user terminal to the user terminal, so that the broadband occupation from a private network to the internet can be reduced, the system can support data bearing with larger capacity and user terminal access of various types and models, and the online user group with large capacity is satisfied. The encoding and decoding mode is determined and sent to the user terminal through the audio and video interaction cloud platform according to the user terminal information, so that the user terminal can use the optimal encoding and decoding mode, and the experience of the user terminal is improved.
In detail, the court trial host 210 described herein is an existing audio and video acquisition and sound amplification device in a court. The court trial terminal 220 is a device used by a judge and a bookclerk, such as a laptop, a desktop, or other existing devices. The user terminal 230 is a mobile terminal used by a party (including a grandfather, a defendant, a attorney, etc.), including but not limited to various brands and models of smart phones, PADs, desktop computers, notebook computers, etc., as long as the device can access the internet to communicate, and all of the devices are the mobile terminals described herein. The user terminal 230 is pre-installed with a client (i.e., APP) accessing to the court private network, and the client can be used to realize interconnection with the court private network and playing of each court trial video.
The audio/video interactive server 110 is a high-definition streaming media interactive server, is deployed in a court special network, can be accessed to the existing court trial host 210 in a court, realizes access of court trial audio/video code streams, and determines court trial audio/video code streams suitable for the user terminals according to user terminal information and the court trial audio/video code streams uploaded by the court trial host 210. Specifically, when the user terminal logs in the court trial private network, the audio/video interaction cloud platform 130 collects the user terminal information from the user terminal 230, and forwards the user terminal information to the audio/video interaction server 110 through the audio/video isolation exchange device 120. The audio/video interactive server 110 determines that the court trial audio/video code stream suitable for the user terminal is implemented according to the user terminal information and the court trial audio/video code stream uploaded by the court trial host 210, and the implementation method includes the following two implementation modes:
the first method comprises the following steps: if the court trial audio/video code stream uploaded by the court trial host comprises a plurality of layers of code streams, matching the court trial audio/video code stream suitable for the user terminal from the court trial audio/video code stream uploaded by the court trial host according to the information of the user terminal;
in detail, the user terminal information at least includes: user terminal brand name, model, processor information, camera capabilities, screen size, etc. Before the implementation of the scheme, the user terminal can be classified according to the number of layers and user terminal information of the court trial audio and video code stream uploaded by the court trial host, the corresponding relation between the user terminal grade and the court trial audio and video code streams of different layers is established, when the court trial audio and video code stream suitable for the user terminal is matched, the grade of the user terminal is determined according to the user terminal information, the court trial audio and video code stream of the layer to which the user terminal belongs is determined according to the grade of the user terminal and the corresponding relation between the grade of the user terminal and the court trial audio and video code streams of different layers, and the determined court trial audio and video code stream is the court trial audio and video code stream suitable for the user terminal. In an implementation, in order to balance the transmission efficiency and the user experience, the number of the user terminals in the hierarchy is limited, for example, to 2.
The multi-layer code stream includes, for example, a base layer and an enhancement layer, where data of the base layer may enable a decoder to decode the base video content completely normally, but video images obtained by data of the base layer may have a lower frame rate, a lower resolution, or a lower quality. And the enhancement layer is a normal code stream and enhances layer data so as to improve the frame rate, or the resolution, or the video quality.
And secondly, if the court trial audio/video code stream uploaded by the court trial host only comprises a code stream with one resolution, determining whether code reduction processing is needed or not (namely, judging whether the code stream uploaded by the court trial host can be processed by the user terminal or not) according to the information of the user terminal, if so, sending the court trial audio/video code stream uploaded by the court trial host to an audio/video GPU processing server for code reduction processing, and taking the court trial audio/video code stream subjected to the code reduction processing as the court trial audio/video code stream suitable for the user terminal. The audio and video GPU processing server is a device deployed in a court private network and used for performing processing such as code reduction and picture synthesis on code streams. The method can be summarized as a mode of fusing layered coding and decoding, can perform layered code reduction on court trial audio and video code streams, and improves user experience.
The two methods can be implemented according to actual requirements, and the method is not limited in the text.
The audio/video isolation switching device 120 described herein includes: protocol conversion equipment and optical gate safety isolation switching equipment. The protocol conversion equipment is used for realizing the protocol conversion of the audio and video interaction server and the audio and video interaction cloud platform for sending the audio and video. And the optical gate safety isolation switching equipment is used for safety isolation between the audio and video isolation switching equipment and the audio and video interaction cloud platform.
The audio/video interactive cloud platform 130 described herein is deployed at the internet end, and may adopt a direct-current SFU architecture to implement access of an internet end user audio/video code stream, forward a court trial audio/video code stream suitable for a user terminal to the user terminal 230, and forward the user audio/video code stream to the audio/video isolation switching device 120. The audio/video interaction cloud platform 130 is further configured to analyze and determine a coding mode of the user terminal according to the audio/video processing capability of the user terminal, and specifically, as shown in fig. 2, includes:
step 210, determining the audio and video processing capability of the user terminal according to the user terminal information;
step 220, judging whether the audio and video processing capability of the user terminal meets the preset soft-editing requirement;
if the audio/video processing capability of the user terminal meets the preset soft-coding requirement, executing step 230; if the audio/video processing capability of the user terminal does not meet the predetermined soft-coding requirement, executing step 240;
step 230, determining the coding and decoding mode as an SVC (scaled Video coding) layered coding and decoding mode, and sending the SVC layered coding and decoding mode to the user terminal;
and 240, determining that the coding and decoding mode is a hardware double coding and decoding mode, and sending the hardware double coding and decoding mode to the user terminal.
In detail, the audio and video processing capability of the user terminal can be embodied by parameters of the user terminal such as camera performance, screen size, CPU, GPU and memory. And automatically selecting 720P and 480P resolutions according to the coding capability of the camera, carrying out dual-code stream coding, and automatically reducing the resolution to try again if the CPU or GPU utilization rate is greater than a set threshold value. And during decoding, automatically selecting the optimal video resolution according to the screen size of the terminal, and if the CPU or GPU utilization rate is greater than a set threshold, automatically reducing the resolution and retrying. SVC is a technology capable of dividing a video stream into a plurality of resolution, quality and frame rate layers, and is an extension of the h.264 video codec standard adopted by most of the video conference equipment today, and its specific coding algorithm can refer to the prior art, which is not limited in this document.
The hardware coding mode can carry out coding with two different resolutions on the video collected by the user terminal, thereby meeting the requirements of the remote user on different video qualities; and playing one of the video code streams which are not collected by the terminal by adopting a hardware decoding mode according to the hardware decoding performance and the screen size.
According to the embodiment, the optimal encoding and decoding mode of the user terminal is determined by judging the audio and video processing capacity of the user terminal through the audio and video interaction cloud platform 130, so that various terminals can obtain optimal experience, the delay loss caused by secondary encoding and decoding is avoided, a large number of users can be supported, and the experience of the user terminal is improved.
In a further embodiment, in order to enable the user terminal to perform remote real-time communication in any network and reduce unsmooth communication in the trial process, after the audio/video interaction cloud platform determines and sends the encoding and decoding mode according to the user terminal information, as shown in fig. 3, the method further includes:
step 250, acquiring the network transmission capability of the user terminal according to a predetermined plan;
step 260, judging whether the network transmission capability of the user terminal meets the real-time transmission requirement;
if the network transmission capability of the user terminal does not meet the real-time transmission requirement, sending a self-adaptive processing mode to the user terminal; the self-adaptive processing mode comprises the step of processing at least one of code stream, quality and frame rate of the user audio and video code stream.
The predetermined plan may be set according to actual requirements, for example, at regular or non-regular intervals, and specific values thereof are not limited herein.
The network transmission capability of the user terminal can be represented by a network transmission speed (bit rate, bps), and is divided into an uplink transmission speed (push stream) and a downlink transmission speed (pull stream) according to a data transmission direction.
In specific implementation, whether real-time transmission requirements are met can be determined according to the network transmission capability of the user terminal and the size of the audio and video code stream of the user.
According to the embodiment, the transmission efficiency of the audio and video code stream of the user can be improved, the fluency in the interaction process is ensured, and the user experience is improved.
In an embodiment of this document, in order to be able to access user terminals distributed in various regions, an audio-video interactive cloud platform includes: and the cloud service nodes are respectively deployed in different areas and used for accessing the user terminals in the different areas. The cloud server nodes are devices such as desktop computers, notebook computers and servers. The user terminal can use a terminal camera or a camera mutually connected with the user terminal to acquire the audio and video code stream of the user.
When the cloud service node is deployed, the cloud service node may be deployed according to a region division manner, for example, one cloud service node is deployed in each city or in several cities, and the specific deployment manner of the cloud service node is not limited herein.
In an embodiment herein, as shown in fig. 4, the cross-network audio/video real-time online collaboration system further includes:
and the audio and video GPU processing server 140 is connected with the audio and video interaction server 110 and is used for carrying out convergence and picture synthesis processing on the court trial audio and video code stream and the user audio and video code stream, storing the processed code stream and sending the processed code stream to a court trial live broadcast system for playing.
In detail, the court trial audio/video code stream and the user audio/video code stream are converged and picture synthesis processing is performed, that is, the court trial audio/video code stream and the user audio/video code stream are integrated into a picture to be displayed, for example, the court trial audio/video code stream includes a judge and records an original audio/video code stream, the user audio/video code stream includes an original reporting audio/video code stream and a reported audio/video code stream, after being processed by the audio/video GPU processing server 140, the four code streams can be synthesized into a picture, and the representation form of the picture is, for example, an upper row layout, a lower row layout, a horizontal layout, a one-large-three-small picture layout, and the like. In specific implementation, the synthesized picture needs to be stored to realize court trial video recording, and the recorded audio and video is better, real and effective by adopting the visual angle of a simulated judge role and the realization mode of data mirroring in the specific video recording process.
The court trial live broadcast system is a live broadcast system connected with the Internet, and people who commonly participate in the court trial can watch the court trial live broadcast system by logging in the court trial live broadcast system.
In an embodiment of this document, in order to support the exchange of service data (word, excel, pdf, and other files), as shown in fig. 5, the cross-network audio/video real-time online collaboration system further includes a trial service server 150 and a mobile terminal server 160. The trial service server 150 has a trial service system installed therein, and the mobile terminal server 160 has a mobile service system installed therein. When the user needs to upload the service data, the user sends the service data to the mobile service system through the user terminal 230, the mobile service system sends the service data to the trial service system through the data isolation exchange device, and the trial terminal can see the service data by logging in the trial service system. The process of obtaining the trial service data by the user terminal is similar, and the data exchange direction is opposite.
In an embodiment of this document, there is further provided a cross-network system real-time online audio/video collaboration method applicable to a court private network side, as shown in fig. 6, including:
step 610, receiving user terminal information uploaded by a user terminal and a court trial audio and video code stream uploaded by a court trial host;
step 620, determining and sending court trial audio and video code streams suitable for the user terminal according to the user terminal information and the court trial audio and video code streams uploaded by the court trial host;
step 630, receiving a user audio and video code stream uploaded by a user terminal;
and step 640, sending the user audio and video code stream to a court trial terminal for playing.
In detail, the above steps are not used to limit the execution steps of the method, and in the specific implementation, the process of receiving and sending the court trial audio and video code stream is performed synchronously with the process of receiving and sending the user audio and video code stream.
In an embodiment of this document, there is further provided a cross-network system real-time online audio/video collaboration method applicable to an internet side, as shown in fig. 7, including:
step 710, determining and sending an encoding and decoding mode to the user terminal according to the user terminal information;
step 720, sending the user audio and video code stream uploaded by the user terminal to an audio and video interaction server;
step 730, receiving a court trial audio and video code stream sent by an audio and video interaction server and suitable for a user terminal;
and step 740, sending the court trial audio and video code stream suitable for the user terminal to the user terminal for playing.
In an embodiment of this document, there is further provided an audio-video interaction server, as shown in fig. 8, including:
the first court trial audio and video processing module 810 is used for receiving the user terminal information uploaded by the user terminal and the court trial audio and video code stream uploaded by the court trial host; determining and sending court trial audio and video code streams suitable for the user terminal according to the user terminal information and the court trial audio and video code streams uploaded by the court trial host;
the first user audio and video processing module 820 is used for receiving a user audio and video code stream uploaded by a user terminal; and sending the user audio and video code stream to a court trial terminal for playing.
In an embodiment of this document, an audio-video interactive cloud platform is further provided, as shown in fig. 9, including:
the second user audio and video processing module 910 is configured to determine and send an encoding and decoding manner to the user terminal according to the user terminal information; sending the user audio and video code stream uploaded by the user terminal to audio and video isolation switching equipment;
the second court trial audio and video processing module 920 is used for receiving the court trial audio and video code stream sent by the audio and video interaction server and suitable for the user terminal; and sending the court trial audio and video code stream suitable for the user terminal to the user terminal for playing.
The court trial audio and video code stream suitable for the user terminal is determined by configuring the audio and video interaction server according to the user terminal information and the court trial audio and video code stream uploaded by the court trial host, the court trial audio and video code stream suitable for the user terminal is transmitted to the audio and video interaction platform through the audio and video isolation exchange equipment, and the court trial audio and video code stream suitable for the user terminal is transmitted to the user terminal through the audio and video interaction platform, so that the broadband occupation from a private network to the internet can be reduced, the system can support larger-capacity data bearing and various types and models of user terminal access, the online large-capacity user group is met, and the remote online case handling becomes possible. The encoding and decoding mode is determined and sent to the user terminal through the audio and video interaction cloud platform according to the user terminal information, so that the user terminal can use the optimal encoding and decoding mode, and the experience of the user terminal is improved.
In order to more clearly illustrate the technical solution herein, a specific embodiment is described in detail below, and as shown in fig. 10, an implementation process of the cross-network audio/video real-time online collaboration system includes:
1001, a user terminal logs in an audio and video interactive cloud platform and sends user terminal information to the audio and video interactive cloud platform;
step 1002, the audio and video interaction cloud platform sends user terminal information to an audio and video isolation exchange device, and determines the audio and video processing capacity of a user terminal according to the user terminal information;
and judging whether the audio and video processing capability of the user terminal meets the preset soft coding requirement, and sending a corresponding coding and decoding mode to the user terminal according to the judgment result. Specifically, if the audio and video processing capability of the user terminal meets the preset soft coding requirement, determining that the coding and decoding mode is an SVC layered coding and decoding mode, and sending the SVC layered coding and decoding mode to the user terminal; and if the audio and video processing capability of the user terminal does not meet the preset soft coding requirement, determining that the coding and decoding mode is a hardware double coding and decoding mode, and sending the hardware double coding and decoding mode to the user terminal.
Step 1003, the audio and video isolation exchange equipment carries out protocol conversion and other processing on the user terminal information and then sends the user terminal information to the audio and video interaction server;
step 1004, the user terminal encodes the user audio and video according to the encoding and decoding mode of the user terminal to obtain a user audio and video code stream, and sends the user audio and video code stream to an audio and video interaction cloud platform;
step 1005, the audio and video interaction cloud platform also regularly acquires the network transmission capability of the user terminal and judges whether the network transmission capability of the user terminal meets the real-time transmission requirement; if the network transmission capability of the user terminal does not meet the real-time transmission requirement, sending a self-adaptive processing mode to the user terminal so that the user terminal can perform self-adaptive processing on the user audio and video code stream;
step 1006, the audio/video interactive platform sends the user audio/video code stream to the audio/video isolation switching device;
step 1007, the audio and video isolation exchange device performs protocol conversion and other processing on the user audio and video code stream and sends the processed user audio and video code stream to the audio and video interaction server;
step 1008, the audio/video interaction server sends the user audio/video code stream to a court trial terminal for playing;
step 1009, the audio and video interactive server receives the court trial audio and video code stream uploaded by the court trial host, determines whether code reduction processing is needed according to the user terminal information, and if so, sends the court trial audio and video code stream uploaded by the court trial host to the audio and video GPU processing server for code reduction processing; matching court trial audio and video code streams suitable for the user terminal from the original court trial audio and video code streams and the code-reduced court trial audio and video code streams according to the information of the user terminal, and sending the court trial audio and video code streams suitable for the user terminal to audio and video isolation exchange equipment;
step 1010, the audio and video isolation exchange equipment carries out protocol conversion and other processing on the received court trial audio and video code stream and then sends the court trial audio and video code stream to an audio and video interaction cloud platform;
step 1011, the audio and video interactive cloud platform distributes the received court trial audio and video code stream according to the user terminal information.
The steps of the process are not used for limiting the execution sequence of each step, and the receiving and sending processes of the trial audio and video code stream and the receiving and sending processes of the user audio and video code stream are synchronously carried out.
The cross-network audio and video real-time online collaboration system and the method have the following advantages:
1) the scene of mixing online, offline and online and offline is supported, the comprehensiveness is achieved, the original court-opening mode of a judge is not changed, and the learning cost of a system is almost zero;
2) the audio and video interaction cloud platform determines the coding and decoding modes (which can be called as a classification selection algorithm) of the user terminal according to the information of the user terminal, so that different user terminals can preferentially select the optimal coding and decoding mode, and the experience of the user terminal is improved;
3) the audio and video interactive server determines the court trial audio and video code stream (namely, the fusion layered coding technology) suitable for the user terminal according to the user terminal information and the court trial audio and video code stream uploaded by the court trial host, so that the bandwidth occupation from a private network to the Internet can be reduced, and the system can support data bearing with larger capacity and users with larger quantity;
4) the structure is clear, the function is centralized, no additional hardware is needed for protocol conversion, all protocol conversion is completed through a software platform, and thus the overall interaction time delay of the system is the lowest.
The audio-visual interactive cloud platform described herein may be a computer device, and as shown in fig. 11, computer device 1102 may include one or more processors 1104, such as one or more Central Processing Units (CPUs), each of which may implement one or more hardware threads. The computer device 1102 may also include any memory 1106 for storing any kind of information, such as code, settings, data, etc. For example, and without limitation, memory 1106 may include any one or more of the following in combination: any type of RAM, any type of ROM, flash memory devices, hard disks, optical disks, etc. More generally, any memory may use any technology to store information. Further, any memory may provide volatile or non-volatile retention of information. Further, any memory may represent fixed or removable components of computer device 1102. In one case, when the processor 1104 executes the associated instructions, which are stored in any memory or combination of memories, the computer device 1102 can perform any of the operations of the associated instructions. The computer device 1102 also includes one or more drive mechanisms 1108, such as a hard disk drive mechanism, an optical disk drive mechanism, etc., for interacting with any memory.
Computer device 1102 may also include an input/output module 1110 (I/O) for receiving various inputs (via input device 1112) and for providing various outputs (via output device 1114). One particular output mechanism may include a presentation device 1116 and an associated graphical user interface 1118 (GUI). In other embodiments, input/output module 1110 (I/O), input device 1112, and output device 1114 may also be excluded, as only one computer device in a network. Computer device 1102 can also include one or more network interfaces 1120 for exchanging data with other devices via one or more communication links 1122. One or more communication buses 1124 couple the above-described components together.
Communication link 1122 may be implemented in any manner, e.g., via a local area network, a wide area network (e.g., the Internet), a point-to-point connection, etc., or any combination thereof. Communications link 1122 may include any combination of hardwired links, wireless links, routers, gateway functions, name servers, etc., governed by any protocol or combination of protocols.
Corresponding to the methods in fig. 6-7, the embodiments herein also provide a computer-readable storage medium having stored thereon a computer program, which, when executed by a processor, performs the steps of the above-described method.
Embodiments herein also provide computer readable instructions, wherein when executed by a processor, a program thereof causes the processor to perform the method as shown in fig. 6-7.
It should be understood that, in various embodiments herein, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments herein.
It should also be understood that, in the embodiments herein, the term "and/or" is only one kind of association relation describing an associated object, meaning that three kinds of relations may exist. For example, a and/or B, may represent: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the examples described in connection with the embodiments disclosed herein may be embodied in electronic hardware, computer software, or combinations of both, and that the components and steps of the examples have been described in a functional general in the foregoing description for the purpose of illustrating clearly the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided herein, it should be understood that the disclosed system, apparatus, and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may also be an electric, mechanical or other form of connection.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purposes of the embodiments herein.
In addition, functional units in the embodiments herein may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present invention may be implemented in a form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The principles and embodiments of this document are explained herein using specific examples, which are presented only to aid in understanding the methods and their core concepts; meanwhile, for the general technical personnel in the field, according to the idea of this document, there may be changes in the concrete implementation and the application scope, in summary, this description should not be understood as the limitation of this document.

Claims (12)

1. An inter-network system audio and video real-time online collaboration system is characterized by comprising: the system comprises an audio and video interaction server, audio and video isolation exchange equipment and an audio and video interaction cloud platform;
the audio and video interactive server is connected with the court trial host and is used for determining and sending the court trial audio and video code stream suitable for the user terminal to the audio and video isolation exchange equipment according to the user terminal information and the court trial audio and video code stream uploaded by the court trial host; sending the user audio and video code stream forwarded by the audio and video isolation switching equipment to a court trial terminal for playing;
the audio and video isolation exchange equipment is connected with the audio and video interaction server and the audio and video interaction cloud platform and is used for establishing a safety channel for real-time data exchange between the audio and video interaction server and the audio and video interaction cloud platform;
the audio and video interaction cloud platform is connected with a user terminal and used for determining and sending an encoding and decoding mode to the user terminal according to the user terminal information; sending the user audio and video code stream uploaded by the user terminal to the audio and video isolation switching equipment; and receiving and sending the court trial audio and video code stream which is forwarded by the audio and video isolation switching equipment and is suitable for the user terminal to the user terminal for playing.
2. The system for real-time online collaboration of audio and video over a network as claimed in claim 1, wherein the audio and video interactive cloud platform comprises: and the cloud service nodes are respectively deployed in different areas and used for accessing the user terminals in the different areas.
3. The system of claim 1, wherein the audio-video interactive server determines a court trial audio-video code stream applicable to the user terminal according to the user terminal information and court trial audio-video codes uploaded by the court trial host, and the system comprises:
if the court trial audio/video code stream uploaded by the court trial host comprises a plurality of layers of code streams, matching the court trial audio/video code stream suitable for the user terminal from the court trial audio/video code stream uploaded by the court trial host according to the information of the user terminal;
if the court trial audio/video code stream uploaded by the court trial host only comprises a code stream with one resolution, determining whether code reduction processing is needed or not according to the information of the user terminal, if so, sending the court trial audio/video code stream uploaded by the court trial host to an audio/video GPU processing server for code reduction processing, and taking the court trial audio/video code stream subjected to the code reduction processing as the court trial audio/video code stream suitable for the user terminal.
4. The cross-network system audio-video real-time online collaboration system as claimed in claim 1, wherein the audio-video interactive cloud platform determines and sends a coding mode to the user terminal according to the user terminal information, and the system comprises:
determining the audio and video processing capability of the user terminal according to the user terminal information;
judging whether the audio and video processing capability of the user terminal meets the preset soft-editing requirement or not;
if the audio and video processing capability of the user terminal meets the preset soft coding requirement, determining that the coding and decoding mode is an SVC layered coding and decoding mode, and sending the SVC layered coding and decoding mode to the user terminal;
and if the audio and video processing capability of the user terminal does not meet the preset soft coding requirement, determining that the coding and decoding mode is a hardware double coding and decoding mode, and sending the hardware double coding and decoding mode to the user terminal.
5. The cross-network system audio-video real-time online collaboration system as claimed in claim 4, wherein the audio-video interactive cloud platform determines and sends an encoding and decoding mode according to the user terminal information, and further comprises:
acquiring network transmission capability of a user terminal;
judging whether the network transmission capability of the user terminal meets the real-time transmission requirement or not;
if the network transmission capability of the user terminal does not meet the real-time transmission requirement, sending a self-adaptive processing mode to the user terminal; the self-adaptive processing mode comprises the step of processing at least one of code stream, quality and frame rate of the user audio and video code stream.
6. The system for real-time online collaboration of audio and video over a network as claimed in claim 1 further comprising:
and the audio and video GPU processing server is connected with the audio and video interaction server and is used for converging the court trial audio and video code stream and the user audio and video code stream, synthesizing pictures, storing the processed code stream and sending the processed code stream to a court trial live broadcast system for playing.
7. An inter-network audio and video real-time online collaboration method is characterized by comprising the following steps:
receiving user terminal information uploaded by a user terminal and court trial audio and video code streams uploaded by a court trial host;
determining and sending court trial audio and video code streams suitable for the user terminal according to the user terminal information and the court trial audio and video code streams uploaded by the court trial host;
receiving a user audio and video code stream uploaded by a user terminal;
and sending the user audio and video code stream to a court trial terminal for playing.
8. An inter-network audio and video real-time online collaboration method is characterized by comprising the following steps:
determining and sending an encoding and decoding mode to the user terminal according to the user terminal information;
sending the user audio and video code stream uploaded by the user terminal to an audio and video interaction server;
receiving court trial audio and video code streams which are sent by the audio and video interaction server and are suitable for the user terminal;
and sending the court trial audio and video code stream suitable for the user terminal to the user terminal for playing.
9. An audio-video interaction server, comprising:
the first court trial audio and video processing module is used for receiving the user terminal information uploaded by the user terminal and the court trial audio and video code stream uploaded by the court trial host; determining and sending court trial audio and video code streams suitable for the user terminal according to the user terminal information and the court trial audio and video code streams uploaded by the court trial host;
the first user audio and video processing module is used for receiving a user audio and video code stream uploaded by a user terminal; and sending the user audio and video code stream to a court trial terminal for playing.
10. An audio-video interaction cloud platform, comprising:
the second user audio and video processing module is used for determining and sending an encoding and decoding mode to the user terminal according to the user terminal information; receiving and transmitting a user audio and video code stream uploaded by the user terminal;
the second court trial audio and video processing module is used for receiving court trial audio and video code streams which are sent by the audio and video interaction server and are suitable for the user terminal; and sending the court trial audio and video code stream suitable for the user terminal to the user terminal for playing.
11. A computer device comprising a memory, a processor, and a computer program stored on the memory, wherein the computer program, when executed by the processor, performs the instructions of the method of any one of claims 7-8.
12. A computer storage medium having a computer program stored thereon, the computer program being adapted to perform the instructions of the method of any one of claims 7-8 when the computer program is run by a processor of a computer device.
CN202110755184.2A 2021-07-05 2021-07-05 Inter-network system audio and video real-time online collaboration system and method Pending CN113259690A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110755184.2A CN113259690A (en) 2021-07-05 2021-07-05 Inter-network system audio and video real-time online collaboration system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110755184.2A CN113259690A (en) 2021-07-05 2021-07-05 Inter-network system audio and video real-time online collaboration system and method

Publications (1)

Publication Number Publication Date
CN113259690A true CN113259690A (en) 2021-08-13

Family

ID=77190594

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110755184.2A Pending CN113259690A (en) 2021-07-05 2021-07-05 Inter-network system audio and video real-time online collaboration system and method

Country Status (1)

Country Link
CN (1) CN113259690A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115604420A (en) * 2022-11-29 2023-01-13 共道网络科技有限公司(Cn) System, method, device and computer readable storage medium for court remote court trial

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103270750A (en) * 2010-05-12 2013-08-28 布鲁珍视网络有限公司 Systems and methods for real-ime multimedia communication across multiple standards and proprietary devices
US20140146129A1 (en) * 2011-07-08 2014-05-29 Zte Corporation Telepresence method, terminal and system
CN104093028A (en) * 2014-06-25 2014-10-08 中兴通讯股份有限公司 Device capacity negotiation method and device
CN105979226A (en) * 2016-06-27 2016-09-28 祁磊 Digital trial system for the People's Court
CN106791538A (en) * 2016-12-25 2017-05-31 重庆警蜂科技有限公司 For the digital display circuit of circuit court
CN206977580U (en) * 2017-08-01 2018-02-06 合肥高新技术产业开发区人民法院 A kind of long-range court's trial system in internet
CN207266190U (en) * 2017-09-13 2018-04-20 广东科泽信息科技股份有限公司 One kind digitlization court's trial system
CN108024126A (en) * 2017-11-28 2018-05-11 北京潘达互娱科技有限公司 Network direct broadcasting video regulation method, device, electronic equipment and storage medium
CN109936744A (en) * 2017-12-19 2019-06-25 腾讯科技(深圳)有限公司 Video coding processing method, device and the application with Video coding function
CN111225188A (en) * 2020-01-16 2020-06-02 北京东土科技股份有限公司 Internet remote court trial implementation method
CN111260326A (en) * 2020-01-16 2020-06-09 北京东土科技股份有限公司 Internet remote court trial division method
CN112838979A (en) * 2020-12-28 2021-05-25 北京东土和兴科技有限公司 Case discussion information interaction method and system

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103270750A (en) * 2010-05-12 2013-08-28 布鲁珍视网络有限公司 Systems and methods for real-ime multimedia communication across multiple standards and proprietary devices
US20140146129A1 (en) * 2011-07-08 2014-05-29 Zte Corporation Telepresence method, terminal and system
CN104093028A (en) * 2014-06-25 2014-10-08 中兴通讯股份有限公司 Device capacity negotiation method and device
CN105979226A (en) * 2016-06-27 2016-09-28 祁磊 Digital trial system for the People's Court
CN106791538A (en) * 2016-12-25 2017-05-31 重庆警蜂科技有限公司 For the digital display circuit of circuit court
CN206977580U (en) * 2017-08-01 2018-02-06 合肥高新技术产业开发区人民法院 A kind of long-range court's trial system in internet
CN207266190U (en) * 2017-09-13 2018-04-20 广东科泽信息科技股份有限公司 One kind digitlization court's trial system
CN108024126A (en) * 2017-11-28 2018-05-11 北京潘达互娱科技有限公司 Network direct broadcasting video regulation method, device, electronic equipment and storage medium
CN109936744A (en) * 2017-12-19 2019-06-25 腾讯科技(深圳)有限公司 Video coding processing method, device and the application with Video coding function
CN111225188A (en) * 2020-01-16 2020-06-02 北京东土科技股份有限公司 Internet remote court trial implementation method
CN111260326A (en) * 2020-01-16 2020-06-09 北京东土科技股份有限公司 Internet remote court trial division method
CN112838979A (en) * 2020-12-28 2021-05-25 北京东土和兴科技有限公司 Case discussion information interaction method and system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115604420A (en) * 2022-11-29 2023-01-13 共道网络科技有限公司(Cn) System, method, device and computer readable storage medium for court remote court trial

Similar Documents

Publication Publication Date Title
US11881945B2 (en) Reference picture selection and coding type decision processing based on scene contents
CN109640029B (en) Method and device for displaying video stream on wall
US9661209B2 (en) Remote controlled studio camera system
CN106331581A (en) Method and device for communication between mobile terminal and video networking terminal
CN104580991A (en) System and method for real-time adaptation of a conferencing system to current conditions of a conference session
CN102158690A (en) Remote multichannel real-time video monitoring system
CN103597468A (en) Systems and methods for improved interactive content sharing in video communication systems
CN108462851A (en) The method and mobile terminal of data processing, server, the second mobile terminal
CN103051864A (en) Mobile video conference method and system thereof
CN113259690A (en) Inter-network system audio and video real-time online collaboration system and method
CN101350908A (en) Video data transmission system and method for network video conference
US9729822B2 (en) Method and system for sharing content in videoconferencing
WO2021082479A1 (en) Method and device for adjusting attribute of video stream
KR101085063B1 (en) Group communication method in media server system with distributed structure
CN103716651A (en) Image processing device, image processing method, and image processing system
WO2015000303A1 (en) Method for call processing and gateway
CN113996056A (en) Data sending and receiving method of cloud game and related equipment
CN102427518B (en) On-demand networking video conference system
CN103974027A (en) Multiport-to-multiport real-time communication method and system
US20140137148A1 (en) System for Managing the Streaming and Recording of Audiovisual Data
CN102148909A (en) Method of realizing interactive official conference system
CN115720257B (en) Communication security management method and system for video conference system
TWI531244B (en) Method and system for processing video data of meeting
CN211830976U (en) Video conference platform
Găitanaru Virtual Class (Videoconference)

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210813