CN112565664B - Video conference code stream feedback method, device, equipment and computer readable storage medium - Google Patents

Video conference code stream feedback method, device, equipment and computer readable storage medium Download PDF

Info

Publication number
CN112565664B
CN112565664B CN202011366629.XA CN202011366629A CN112565664B CN 112565664 B CN112565664 B CN 112565664B CN 202011366629 A CN202011366629 A CN 202011366629A CN 112565664 B CN112565664 B CN 112565664B
Authority
CN
China
Prior art keywords
code stream
feedback
feedback message
receiving
code
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011366629.XA
Other languages
Chinese (zh)
Other versions
CN112565664A (en
Inventor
杨阳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Rongxun Technology Co ltd
Original Assignee
Beijing Rongxun Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Rongxun Technology Co ltd filed Critical Beijing Rongxun Technology Co ltd
Priority to CN202011366629.XA priority Critical patent/CN112565664B/en
Publication of CN112565664A publication Critical patent/CN112565664A/en
Application granted granted Critical
Publication of CN112565664B publication Critical patent/CN112565664B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/854Content authoring
    • H04N21/8547Content authoring involving timestamps for synchronizing content

Abstract

The invention discloses a video conference code stream feedback method, a device, equipment and a computer readable storage medium, wherein the video conference code stream feedback method enables code stream feedback information reflecting the data transmission condition to be transmitted to a corresponding participant in an independent channel by opening the independent channel between the participants of a video conference; the two communication parties can timely acquire the actual transmission condition of the code stream of the other party by timely generating and transmitting the code stream feedback information; by updating the sending strategy in time when the code stream receiving is abnormal, the sender of the participant can change the sending strategy in time, so that the current code stream receiving abnormality is eliminated rapidly, the solution efficiency of the code stream receiving problem is improved, the diagnosis and maintenance of a video system are facilitated, and the cost of engineering maintenance is reduced.

Description

Video conference code stream feedback method, device, equipment and computer readable storage medium
Technical Field
The present invention relates to the field of video conferencing technologies, and in particular, to a method, an apparatus, a device, and a computer readable storage medium for video conference code stream feedback.
Background
Pulse code modulation (PCM, pulse Code Modulation) is a technique for converting an analog signal into a digital signal. The European 30-channel pulse code modulation PCM is called E1 for short, and the same E1 standard as that of Europe is adopted in China. As shown in fig. 2, the implementation manner of the E1 private line video conference is as follows: data transmission is carried out through the H.221 frame structure (the H.221 protocol is a sub-protocol of the H.320 protocol), the audio and video code stream is transmitted in an independent channel, and a receiver feeds back whether the receiver performs frame positioning or not to a sender through an A-bit (frame positioning loss indication) value of a frame positioning signal (FAS, frame Aligning Signal) code in the H.221 frame structure. The sender judges whether the receiving code stream of the receiver is normal or not by checking the FAS code frame positioning state in the received H.221 frame data and the A-bit value in the FAS code, and when the FAS frame positioning is normal and the A-bit is 0, the sender considers that the receiving code stream of the receiver is normal.
If the cable has errors, the code stream of the sender is sent in error or the code stream of the receiver is received in error, the quality of the code stream actually received by the receiver is poor, but the sender can misunderstand that the code stream received by the receiver is normal. Under the condition, the sender cannot modify the strategy in time to improve the code stream receiving quality of the receiver, and often needs means such as manual observation to acquire the condition of receiving the code stream by the receiver, and related technicians formulate the strategy according to the actual receiving condition to solve the code stream receiving problem, so that the technical problem of low efficiency of solving the code stream receiving problem in the existing video conference communication process is caused.
Disclosure of Invention
The invention mainly aims to provide a video conference code stream feedback method, which aims to solve the technical problem of low efficiency of solving the code stream receiving problem in the existing video conference communication process.
In order to achieve the above object, the present invention provides a video conference code stream feedback method, which includes:
acquiring a specific signal code in a frame structure, and opening an independent code stream statistical data channel between two communication parties based on the specific signal code;
acquiring a code stream feedback message generated by the two communication parties in the code stream transmission process and transmitted in the code stream statistic data channel;
and updating a code stream sending strategy when the code stream receiving abnormality exists between the two communication parties according to the code stream feedback information.
Optionally, the step of acquiring a code stream feedback message generated by the two communication parties in a code stream transmission process and transmitted on the code stream statistic data channel includes:
and searching and acquiring a sending feedback message generated based on the code stream sending of the participants sending the code streams in the two communication parties from the code stream statistical data channel, and a receiving feedback message generated by the participants receiving the code streams in the code stream receiving mode, so as to take the sending feedback message and the receiving feedback message as the code stream feedback message.
Optionally, before the step of obtaining the code stream feedback message that is generated by the two communication parties in the code stream transmission process and transmitted by the code stream statistic data channel, the method further includes:
counting the coding format, the total number of data packets and the total data amount of the audio and video code stream transmitted by the participant transmitting the code stream at intervals of a preset first time interval to serve as the transmission feedback message;
placing the sending feedback message in the code stream statistical data channel so as to send the sending feedback message to the participant receiving the code stream through the code stream statistical data channel;
counting the decoding format, the maximum value of the packet sequence number, the packet loss rate in unit time and the total packet loss number of the audio and video code stream received by the participant of the received code stream at intervals of a preset second time interval to serve as the received feedback message;
and placing the received feedback message in the code stream statistical data channel so as to send the received feedback message to the participant sending the code stream through the code stream statistical data channel.
Optionally, before the step of updating the code stream sending policy when it is determined that there is a code stream receiving abnormality between the two communication parties according to the code stream feedback message, the method further includes:
Combining the sending feedback message and the receiving feedback message, judging whether the integrity and/or the decodability of the code stream transmitted between the party sending the code stream and the party receiving the code stream are abnormal;
if the integrity and/or the decodability of the code stream transmitted between the party sending the code stream and the party receiving the code stream are abnormal, judging that the code stream receiving is abnormal between the two communication parties.
Optionally, when determining that there is abnormal code stream reception between the two communication parties according to the code stream feedback message, the step of updating the code stream sending policy includes:
when the integrity and/or the decodability of the code stream transmitted between the participant transmitting the code stream and the participant receiving the code stream are abnormal, the transmission data quantity of the participant transmitting the code stream in the two communication parties is reduced and/or the coding format is modified to be used as a new code stream transmission strategy so as to execute the new code stream transmission strategy to exclude the abnormality.
Optionally, the step of acquiring a specific signal code in the frame structure and opening an independent code stream statistic data channel between two communication parties based on the specific signal code includes:
Acquiring BAS codes in an H.221 frame structure, and taking the BAS codes as the specific signal codes;
and opening an independent code stream statistical data channel between a participant transmitting the code stream and a participant receiving the code stream by using the BAS code, wherein the H.221 frame structure is a data transmission basis of a plurality of participants in E1 private line video conferences.
Optionally, after the step of obtaining the code stream feedback message generated by the two communication parties in the code stream transmission process and transmitted by the code stream statistic data channel, the method further includes:
and integrating the code stream feedback information to generate target feedback information, and displaying the target feedback information on a screen so that a user can formulate a target code stream sending strategy based on the target feedback information.
In addition, in order to achieve the above object, the present invention further provides a video conference code stream feedback device, including:
an independent channel opening module, configured to obtain a specific signal code in a frame structure, and open an independent code stream statistical data channel between two communication parties based on the specific signal code;
the feedback message acquisition module is used for acquiring a code stream feedback message which is generated by the two communication parties in the code stream transmission process and transmitted in the code stream statistic data channel;
And the sending strategy updating module is used for updating the code stream sending strategy when the code stream receiving abnormality exists between the two communication parties according to the code stream feedback information.
Optionally, the feedback message acquisition module includes:
and the feedback message searching unit is used for searching and acquiring a sending feedback message generated by sending the code stream based on the participant sending the code stream in the two communication parties from the code stream statistic data channel, and a receiving feedback message generated by receiving the code stream based on the participant receiving the code stream, so that the sending feedback message and the receiving feedback message are used as the code stream feedback messages.
Optionally, the video conference code stream feedback device further includes:
the sending message acquisition module is used for counting the coding format, the total number of data packets and the total data amount of the audio and video code stream sent by the participant of the sending code stream at intervals of a preset first time interval to serve as the sending feedback message;
a sending message sending module, configured to place the sending feedback message on the code stream statistics data channel, so that the sending feedback message is sent to the participant receiving the code stream through the code stream statistics data channel;
The receiving message acquisition module is used for counting the decoding format, the maximum value of the packet sequence number, the packet loss rate in unit time and the total packet loss number of the audio and video code stream received by the participant of the receiving code stream at intervals of a preset second time interval to be used as the receiving feedback message;
and the receiving message sending module is used for placing the receiving feedback message on the code stream statistical data channel so as to send the receiving feedback message to the party sending the code stream through the code stream statistical data channel.
Optionally, the video conference code stream feedback device further includes:
the receiving exception judging module is used for combining the sending feedback message and the receiving feedback message to judge whether the integrity and/or the decodability of the code stream transmitted between the party sending the code stream and the party receiving the code stream are abnormal or not;
and the receiving abnormality judging module is used for judging that the code stream receiving abnormality exists between the two communication parties if the integrity and/or the decodability of the code stream transmitted between the party sending the code stream and the party receiving the code stream exist abnormality.
Optionally, the sending policy updating module includes:
And the sending strategy updating unit is used for reducing the sending data quantity of the participant sending the code stream in the two communication parties and/or modifying the coding format as a new code stream sending strategy when the integrity and/or the decodability of the code stream transmitted between the participant sending the code stream and the participant receiving the code stream are abnormal so as to execute the new code stream sending strategy to eliminate the abnormality.
Optionally, the independent channel opening module includes:
a specific code obtaining unit, configured to obtain a BAS code in an h.221 frame structure, so that the BAS code is used as the specific signal code;
and the independent channel opening unit is used for opening an independent code stream statistical data channel between a participant transmitting the code stream and a participant receiving the code stream by utilizing the BAS code, wherein the H.221 frame structure is a data transmission basis of the E1 private line video conference of a plurality of participants.
Optionally, the video conference code stream feedback device further includes:
and the feedback information display module is used for integrating the code stream feedback information to generate target feedback information, and displaying the target feedback information on a screen so that a user can formulate a target code stream sending strategy based on the target feedback information.
In addition, to achieve the above object, the present invention further provides a video conference code stream feedback device, including: the system comprises a memory, a processor and a video conference code stream feedback program stored on the memory and capable of running on the processor, wherein the video conference code stream feedback program realizes the steps of the method when being executed by the processor.
In addition, in order to achieve the above object, the present invention further provides a computer readable storage medium, on which a video conference code stream feedback program is stored, which when executed by a processor, implements the steps of the method as described above.
The invention provides a video conference code stream feedback method, a video conference code stream feedback device, video conference code stream feedback equipment and a computer readable storage medium. According to the video conference code stream feedback method, the independent channels are opened between the participants of the video conference, so that code stream feedback information reflecting the data transmission condition can be transmitted to the corresponding participant in the independent channels; the two communication parties can timely acquire the actual transmission condition of the code stream of the other party by timely generating and transmitting the code stream feedback information; by updating the sending strategy in time when the code stream receiving is abnormal, the sender of the participant can change the sending strategy in time, so that the current code stream receiving abnormality is eliminated rapidly, the solution efficiency of the code stream receiving problem is improved, the technical problem of low solution efficiency of the code stream receiving problem in the existing video conference communication process is solved, meanwhile, the diagnosis and maintenance of a video system are facilitated, and the cost of engineering maintenance is reduced.
Drawings
Fig. 1 is a schematic structural diagram of a video conference code stream feedback device of a hardware running environment according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a frame structure under the h.221 protocol in the prior art;
fig. 3 is a flowchart of a first embodiment of a video conference code stream feedback method according to the present invention;
fig. 4 is a schematic structural diagram of a video conference system according to an embodiment of the video conference code stream feedback method of the present invention;
fig. 5 is a flow chart of a code stream statistics feedback information transmission according to an embodiment of the video conference code stream feedback method of the present invention;
FIG. 6 is a flowchart illustrating a method for receiving feedback information of a video conference code stream according to an embodiment of the present invention;
fig. 7 is a schematic diagram of a functional module of the video conference code stream feedback device of the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
As shown in fig. 1, fig. 1 is a schematic structural diagram of a video conference code stream feedback device of a hardware running environment according to an embodiment of the present invention.
The video conference code stream feedback equipment of the embodiment of the invention is terminal equipment capable of carrying out video conference.
As shown in fig. 1, the video conference code stream feedback device may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Wherein the communication bus 1002 is used to enable connected communication between these components. Optional user interface 1003 may include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory). The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
It will be appreciated by those skilled in the art that the video conference bitstream feedback device structure shown in fig. 1 does not constitute a limitation on the video conference bitstream feedback device, and may include more or fewer components than shown, or may combine certain components, or may be a different arrangement of components.
As shown in fig. 1, an operating system, a network communication module, a user interface module, and a video conference stream feedback program may be included in a memory 1005 as one type of computer storage medium.
In the video conference code stream feedback device shown in fig. 1, the network interface 1004 is mainly used for connecting to a background server and performing data communication with the background server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be configured to invoke the video conference stream feedback setup program stored in the memory 1005, and perform the following operations:
Acquiring a specific signal code in a frame structure, and opening an independent code stream statistical data channel between two communication parties based on the specific signal code;
acquiring a code stream feedback message generated by the two communication parties in the code stream transmission process and transmitted in the code stream statistic data channel;
and updating a code stream sending strategy when the code stream receiving abnormality exists between the two communication parties according to the code stream feedback information.
Further, the step of obtaining the code stream feedback message generated by the two communication parties in the code stream transmission process and transmitted in the code stream statistic data channel includes:
and searching and acquiring a sending feedback message generated based on the code stream sending of the participants sending the code streams in the two communication parties from the code stream statistical data channel, and a receiving feedback message generated by the participants receiving the code streams in the code stream receiving mode, so as to take the sending feedback message and the receiving feedback message as the code stream feedback message.
Further, before the step of obtaining the stream feedback message generated by the two parties during the stream transmission, the processor 1001 may be configured to invoke the video conference stream feedback setup program stored in the memory 1005, and perform the following operations:
Counting the coding format, the total number of data packets and the total data amount of the audio and video code stream transmitted by the participant transmitting the code stream at intervals of a preset first time interval to serve as the transmission feedback message;
placing the sending feedback message in the code stream statistical data channel so as to send the sending feedback message to the participant receiving the code stream through the code stream statistical data channel;
counting the decoding format, the maximum value of the packet sequence number, the packet loss rate in unit time and the total packet loss number of the audio and video code stream received by the participant of the received code stream at intervals of a preset second time interval to serve as the received feedback message;
and placing the received feedback message in the code stream statistical data channel so as to send the received feedback message to the participant sending the code stream through the code stream statistical data channel.
Further, before the step of updating the code stream transmission policy when it is determined that there is a code stream reception abnormality between the two communication parties according to the code stream feedback message, the processor 1001 may be configured to invoke a video conference code stream feedback setup program stored in the memory 1005, and perform the following operations:
combining the sending feedback message and the receiving feedback message, judging whether the integrity and/or the decodability of the code stream transmitted between the party sending the code stream and the party receiving the code stream are abnormal;
If the integrity and/or the decodability of the code stream transmitted between the party sending the code stream and the party receiving the code stream are abnormal, judging that the code stream receiving is abnormal between the two communication parties.
Further, when it is determined that there is a code stream reception abnormality between the two communication parties according to the code stream feedback message, the step of updating the code stream transmission policy includes:
when the integrity and/or the decodability of the code stream transmitted between the participant transmitting the code stream and the participant receiving the code stream are abnormal, the transmission data quantity of the participant transmitting the code stream in the two communication parties is reduced and/or the coding format is modified to be used as a new code stream transmission strategy so as to execute the new code stream transmission strategy to exclude the abnormality.
Further, the step of obtaining the specific signal code in the frame structure and opening an independent code stream statistic data channel between two communication parties based on the specific signal code comprises the following steps:
acquiring BAS codes in an H.221 frame structure, and taking the BAS codes as the specific signal codes;
and opening an independent code stream statistical data channel between a participant transmitting the code stream and a participant receiving the code stream by using the BAS code, wherein the H.221 frame structure is a data transmission basis of a plurality of participants in E1 private line video conferences.
Further, after the step of obtaining the stream feedback message generated by the two communication parties during the stream transmission process and transmitted by the stream statistics channel, the processor 1001 may be configured to invoke the video conference stream feedback setup program stored in the memory 1005, and perform the following operations:
and integrating the code stream feedback information to generate target feedback information, and displaying the target feedback information on a screen so that a user can formulate a target code stream sending strategy based on the target feedback information.
Based on the above hardware structure, various embodiments of the video conference code stream feedback method of the present invention are provided.
Pulse code modulation (PCM, pulse Code Modulation) is a technique for converting an analog signal into a digital signal. The European 30-channel pulse code modulation PCM is called E1 for short, and the same E1 standard as that of Europe is adopted in China. As shown in fig. 2, the implementation manner of the E1 private line video conference is as follows: data transmission is carried out through the H.221 frame structure (the H.221 protocol is a sub-protocol of the H.320 protocol), the audio and video code stream is transmitted in an independent channel, and a receiver feeds back whether the receiver performs frame positioning or not to a sender through an A-bit (frame positioning loss indication) value of a frame positioning signal (FAS, frame Aligning Signal) code in the H.221 frame structure. The sender judges whether the receiving code stream of the receiver is normal or not by checking the FAS code frame positioning state in the received H.221 frame data and the A-bit value in the FAS code, and when the FAS frame positioning is normal and the A-bit is 0, the sender considers that the receiving code stream of the receiver is normal.
If the cable has errors, the code stream of the sender is sent in error or the code stream of the receiver is received in error, the quality of the code stream actually received by the receiver is poor, but the sender can misunderstand that the code stream received by the receiver is normal. Under the condition, the sender cannot modify the strategy in time to improve the code stream receiving quality of the receiver, and often needs means such as manual observation to acquire the condition of receiving the code stream by the receiver, and related technicians formulate the strategy according to the actual receiving condition to solve the code stream receiving problem, so that the technical problem of low efficiency of solving the code stream receiving problem in the existing video conference communication process is caused.
In order to solve the technical problems, the invention provides a video conference code stream feedback method, namely, by opening an independent channel between participants of a video conference, code stream feedback information reflecting the data transmission condition can be transmitted to the corresponding participant in the independent channel; the two communication parties can timely acquire the actual transmission condition of the code stream of the other party by timely generating and transmitting the code stream feedback information; by updating the sending strategy in time when the code stream receiving is abnormal, the sender of the participant can change the sending strategy in time, so that the current code stream receiving abnormality is eliminated rapidly, the solution efficiency of the code stream receiving problem is improved, the technical problem of low solution efficiency of the code stream receiving problem in the existing video conference communication process is solved, meanwhile, the diagnosis and maintenance of a video system are facilitated, and the cost of engineering maintenance is reduced.
Referring to fig. 2, fig. 2 is a flowchart of a first embodiment of a video conference code stream feedback method.
The first embodiment of the invention provides a video conference code stream feedback method, which comprises the following steps:
step S10, a specific signal code in a frame structure is obtained, and an independent code stream statistical data channel is opened between two communication parties based on the specific signal code;
in this embodiment, the method is applied to a video conference system, hereinafter referred to as a system. A frame structure refers to a frame consisting of several parts performing different functions to facilitate transmission. The frame structure corresponding to different multimedia conferencing standards may be different. For example, the h.221 protocol, which is a sub-protocol of the h.320 protocol, specifies the frame structure of 64k to 1920knps channels in audio-video telecommunication services. The signal codes in the frame structure include a frame alignment mark signal (FAS, frame Aligning Signal) code, a Bit allocation mark (BAS, bit-rate Allocation Signal) code, an encryption control signal (ECS, encryption Control Signal) code, and the like.
The specific signal code refers to one or more signal codes in a frame structure corresponding to a conference standard adopted for video conference data transmission.
The communication parties refer to the participants participating in the video conference for code stream transmission, and the number of the participants participating in the video conference is usually two or more. The same participant can be either a sender or a receiver in the video conference process.
The stream statistics channel refers to a data channel in the frame data, which is used to transmit stream feedback messages.
When the system controls a plurality of terminals to carry out video conferences, a code stream statistical data channel is firstly required to be opened between a sender and a receiver through a specific signal code in a frame structure so as to transmit code stream feedback messages when the sender and the receiver are transmitted based on the channel.
Step S20, obtaining a code stream feedback message generated by both communication parties in the code stream transmission process and transmitted in the code stream statistic data channel;
in this embodiment, the code stream feedback message refers to a data message that can reflect the actual situation of code stream transmission between the sender and the receiver in the video conference process. The code stream feedback message generally includes a sending feedback message and a receiving feedback message of the code stream, and the sending feedback message specifically may include: the coding format of the audio and video sent by the sender in a certain period, the total number of the sent code stream packets, the total data amount and the like; receiving the feedback message may specifically include: the receiving side receives the audio and video decoding format of the code stream in a certain period, the maximum value of the packet serial numbers of the received code stream packets, the packet loss rate in unit time, the total packet loss number and the like.
In the process of video conference of a plurality of participants, each participant can count the relevant statistics data when sending and receiving the code stream at regular time as a code stream feedback message, and the code stream feedback message is transmitted to the other side through a code stream statistics data channel. The system obtains the stream feedback message from the stream statistics channel to analyze it.
And step S30, updating a code stream sending strategy when the code stream receiving abnormality exists between the two communication parties according to the code stream feedback information.
In this embodiment, the abnormal reception of the code stream may include that the code stream data received by the receiving party is not complete, or the received code stream data cannot be resolved, etc.
The size of the data amount of the code stream packet to be transmitted, the coding format of the data, etc. are generally specified by the code stream transmission policy.
The system analyzes the obtained code stream feedback information, and if the analysis result shows that the current code stream is abnormal in reception, the original code stream transmission strategy needs to be changed, and the transmission strategy applicable to the current transmission condition is selected for the sender to execute.
As an embodiment, as shown in fig. 4, the following units are included in the system.
Media transmission processing unit: some information of audio and video of the transmitted code stream is counted. Every fixed period, the information is counted to obtain a code stream based on the statistical data to send a feedback message. The media sending processing unit sends the code stream sending feedback information to the H.320 protocol processing unit.
Media reception processing unit: statistics the audio and video of the received code stream decodes some information. The information is counted every fixed period to obtain a code stream receiving feedback message based on the counted data. The media receiving processing unit sends the code stream receiving feedback information to the H.320 protocol processing unit.
H.320 protocol processing unit: the stream statistics data channel is opened to the opposite end through the BAS code, the H.320 protocol processing unit receives the information of the media sending processing unit and the information of the media receiving processing unit, and the information data are put into the stream statistics data channel and sent to the opposite end through the H.221 frame data. When H.221 frame data is received, a code stream sending feedback message and a code stream receiving feedback message are searched in a code stream statistical data channel, and the code stream feedback message is sent to a code stream feedback message processing unit.
The code stream feedback message processing unit: analyzing the code stream to send feedback information and the code stream to receive the feedback information, and reporting the statistical information of the code stream in the information to the UI for presentation. When the receiving party code stream receiving quality is poor, the sending party can change the sending strategy in time, and the communication effect of the video conference is improved.
In this embodiment, by acquiring a specific signal code in a frame structure, an independent code stream statistic data channel is opened between two communication parties based on the specific signal code; acquiring a code stream feedback message generated by the two communication parties in the code stream transmission process and transmitted in the code stream statistic data channel; and updating a code stream sending strategy when the code stream receiving abnormality exists between the two communication parties according to the code stream feedback information. By the method, the independent channels are opened between the participants of the video conference, so that the code stream feedback information reflecting the data transmission condition can be transmitted to the corresponding participant in the independent channels; the two communication parties can timely acquire the actual transmission condition of the code stream of the other party by timely generating and transmitting the code stream feedback information; by updating the sending strategy in time when the code stream receiving is abnormal, the sender of the participant can change the sending strategy in time, so that the current code stream receiving abnormality is eliminated rapidly, the solution efficiency of the code stream receiving problem is improved, the technical problem of low solution efficiency of the code stream receiving problem in the existing video conference communication process is solved, meanwhile, the diagnosis and maintenance of a video system are facilitated, and the cost of engineering maintenance is reduced.
Further, based on the first embodiment shown in fig. 2, a second embodiment of the video conference code stream feedback method of the present invention is provided, in this embodiment, step S20 includes:
and searching and acquiring a sending feedback message generated based on the code stream sending of the participants sending the code streams in the two communication parties from the code stream statistical data channel, and a receiving feedback message generated by the participants receiving the code streams in the code stream receiving mode, so as to take the sending feedback message and the receiving feedback message as the code stream feedback message.
In this embodiment, since the feedback message is transmitted in an independent code stream statistics data channel after the feedback message is generated and the feedback message is received, the system can find the feedback message and the feedback message in the code stream statistics data channel, which can reflect the actual situation of transmitting and receiving the code stream by the participant. The specific searching mode can be that when the feedback information is sent and received in statistics, specific identification information such as specific characters are added to the feedback information, and the system only needs to find the information with the specific identification information when searching.
Further, before step S20, the method further includes:
Counting the coding format, the total number of data packets and the total data amount of the audio and video code stream transmitted by the participant transmitting the code stream at intervals of a preset first time interval to serve as the transmission feedback message;
placing the sending feedback message in the code stream statistical data channel so as to send the sending feedback message to the participant receiving the code stream through the code stream statistical data channel;
counting the decoding format, the maximum value of the packet sequence number, the packet loss rate in unit time and the total packet loss number of the audio and video code stream received by the participant of the received code stream at intervals of a preset second time interval to serve as the received feedback message;
and placing the received feedback message in the code stream statistical data channel so as to send the received feedback message to the participant sending the code stream through the code stream statistical data channel.
In this embodiment, the preset first time interval refers to a statistics period of sending the feedback message, and the preset second time interval refers to a statistics period of receiving the feedback message, which may be flexibly set according to actual requirements, may be set to the same duration, may also be set to different durations, and the embodiment is not limited specifically.
The sender counts the coding format, the total amount of data packets and the total amount of data of the transmitted audio and video code stream at regular time, and encapsulates the counted data into a fixed message structure, and the message is called a feedback message; the receiving party counts the decoding format of the received audio and video of the code stream, the maximum value of the packet sequence number of the received code stream packet, the packet loss rate in unit time and the total packet loss number at regular time, and encapsulates the statistic data into a fixed message structure, and the message is called a receiving feedback message. After generating the send feedback message and receiving the feedback message, the feedback message can be transmitted to the corresponding participant through the code stream statistics data channel, and the system can find the message in the channel.
Further, before step S30, the method further includes:
combining the sending feedback message and the receiving feedback message, judging whether the integrity and/or the decodability of the code stream transmitted between the party sending the code stream and the party receiving the code stream are abnormal;
if the integrity and/or the decodability of the code stream transmitted between the party sending the code stream and the party receiving the code stream are abnormal, judging that the code stream receiving is abnormal between the two communication parties.
In this embodiment, the system may determine whether the integrity and/or the decodability of the transmission code stream is abnormal by comparing and analyzing the sending feedback message and the receiving feedback message. The integrity is the data integrity, and abnormal loss of data may occur in the actual transmission process. Decodability refers to the ability of a receiver to successfully decode data using a decoding format that corresponds to the sender's encoding format. For example, whether the receiver receives the data completely can be determined by comparing whether the transmitted effective data amount is consistent with the received effective data amount, and whether the receiver can successfully analyze the received data can be determined by comparing whether the encoding mode of the transmitter corresponds to the decoding mode of the receiver.
In addition, if the integrity and the decodability of the code stream are not abnormal, the system can determine that the code stream receiving abnormality is not existed among the plurality of the reference parties.
Further, step S30 includes:
when the integrity and/or the decodability of the code stream transmitted between the participant transmitting the code stream and the participant receiving the code stream are abnormal, the transmission data quantity of the participant transmitting the code stream in the two communication parties is reduced and/or the coding format is modified to be used as a new code stream transmission strategy so as to execute the new code stream transmission strategy to exclude the abnormality.
In this embodiment, when the integrity of the code stream is abnormal, the system may solve the abnormality by reducing the amount of data sent by the sender; when the decodability of the code stream is abnormal, the system can adopt a mode of modifying the coding format of the sender to the coding format corresponding to the decoding format of the receiver to solve the abnormality. After executing the new sending strategy, the sender can successfully remove the abnormality.
In this embodiment, further, by acquiring the sending feedback message and the receiving feedback message of the timing statistics in the independent channels, the video conference system can timely learn the actual data transmission situation of the sending participant and the receiving participant in the video conference process; by judging the integrity and/or the decodability of the transmission code stream, whether the receiving party has abnormal code stream reception at present can be rapidly judged; the corresponding abnormal situation can be rapidly solved by reducing the data transmission amount and/or modifying the coding mode.
Further, based on the first embodiment shown in fig. 2, a third embodiment of the video conference code stream feedback method of the present invention is proposed. In this embodiment, step S10 includes:
acquiring BAS codes in an H.221 frame structure, and taking the BAS codes as the specific signal codes;
And opening an independent code stream statistical data channel between a participant transmitting the code stream and a participant receiving the code stream by using the BAS code, wherein the H.221 frame structure is a data transmission basis of a plurality of participants in E1 private line video conferences.
In this embodiment, the video conference is transmitted based on an E1 dedicated line, and the E1 circuit transmission is based on a circuit switched network, and the two points are connected by a fixed circuit to complete the audio and video communication. After connection establishment, the circuit is fully shared. And E1 has high communication quality, high stability, high reliability and high safety, and is particularly suitable for constructing a high-quality video transmission network by users such as government, army, telecom operators, large enterprises and the like with high video transmission quality requirements. The BAS bit rate allocation signal specifies the allocation of bit positions in the video, audio and data channels in the h.221 frame, thus providing the bit rate required for each channel. It also transmits other control information by which the terminals negotiate transmission rates and other commands. The bit rate allocation signal is located at 9-16 bits of the service channel.
The system opens a code stream statistical data channel by using the BAS code in the H.221 frame structure, a receiver can receive the sending feedback information of the code stream through the channel, and the sender can acquire the receiving feedback information fed back by the receiver through the channel to acquire the receiving code stream condition of the receiver.
Further, after step S20, the method further includes:
and integrating the code stream feedback information to generate target feedback information, and displaying the target feedback information on a screen so that a user can formulate a target code stream sending strategy based on the target feedback information.
In this embodiment, the exception removal may also be performed in combination with an artificial decision. The system can integrate the code stream feedback messages in such a way that the same kind of information in the two messages is compared and highlighted. The system displays the integrated target feedback information on a screen so that relevant technicians can formulate a new sending strategy for the sending end according to the target feedback information.
As an embodiment, based on each unit included in the system in fig. 4, as shown in fig. 5, the transmission flow of the code stream statistics feedback information is:
step one: and E1, opening a data channel by both parties of the special line conference through the BAS code, wherein the data channel is used for transmitting the code stream feedback statistical information.
Step two: the media transmitting processing unit and the media receiving processing unit count the code stream data every fixed period time. The media sending processing unit counts the coding formats of the audio and video code streams, sends the total number and the total data size of the code stream data packets, and encapsulates the counted data into a fixed message structure; the media receiving processing unit counts the coding format of the received audio and video code stream, the maximum value of the received code stream packet sequence number, the packet loss rate in unit time and the total packet loss number, and encapsulates the statistical data into a fixed message structure.
Step three: the media sending processing unit sends the code stream sending feedback information to the H.320 protocol processing unit, and the media receiving processing unit sends the code stream receiving feedback information to the H.320 protocol processing unit.
Step four: the H.320 protocol processing unit puts the code stream sending feedback information and the code stream receiving feedback information into a code stream statistic data channel and sends the code stream sending feedback information and the code stream receiving feedback information to the opposite side together with other data of H.221 frame data.
As shown in fig. 6, the code stream statistics feedback information receiving flow is as follows:
step five: the H.320 protocol processing unit searches a code stream sending feedback message and a code stream receiving feedback message from a code stream statistical data channel of H.221 frame data, and sends the code stream feedback message to the code stream feedback message processing unit.
Step six: the code stream feedback message processing unit: analyzing the code stream to send feedback information and the code stream to receive feedback information, reporting the code stream statistical information in the information to the UI processing unit or processing by using the code stream statistical information, changing the code stream sending strategy and improving the video communication effect.
In this embodiment, an independent channel for transmitting the code stream feedback message is further opened by using BAS codes in the E1 dedicated line video conference, so that the code stream feedback message can be transmitted to the corresponding participant in the channel; the method for manually eliminating the abnormality is provided on the basis of the automatic updating strategy, so that the solution way of the abnormality is enriched.
The invention also provides a video conference code stream feedback device, as shown in fig. 7.
The video conference code stream feedback device comprises:
an independent channel opening module 10, configured to obtain a specific signal code in a frame structure, and open an independent code stream statistic data channel between two communication parties based on the specific signal code;
a feedback message obtaining module 20, configured to obtain a code stream feedback message generated by the two communication parties in a code stream transmission process and transmitted on the code stream statistic data channel;
and the sending policy updating module 30 is configured to update a code stream sending policy when it is determined that there is abnormal code stream reception between the two communication parties according to the code stream feedback message.
The invention also provides video conference code stream feedback equipment.
The video conference code stream feedback device comprises a processor, a memory and a video conference code stream feedback program which is stored in the memory and can run on the processor, wherein the video conference code stream feedback program realizes the steps of the video conference code stream feedback method when being executed by the processor.
The method implemented when the video conference code stream feedback program is executed may refer to various embodiments of the video conference code stream feedback method of the present invention, which are not described herein again.
The invention also provides a computer readable storage medium.
The computer readable storage medium of the invention stores a video conference code stream feedback program, which when executed by a processor, implements the steps of the video conference code stream feedback method described above.
The method implemented when the video conference code stream feedback program is executed may refer to various embodiments of the video conference code stream feedback method of the present invention, which will not be described herein.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) as described above, comprising instructions for causing a video conference stream feedback device to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.

Claims (10)

1. The video conference code stream feedback method is characterized by comprising the following steps of:
acquiring a specific signal code in a frame structure, and opening an independent code stream statistical data channel between two communication parties based on the specific signal code;
Acquiring a code stream feedback message generated by the two communication parties in the code stream transmission process and transmitted in the code stream statistic data channel;
based on comparing and analyzing the sending feedback message and the receiving feedback message in the code stream feedback message, judging whether the integrity and/or the decodability of the code stream transmitted between the party sending the code stream and the party receiving the code stream are abnormal;
and updating a code stream sending strategy when the code stream receiving abnormality exists between the two communication parties according to the code stream feedback information.
2. The video conference code stream feedback method as set forth in claim 1, wherein said step of acquiring a code stream feedback message generated by both communication parties during code stream transmission and transmitted on said code stream statistics data channel comprises:
and searching and acquiring a sending feedback message generated based on the code stream sending of the participants sending the code streams in the two communication parties from the code stream statistical data channel, and a receiving feedback message generated by the participants receiving the code streams in the code stream receiving mode, so as to take the sending feedback message and the receiving feedback message as the code stream feedback message.
3. The video conference code stream feedback method as set forth in claim 2, wherein said step of obtaining a code stream feedback message generated by both communication parties during code stream transmission and transmitted over said code stream statistics data channel further comprises:
counting the coding format, the total number of data packets and the total data amount of the audio and video code stream transmitted by the participant transmitting the code stream at intervals of a preset first time interval to serve as the transmission feedback message;
placing the sending feedback message in the code stream statistical data channel so as to send the sending feedback message to the participant receiving the code stream through the code stream statistical data channel;
counting the decoding format, the maximum value of the packet sequence number, the packet loss rate in unit time and the total packet loss number of the audio and video code stream received by the participant of the received code stream at intervals of a preset second time interval to serve as the received feedback message;
and placing the received feedback message in the code stream statistical data channel so as to send the received feedback message to the participant sending the code stream through the code stream statistical data channel.
4. The video conference code stream feedback method as claimed in claim 2, wherein the step of determining whether there is an abnormality in the integrity and/or decodability of the code stream transmitted between the participant transmitting the code stream and the participant receiving the code stream based on a comparison analysis of the transmission feedback message and the reception feedback message in the code stream feedback message, comprises:
Combining the sending feedback message and the receiving feedback message, judging whether the integrity and/or the decodability of the code stream transmitted between the party sending the code stream and the party receiving the code stream are abnormal;
if the integrity and/or the decodability of the code stream transmitted between the party sending the code stream and the party receiving the code stream are abnormal, judging that the code stream receiving is abnormal between the two communication parties.
5. The video conference code stream feedback method as claimed in claim 4, wherein said step of updating a code stream transmission policy when it is determined that there is a code stream reception abnormality between the two communication parties according to the code stream feedback message comprises:
when the integrity and/or the decodability of the code stream transmitted between the participant transmitting the code stream and the participant receiving the code stream are abnormal, the transmission data quantity of the participant transmitting the code stream in the two communication parties is reduced and/or the coding format is modified to be used as a new code stream transmission strategy so as to execute the new code stream transmission strategy to exclude the abnormality.
6. The video conference code stream feedback method as set forth in claim 1, wherein said step of acquiring a specific signal code in a frame structure, and opening an independent code stream statistic data channel between both communication parties based on said specific signal code comprises:
Acquiring BAS codes in an H.221 frame structure, and taking the BAS codes as the specific signal codes;
and opening an independent code stream statistical data channel between a participant transmitting the code stream and a participant receiving the code stream by using the BAS code, wherein the H.221 frame structure is a data transmission basis of a plurality of participants in E1 private line video conferences.
7. The video conference code stream feedback method according to any one of claims 1 to 6, wherein said step of obtaining a code stream feedback message generated by both communication parties during code stream transmission and transmitted over said code stream statistics data channel further comprises:
and integrating the code stream feedback information to generate target feedback information, and displaying the target feedback information on a screen so that a user can formulate a target code stream sending strategy based on the target feedback information.
8. A video conference code stream feedback device, characterized in that the video conference code stream feedback device comprises:
an independent channel opening module, configured to obtain a specific signal code in a frame structure, and open an independent code stream statistical data channel between two communication parties based on the specific signal code;
The feedback message acquisition module is used for acquiring a code stream feedback message which is generated by the two communication parties in the code stream transmission process and transmitted in the code stream statistic data channel;
the method is also used for judging whether the integrity and/or the decodability of the code stream transmitted between the party transmitting the code stream and the party receiving the code stream are abnormal or not based on the comparison and analysis of the transmitted feedback message and the received feedback message in the code stream feedback message;
and the sending strategy updating module is used for updating the code stream sending strategy when the code stream receiving abnormality exists between the two communication parties according to the code stream feedback information.
9. A video conference code stream feedback device, characterized in that the video conference code stream feedback device comprises: memory, a processor and a video conference stream feedback arrangement stored on the memory and executable on the processor, which video conference stream feedback arrangement when executed by the processor implements the steps of the method according to any of claims 1 to 7.
10. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon a video conference bitstream feedback program, which when executed by a processor, implements the steps of the method according to any of claims 1 to 7.
CN202011366629.XA 2020-11-27 2020-11-27 Video conference code stream feedback method, device, equipment and computer readable storage medium Active CN112565664B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011366629.XA CN112565664B (en) 2020-11-27 2020-11-27 Video conference code stream feedback method, device, equipment and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011366629.XA CN112565664B (en) 2020-11-27 2020-11-27 Video conference code stream feedback method, device, equipment and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN112565664A CN112565664A (en) 2021-03-26
CN112565664B true CN112565664B (en) 2023-04-28

Family

ID=75046226

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011366629.XA Active CN112565664B (en) 2020-11-27 2020-11-27 Video conference code stream feedback method, device, equipment and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN112565664B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113573006B (en) * 2021-07-21 2024-04-05 北京融讯科创技术有限公司 Special line video conference communication method, device, equipment and storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06350725A (en) * 1993-06-10 1994-12-22 Ricoh Co Ltd Video conference system
EP0760562A2 (en) * 1995-08-30 1997-03-05 Sharp Kabushiki Kaisha Communication procedure control system
CN1476247A (en) * 2002-08-16 2004-02-18 深圳市中兴通讯股份有限公司 Method of reliable transmission on low quality line for conference TV system transmiling code flow
CN101478411A (en) * 2009-01-16 2009-07-08 深圳华为通信技术有限公司 Method, device and system for transmitting conference control signaling
CN101488916A (en) * 2009-01-24 2009-07-22 深圳华为通信技术有限公司 Band-width control method, apparatus, terminal and system based on video conference
CN101883240A (en) * 2010-06-09 2010-11-10 广东威创视讯科技股份有限公司 Video conference system based on MCU (Microprogrammed Control Unit) and video transmission lost packet processing method thereof
CN106357693A (en) * 2016-11-09 2017-01-25 深圳市云之讯网络技术有限公司 Real-time packet loss compensation method for media stream
CN111988556A (en) * 2020-08-28 2020-11-24 深圳市融讯视通科技有限公司 Dynamic audio and video coding transmission method, system, device and storage medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06350725A (en) * 1993-06-10 1994-12-22 Ricoh Co Ltd Video conference system
EP0760562A2 (en) * 1995-08-30 1997-03-05 Sharp Kabushiki Kaisha Communication procedure control system
CN1476247A (en) * 2002-08-16 2004-02-18 深圳市中兴通讯股份有限公司 Method of reliable transmission on low quality line for conference TV system transmiling code flow
CN101478411A (en) * 2009-01-16 2009-07-08 深圳华为通信技术有限公司 Method, device and system for transmitting conference control signaling
CN101488916A (en) * 2009-01-24 2009-07-22 深圳华为通信技术有限公司 Band-width control method, apparatus, terminal and system based on video conference
CN101883240A (en) * 2010-06-09 2010-11-10 广东威创视讯科技股份有限公司 Video conference system based on MCU (Microprogrammed Control Unit) and video transmission lost packet processing method thereof
CN106357693A (en) * 2016-11-09 2017-01-25 深圳市云之讯网络技术有限公司 Real-time packet loss compensation method for media stream
CN111988556A (en) * 2020-08-28 2020-11-24 深圳市融讯视通科技有限公司 Dynamic audio and video coding transmission method, system, device and storage medium

Also Published As

Publication number Publication date
CN112565664A (en) 2021-03-26

Similar Documents

Publication Publication Date Title
US7894354B2 (en) System and method to monitor RTP streams using RTCP SR/RR packet information
US8380848B2 (en) Transmission of information relating to a quality of service
KR101122143B1 (en) Signaling buffer parameters indicative of receiver buffer architecture
US20090231438A1 (en) Automatic Testing of Scheduled Telepresence Meetings
CN105610824B (en) A kind of screen sharing method based on screen mirror image and RTSP Streaming Media frame
CN102202210B (en) Method for mobile phone to play real-time monitoring video and mobile phone to play real-time monitoring video
US20160219318A1 (en) Information presentation device and method
CN1972494B (en) Processing method for signaling tracking
CN112565664B (en) Video conference code stream feedback method, device, equipment and computer readable storage medium
RU2007114149A (en) SYSTEM AND METHOD OF MANAGING SUBSCRIBER DATA IN DIGITAL MULTIMEDIA BROADCASTING
CN1988709A (en) Signalling tracking device
CN102263771B (en) Mobile terminal, adapter as well as method and system for playing multi-media data
CN112738450B (en) Conference holding method, device, equipment and computer readable storage medium
KR100825459B1 (en) Multimedia broadcasting service method using broadcasting/multicast control in wireless telecommunication system
CN101909194B (en) Method and system for providing channel switching service and channel switching server
CN100508640C (en) Method and device in a telecommunication system
CN112118442A (en) AI video call quality analysis method, device, computer equipment and storage medium
US8391284B2 (en) Usage of feedback information for multimedia sessions
US20110216891A1 (en) Method and equipment for implementing information exchange
CN111698677A (en) Method for reporting and receiving user plane statistical information and network equipment
CN110611663B (en) Detection method, device and system
CN101662642A (en) Method for directly introducing real-time monitoring images into video conference
CN114793183B (en) Distributed fusion communication method based on multi-source data processing
EP1855454A1 (en) Method and apparatus for speaker identification in a conference call
CN114584535B (en) Elevator monitoring camera access call center system for realizing two-way call

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
PE01 Entry into force of the registration of the contract for pledge of patent right
PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: Video conference stream feedback method, device, device, and computer-readable storage medium

Effective date of registration: 20230718

Granted publication date: 20230428

Pledgee: Haidian Beijing science and technology enterprise financing Company limited by guarantee

Pledgor: Beijing Rongxun Technology Co.,Ltd.

Registration number: Y2023110000296