CN117768708A

CN117768708A - Local video loop display method in video conference, electronic equipment and storage medium

Info

Publication number: CN117768708A
Application number: CN202311437628.3A
Authority: CN
Inventors: 贺传森; 龚著期; 韩杰; 杨春晖
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2023-10-31
Filing date: 2023-10-31
Publication date: 2024-03-26

Abstract

The invention provides a local video loop display method, electronic equipment and a storage medium in a video conference, wherein the method comprises the following steps: in a video conference, acquiring I frame data sent by the monitoring device, wherein the I frame data comprises: additional information of the monitoring device; determining the position of the local video loop display of the terminal according to the additional information; creating a channel on a local video output VO layer of the terminal, wherein the channel is used for the local video loop display; binding the position of the local video in a video processing subsystem VPSS with the channel of the VO layer; and realizing loop display of the local video through the bound channel. By adopting the scheme, the video of the own terminal can be attached to the monitoring video, the problem that when the current terminal watches the video of the own terminal in the monitoring video due to delay of the monitoring equipment in video transmission is avoided, the picture is asynchronous, the transmission delay is reduced, and the user experience is improved.

Description

Local video loop display method in video conference, electronic equipment and storage medium

Technical Field

The present invention relates to the field of video networking technologies, and in particular, to a local video loop display method, device, system, electronic equipment, and computer readable storage medium in a video conference.

Background

With the rapid development of the video networking, an important milestone of the network development is a higher-level form of the internet, and numerous internet applications are pushed to high-definition video, and high-definition video-facing surfaces, such as video networking conferences and the like, are played through monitoring and broadcasting equipment.

The monitoring and broadcasting equipment is a participant role in the video networking conference, other participant terminals can be pulled into the monitoring and broadcasting equipment split screen for broadcasting, and the monitoring and broadcasting equipment can be distributed for displaying in modes of single screen, two split screens, four split screens and the like. When the monitoring and broadcasting equipment is set as the speaking party 1, other terminal videos played on the monitoring and broadcasting split screen are combined into a converging video, and the converging video is sent to all the participants for watching.

In the video service of the video network, when the terminal equipment watches the monitoring equipment picture and the monitoring equipment picture contains the current terminal equipment picture, the current terminal is delayed and the picture is not synchronous when watching the video of the current terminal in the monitoring equipment picture because the monitoring equipment video transmission needs a certain time.

Disclosure of Invention

The invention provides a local video loop display method, a device, a system, electronic equipment and a computer readable storage medium in a video conference, which at least solve the technical problem of asynchronous monitoring video pictures caused by video transmission delay of monitoring equipment in the related technology. The technical scheme of the invention is as follows:

according to a first aspect of an embodiment of the present invention, there is provided a local video loop display method in a video conference, where the method is applied to a terminal, and when the terminal is used as a participant and a video of a monitoring device is watched on a single screen, the video includes a video of the terminal, and the method includes:

in a video conference, acquiring I frame data sent by the monitoring device, wherein the I frame data comprises: additional information of the monitoring device;

determining the position of the local video loop display of the terminal according to the additional information of the monitoring and broadcasting equipment;

newly creating a channel on a local video output VO layer of the terminal, wherein the channel is used for displaying the local video loop;

binding the position of the local video in a video processing subsystem VPSS with the channel of the VO layer;

and realizing loop display of the local video through the bound channel.

Optionally, the determining, according to the additional information of the monitoring device, a location where the local video loop of the terminal is displayed includes:

determining the split screen position of the terminal in the picture of the monitoring equipment according to the terminal information displayed on each split screen in the additional information of the monitoring equipment;

and determining the position of the local video loop display of the terminal according to the screen resolution of the monitoring and broadcasting equipment and the split screen mode in the additional information of the monitoring and broadcasting equipment.

Optionally, the determining the split screen position of the terminal in the monitor device picture according to the information of the terminal displayed on each split screen in the additional information of the monitor device includes:

acquiring the equipment number of the terminal;

respectively comparing the equipment number of the terminal with the channel number corresponding to the information of the display terminal on each split screen;

and determining a channel number consistent with the equipment number of the terminal according to the comparison result, and taking the channel number as a split screen position of the terminal in the monitoring equipment picture.

Optionally, the determining, according to the screen resolution of the monitoring device, the location of the local video loop display of the terminal according to the split screen position and the split screen mode in the additional information of the monitoring device includes:

Acquiring the screen resolution displayed by the monitoring and broadcasting equipment;

and calculating the position of the local video loop display of the terminal according to the screen resolution and the split screen position and the screen position calculation mode corresponding to the split screen mode, wherein the position comprises an X coordinate, a Y coordinate, a width and a height.

Optionally, a channel is newly created on the local video output VO layer of the terminal, and the channel is used for local video loop display, including:

when the terminal outputs a local video, an ID number corresponding to a video output layer VO used by the terminal is obtained;

and based on the ID number, a channel is newly created on the video output layer VO by utilizing the interface parameters of the created video output channel on the terminal chip of the terminal, and the channel is used for local video loop display.

Optionally, the loop display of the local video is realized through the bound channel, including:

and transmitting the local video through the bound channel, and overlapping the terminal picture on the picture of the local video played by the monitoring and broadcasting equipment based on the position of the local video loop display.

Optionally, binding the location information of the local video in the video processing subsystem VPSS with the channel of the VO layer includes:

Acquiring position information of a local video source in a video processing subsystem (VPSS), wherein the position information comprises a group number ID and a channel number;

and binding the group number ID and the channel number of the VPSS to the channel created by the VO layer by using the system binding interface parameters provided by the terminal chip.

Optionally, the method further comprises:

and at the end of the video conference, unbinding the channels of the VO layer and the positions in the video processing subsystem VPSS, and removing the unbinding channels on the VO layer.

Optionally, in the video conference, the I frame data sent by the monitoring device is obtained, where the I frame data includes: additional information of the monitoring device comprises

In a video conference, judging whether the received video data stream comprises I frame data or not;

when the I frame data is included, judging whether the I frame data includes additional information of the monitoring device or not;

when the additional information is included, the additional information is analyzed to obtain the split screen mode of the monitoring and broadcasting equipment and the information of the display terminal on each split screen.

According to a second aspect of an embodiment of the present invention, there is provided a local video loop display method in a video conference, where the method is applied to a terminal, and a video data stream is sent at the terminal as a monitoring device, and the method includes:

In a video conference, acquiring additional information of the monitoring device, wherein the additional information comprises: the split screen mode of the monitoring and broadcasting equipment and the terminal information of the video played on each split screen;

when the video data stream to be transmitted is detected to comprise I frame data, adding the additional information into the I frame data;

and the I frame data added with the additional information is placed into the video data stream to be sent, so that a terminal for watching the video data stream can conveniently realize the loop display of the local video.

According to a third aspect of the embodiments of the present invention, there is provided a local video loop display device in a video conference, where the device is applied to a terminal, and when the terminal views a video of a monitoring device through a single screen, and the video displayed by the monitoring device includes the video of the terminal, the device includes:

the acquisition module is used for acquiring I frame data sent by the monitoring and broadcasting equipment in the video conference, wherein the I frame data comprises the following components: monitoring additional information of the broadcasting equipment;

the determining module is used for determining the position of the local video loop display of the terminal according to the additional information of the monitoring and broadcasting equipment;

the creation module is used for newly creating a channel on a local video output VO layer of the terminal, wherein the channel is used for the local video loop display;

The binding module is used for binding the position of the local video in the video processing subsystem VPSS with the channel of the VO layer;

and the loop display module is used for realizing loop display of the local video through the channels bound by the binding module.

Optionally, the determining module includes:

the split screen position determining module is used for determining the split screen position of the terminal in the picture of the monitoring equipment according to the terminal information displayed on each split screen in the additional information of the monitoring equipment;

and the loop display position determining module is used for determining the position of the local video loop display of the terminal according to the screen resolution of the monitoring and broadcasting equipment, the split screen position and the split screen mode in the additional information of the monitoring and broadcasting equipment.

Optionally, the split screen position module includes:

the number acquisition module is used for acquiring the equipment number of the terminal;

the comparison module is used for respectively comparing the equipment number of the terminal with the channel number corresponding to the information of the display terminal on each split screen;

and the split screen position determining sub-module is used for determining a channel number consistent with the equipment number of the terminal according to the comparison result, and taking the channel number as the split screen position of the terminal in the monitoring and broadcasting equipment picture.

Optionally, the loop display position determining module includes:

the resolution acquisition module is used for acquiring the screen resolution displayed by the monitoring and broadcasting equipment;

and the loop display position calculation module is used for calculating the position of the local video loop display of the terminal according to the screen resolution and the split screen position and the screen position calculation mode corresponding to the split screen mode, wherein the position comprises an X coordinate, a Y coordinate, a width and a height.

Optionally, the creating module includes:

the ID number acquisition module is used for acquiring an ID number corresponding to a video output layer VO used when the terminal outputs the local video;

and the channel creation module is used for newly creating a channel on the video output layer VO by utilizing the interface parameters of the created video output channel on the terminal chip of the terminal based on the ID number, wherein the channel is used for local video loop display.

Optionally, the loop display module includes:

the transmission module is used for transmitting the local video through the bound channel;

and the superposition display module is used for superposing the video of the terminal on the local video played by the monitoring and broadcasting equipment based on the position where the local video loop is displayed.

Optionally, the binding module includes:

the position acquisition module is used for acquiring the position information of the local video source in the video processing subsystem VPSS, and comprises a group number ID and a channel number;

and the channel binding module is used for binding the group number ID and the channel number of the VPSS to the channel created by the VO layer by utilizing the system binding interface parameters provided by the terminal chip.

Optionally, the method further comprises:

and the unbinding module is used for unbinding the channel between the position in the video processing subsystem VPSS and the VO layer when the video conference is finished, and removing the unbinding channel on the VO layer.

Optionally, the acquiring module includes

The first judging module is used for judging whether the received video data stream comprises I frame data or not in the video conference;

the second judging module is used for judging whether the I frame data comprises additional information of the monitoring and broadcasting equipment or not when the I frame data comprises the I frame data;

and the analysis module is used for analyzing the additional information when the additional information is included, so as to obtain the split screen mode of the monitoring and broadcasting equipment and the information of the display terminal on each split screen.

According to a fourth aspect of an embodiment of the present invention, there is provided a local video loop display device in a video conference, the device being applied to a terminal and transmitting a video data stream as a monitoring device at the terminal, the device comprising:

The acquisition module is used for acquiring the additional information of the monitoring and broadcasting equipment in the video conference, wherein the additional information comprises: the split screen mode of the monitoring and broadcasting equipment and the terminal information of the video played on each split screen;

an adding module, configured to add the additional information to the I-frame data when it is detected that the video data stream to be transmitted includes the I-frame data;

and the putting module is used for putting the I frame data added with the additional information into the video data stream and then sending the I frame data so as to facilitate the terminal for watching the video data stream to realize the loop display of the local video.

According to a fifth aspect of an embodiment of the present invention, there is provided a local video loop display system in a video conference, the system at least including: a first terminal and a second terminal; wherein the first terminal is used as a monitoring and broadcasting device to send video data stream, the second terminal is used as a participant, and the display mode is that when the video of the monitoring and broadcasting device is watched by a single screen,

the first terminal is configured to obtain, in a video conference, additional information of the monitoring device, where the additional information includes: the split screen mode of the monitoring and broadcasting equipment and the terminal information of the video played on each split screen; and adding the additional information to the I frame data when the video data stream to be transmitted is detected to include the I frame data; the I frame data added with the additional information is put into the video data stream and then sent to the second terminal;

The second terminal is configured to obtain I frame data from a video data stream sent by the first terminal when the video data stream is received, obtain additional information of a monitoring device from the I frame data, determine a location where a local video loop is displayed according to the additional information of the monitoring device, and create a channel on the local video output VO layer, where the channel is used for the local video loop display; binding the position of the local video in a video processing subsystem VPSS with a channel of the VO layer, and realizing loop display of the local video through the bound channel.

According to a sixth aspect of an embodiment of the present invention, there is provided an electronic apparatus including:

a processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the local video loop display method in a video networking service as described above.

According to a seventh aspect of embodiments of the present invention, there is provided a computer readable storage medium, which when executed by a processor of an electronic device, causes the electronic device to perform the local video loop display method in a video networking service as described above.

According to an eighth aspect of an embodiment of the present invention, there is provided a computer program product comprising a computer program or instructions which, when executed by a processor of an electronic device, implement a local video loop display method in a video networking service as described above.

The technical scheme provided by the embodiment of the invention at least has the following beneficial effects:

in the embodiment of the present invention, in a video conference, I frame data sent by the monitoring device is obtained, where the I frame data includes: additional information of the monitoring device; determining the position of the local video loop display of the terminal according to the additional information of the monitoring and broadcasting equipment; creating a channel on a local video output VO layer of the terminal, wherein the channel is used for the local video loop display; binding the position of the local video in a video processing subsystem VPSS with the channel of the VO layer; and realizing loop display of the local video through the bound channel. That is, in this embodiment, in a video conference, when a terminal views a video picture of a monitoring device and the monitoring video picture includes a video picture of a current terminal, a split screen position of the viewing terminal in the monitoring picture is determined first; the video loop display position of the watching terminal is calculated based on the information such as the split screen mode, the split screen position and the resolution of the watching terminal, a newly built VO channel is established, the VO channel is bound with a local video source in the VPSS, and the local video loop display is completed, namely, a video picture of the terminal is attached to a displayed monitoring video picture, so that delay of the monitoring equipment in video transmission is avoided, and the problem that the picture is asynchronous when the current terminal watches own video in the monitoring picture is solved, transmission delay is reduced, and user experience is improved. .

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention as claimed.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention and do not constitute a undue limitation on the invention. In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief description will be given below of the drawings that are needed in the embodiments or the prior art descriptions, and it is obvious that the drawings in the following description are some embodiments of the present application, and that other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a flowchart of a local video loop display method in a video conference according to an embodiment of the present invention.

Fig. 2 is another flowchart of a local video loop display method in a video conference according to an embodiment of the present invention.

Fig. 3 is a diagram of an application example of a local video loop display method in a video conference according to an embodiment of the present invention.

Fig. 4 is a diagram of another application example of a local video loop display method in a video conference according to an embodiment of the present invention.

Fig. 5 is a block diagram of a local video loop display device in a video conference according to an embodiment of the present invention.

Fig. 6 is another block diagram of a local video loop display device in a video conference according to an embodiment of the present invention.

Fig. 7 is a block diagram of a local video loop display system in a video conference according to an embodiment of the present invention.

Fig. 8 is a block diagram of an electronic device according to an embodiment of the present invention.

Fig. 9 is a block diagram of an apparatus for local video loop display in a video conference according to an embodiment of the present invention.

Detailed Description

In order to enable a person skilled in the art to better understand the technical solutions of the present invention, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings.

It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. The implementations described in the following exemplary examples do not represent all implementations consistent with the invention. Rather, they are merely examples of apparatus and methods consistent with aspects of the invention as detailed in the accompanying claims.

Fig. 1 is a flowchart of a local video loop display method in a video conference, where the local video loop display method in the video conference is applied to a terminal, and when the terminal is used as a participant and a display mode of the terminal is a video of a single-screen monitoring device, as shown in fig. 1, the method includes the following steps:

step 101: in a video conference, acquiring I frame data sent by the monitoring device, wherein the I frame data comprises: additional information of the monitoring device;

step 102: determining the position of the local video loop display of the terminal according to the additional information of the monitoring and broadcasting equipment;

step 103: newly creating a channel on a local video output VO layer of the terminal, wherein the channel is used for displaying the local video loop;

step 104: binding the position of the local video in a video processing subsystem VPSS with the channel of the VO layer;

step 105: and realizing loop display of the local video through the bound channel.

The method for displaying local video loop in video conference according to the present invention can be applied to a terminal, a server, etc., where the terminal implementation device can be an electronic device such as a smart phone, a notebook computer, a tablet computer, a desktop computer, a personal digital assistant (PDA, personal Digital Assistant), a wearable device, etc., and the server can be an independent server, a server cluster, or a server providing cloud services, a cloud database, cloud computing, a cloud function, cloud storage, a network service, cloud communication, an intermediate service, a domain name service, a security service, a content distribution network, or a server providing big data and an artificial intelligent platform, etc., which is not limited herein.

The following describes in detail the specific implementation steps of a local video loop display method in a video conference provided by the embodiment of the present invention with reference to fig. 1, where the method is applied to a terminal, and when the terminal is used as a participant and a display mode of the terminal is a video of a single-screen monitoring device, the method specifically includes:

in step 101, in a video conference, acquiring I frame data sent by the monitoring device, where the I frame data includes: and the additional information of the monitoring and broadcasting equipment.

In the step, in the video conference, when a video data stream is received, whether the received video data stream comprises I frame data or not is judged; when the I frame data is included, judging whether the I frame data includes additional information of the monitoring and broadcasting equipment or not; the additional information may be supplemental enhancement information (SEI, supplemental Enhancement Information) information, which belongs to the category of the code stream, and provides a method for adding additional information to the video code stream, which is one of the characteristics of the video compression standards h.264/h.265. When the additional information is included, the additional information is analyzed to obtain the split screen mode of the monitoring and broadcasting equipment and the information of the display terminal on each split screen.

Wherein, the SEI information may include: the method comprises the steps of monitoring a split screen mode of the broadcasting equipment and terminal information played on each split screen; the split screen mode can be a two-split screen mode, a four-split screen mode or an eight-split screen mode, and the like, and the split screen mode is selected according to actual needs; and the terminal information played on each split screen may include: information such as the stream channel number (i.e., which of the sub-screens each video plays on the monitor device), the terminal device number to which the video corresponds, the code channel number to which the video is played, etc.

When receiving the I frame data, the watching and monitoring video terminal analyzes SEI information and judges the split screen position of the watching terminal in the monitoring picture;

calculating the video loop display position of the watching terminal according to the information of the monitoring split screen mode, the split screen where the watching terminal is, the resolution of the watching terminal and the like;

and binding the channel of the newly-built video output VO layer with a local video source in the VPSS to finish local video loop display.

In step 102, the position of the local video loop display of the terminal is determined according to the additional information of the monitoring device.

In the step, firstly, the split screen position of the terminal in the picture of the monitoring equipment is determined according to the information of the terminal displayed on each split screen in the additional information of the monitoring equipment.

Specifically, the device number of the terminal is obtained first, the device number of the terminal is compared with each channel number (terminal_number) of the terminal information displayed on each split screen respectively, the channel number consistent with the device number of the terminal is determined, and the channel number is used as the split screen position of the terminal in the monitoring device picture. If no consistent channel number is found, it is indicated that the video data stream of the terminal is not played in the monitoring device.

And secondly, determining the position of the local video loop display of the terminal according to the screen resolution of the monitoring and broadcasting equipment, the split screen position and the split screen mode in the additional information of the monitoring and broadcasting equipment.

Specifically, firstly, the screen resolution displayed by the monitoring and broadcasting equipment is obtained; and then, according to the screen resolution and the split screen position, calculating the position of the local video loop display of the terminal according to a screen position calculation mode corresponding to the split screen mode, wherein the position comprises an X coordinate, a Y coordinate, a width and a height.

For example, if the split screen mode of the monitoring and broadcasting device is two split screens, left and right display is taken as an example. The screen splitting position (for example, the channel number is 0, the subscript starts from 0, namely, on the first screen on the monitoring device) of the terminal on the monitoring device, and meanwhile, the screen resolution displayed by the current terminal is 1920 x 1080 is obtained, and then the calculation is performed according to the screen position calculation mode corresponding to the screen splitting mode, so that the position where the local video loop display is located is obtained:

X＝0，Y＝1080/4，width＝1920/2，height＝1080/2

If the channel number of the terminal on the monitoring device is 1 (i.e. on the second screen), the local video loop display is located at the following position:

X＝1920/2，Y＝1080/4，width＝1920/2，height＝1080/2

for another example, if the split screen mode of the monitoring and broadcasting device is a four-split screen (i.e. a grid of a field character):

if the channel number of the terminal on the monitoring equipment is 0, the position of the local video loop display is:

X＝0，Y＝0，width＝1920/2，height＝1080/2

if the channel number of the terminal on the monitoring equipment is 1, the position of the local video loop display is:

X＝1920/2，Y＝0，width＝1920/2，height＝1080/2

if the channel number of the terminal on the monitoring equipment is 2, the position of the local video loop display is:

X＝0，Y＝1080/2，width＝1920/2，height＝1080/2

if the channel number of the terminal on the monitoring equipment is 3, the position of the local video loop display is:

X＝1920/2，Y＝1080/2，width＝1920/2，height＝1080/2

in step 103, a channel is created on the local video output VO layer of the terminal, said channel being used for the local video loop display.

The method specifically comprises the following steps: when the terminal outputs a local video, an ID number corresponding to a video output layer VO used by the terminal is obtained; and based on the ID number, creating a channel on the video output layer VO by using the interface parameters of the created video output channel on the terminal chip of the terminal, wherein the channel is used for local video loop display.

That is, first, when acquiring an Output Video of the terminal, if an ID number corresponding to a Video Output (VO) layer is used, for example, 3 Video Output layers are supported on a terminal chip of the terminal, the ID numbers are 0/1/2, respectively, and the ID number of the Video Output layer currently used by the terminal is 0. The VO layer is that the module actively reads video and graphic data from corresponding positions of the memory and outputs the video and graphic through corresponding display equipment.

Typically, the channels of the video layer have no scaling capability and are scaled by means of an external VPSS. For example, the VDEC source image is scaled by VPSS and then output to a certain channel of the VO layer for display. If the image output to the channel of the VO layer exceeds the channel region size of the VO layer, the VO layer clips the image.

And then, a channel is newly created on a video output layer (VO) through the interface parameters of the created video output channel provided by the terminal chip, and the channel is used for local video loop display. For example, the current terminal is in a single-screen mode display, the original video service creates a channel with the channel number 0 on the ID number 0 of the video output layer, the channel with the channel number 0 is used for displaying the video sent by the monitoring device, and at this time, a channel with the channel number 1 is newly created and used for being displayed as a local video loop.

Wherein creating the video output channel interface parameters may comprise: the ID number of the video output layer, the video output channel number, the display position (including X coordinate, Y coordinate, width and height) of the channel video at the output layer, the display priority (the value can be 0-32, if the two channel video display positions are overlapped, the display with high priority is at the uppermost layer of the screen), and the like.

In step 104, the local video is bound to the channel of the VO layer at the position in the video processing subsystem VPSS.

The method specifically comprises the following steps: acquiring position information of a local video source in a video processing subsystem (VPSS), wherein the position information comprises a group number ID and a channel number; and binding the group number ID and the channel number of the VPSS to the channel created by the VO layer by using the system binding interface parameters provided by the terminal chip.

That is, the video source is bound to the created video output channel (i.e., the video source local to the current terminal), and the process includes:

1) The method comprises the steps of firstly acquiring a group ID and a channel number of a local video source in a video processing subsystem (VPSS, video Process Sub-System), and binding the local video source to a newly created VO channel through a System binding interface parameter provided by a terminal chip.

In this embodiment, the terminal chip provides a system binding interface, i.e. the association between the two is established by binding the data sources by the data receivers. After binding, the data generated by the data source will be automatically sent to the recipient, for example:

the local Video data collected by the terminal is output through a channel 1 of a decoding module (VDEC, video Decoder, for providing a Video hardware decoding interface to realize a Video decoding function), and is bound with a position in a VPSS through a system binding interface parameter, and the system binding interface parameter may include:

data source type (VDEC), data source device number (device number herein refers to channel number, not device number, which value is 0), data source channel number (1);

the receiver type (VPSS), the receive data device number (VPSS group ID, i.e. 64), the receive path (0).

2) And using a system binding interface to complete the binding of the VPSS and the VO, wherein the parameters of the system binding interface comprise:

data Source type (VPSS), data Source device number (VPSS group ID, 64), data Source channel number (0)

The receiver type (VO), the receiver data device number (VO layer ID, i.e. 0), the receiver channel (newly created channel 1).

In step 105, loop-back display of the local video is achieved through the bound channels.

The method specifically comprises the following steps: and transmitting the local video through the bound channel, and overlapping the terminal picture on the picture of the local video played by the monitoring and broadcasting equipment based on the position of the local video loop display.

That is, after the channel binding is completed, the VPSS will send the local video source to the VO to output on the terminal device, and the newly created channel number 1 on the VO transmits the local video source, and displays the local video source through the monitor terminal, and when displaying, the local video source is pasted to the current terminal picture from the position of the current terminal picture, thereby completing the local video loop display.

In the embodiment of the present invention, in a video conference, I frame data sent by the monitoring device is obtained, where the I frame data includes: additional information of the monitoring device; determining the position of the local video loop display of the terminal according to the additional information of the monitoring and broadcasting equipment; creating a channel on a local video output VO layer of the terminal, wherein the channel is used for the local video loop display; binding the position of the local video in a video processing subsystem VPSS with the channel of the VO layer; and realizing loop display of the local video through the bound channel. That is, in this embodiment, in a video conference, when a terminal views a video picture of a monitoring device and the monitoring video picture includes a video picture of a current terminal, a split screen position of the viewing terminal in the monitoring picture is determined first; the video loop display position of the watching terminal is calculated based on the information such as the split screen mode, the split screen position and the resolution of the watching terminal, a newly built VO channel is established, the VO channel is bound with a local video source in the VPSS, and the local video loop display is completed, namely, a video picture of the terminal is attached to a displayed monitoring video picture, so that delay of the monitoring equipment in video transmission is avoided, and the problem that the picture is asynchronous when the current terminal watches own video in the monitoring picture is solved, transmission delay is reduced, and user experience is improved.

Optionally, in another embodiment, based on the foregoing embodiment, the method may further include: and at the end of the video conference, unbinding the channels of the VO layer and the positions in the video processing subsystem VPSS, and removing the unbinding channels on the VO layer.

In this embodiment, when the video conference is ended, the video of the current terminal needs to be removed from the monitoring split screen of the monitoring device, the current terminal unbinds the VPSS and the channels with the VO layer, and the channels newly added after unbinding are removed from the VO layer.

Wherein, can call the system and unbind the interface to participate in unbind VPSS and with the channel of the said VO layer, the interface parameter of system unbinding includes:

Receiver type (VO), receiver data device number (VO layer ID, i.e. 0), receiver channel (newly created channel 1)

Then, the VO destroy channel interface parameters are called to destroy the newly created channel on the VO, and the VO destroy channel interface parameters may include:

video output layer ID (0), video output channel number (1).

In the embodiment of the invention, when the video conference is finished, the channels of the position and the VO layer in the video processing subsystem VPSS are required to be unbinding, and the unbinding channels are removed on the VO layer, so that channel resources are saved.

Referring to fig. 2, another flowchart of a local video loop display method in a video conference according to an embodiment of the present invention is provided, where the method is applied to a terminal, and the terminal is used as a monitoring device to send a video data stream, and the method includes:

step 201: in a video conference, acquiring additional information of the monitoring device, wherein the additional information comprises: the method comprises the steps of dividing a screen mode and playing terminal information of video on each divided screen;

in the step, in the video conference process, when the terminal is used as the monitoring device to send video data, the information of the current monitoring device is acquired first, and the information may include: and in a split screen mode (such as two split screens, four split screens or eight split screens, and the like), obtaining how many video data are played on the screen of the monitoring terminal.

Acquiring information of each terminal played on the monitoring device, wherein the information of each terminal can comprise: the information of the stream channel number (simply understood as that each video is played on a certain split screen on the monitoring device), the number of the terminal device corresponding to the video, the number of the coding channel for playing the video, and the like is usually stored in json format, and the storage process is as follows:

step 202: when the video data stream to be transmitted is detected to comprise I frame data, adding the additional information into the I frame data;

In this step, the video data stream to be transmitted (the packet queue to be transmitted, i.e. the packet queue to be transmitted, etc.) is acquired first, and it is determined whether the video data stream to be transmitted includes I frame data, and if the video data stream to be transmitted includes I frame data, the additional information is added to the I frame data. In this embodiment, the accessory information is exemplified by SEI information.

That is, when it is detected that the video data to be transmitted is I frame data, the SEI information is inserted at the end of the I frame data, and the rule of inserting the SEI information is shown in table 1, but the present invention is not limited thereto in practical application:

TABLE 1

The I frame is also called an intra-frame coding frame, is an independent frame with all information, can be independently decoded without referring to other video images, and can be simply understood as a static picture. The first frame in the video sequence is always an I-frame, since it is a key frame.

Step 203: and the I frame data added with the additional information is put into the video data stream to be sent, so that the terminal receiving the video data stream can realize loop display of the local video.

In the step, I frame data inserted with SEI information is put into a video data stream (or a packet sending queue) for sending, so that a terminal for watching the video data stream can realize loop display of local video.

In the embodiment of the invention, in the video service of the video network, when the terminal is used as the monitoring and broadcasting equipment to send video data, additional information (such as SEI information and the like) is inserted when I frame data is sent, and the additional information comprises the current split screen mode and information of the display terminal on each split screen, so that the terminal for watching the video data stream can realize loop display of local video, namely, the video picture of the terminal is attached to the monitoring and broadcasting video picture, thereby avoiding the problem that the picture is not synchronous when the current terminal monitors the video picture of the terminal in the monitoring and broadcasting video picture due to delay in video transmission, reducing transmission delay and improving user experience.

Referring to fig. 3, an application example diagram of a local video loop display method in a video conference according to an embodiment of the present invention is provided, where in the embodiment, the video conference is exemplified by a video networking conference, but the application is not limited thereto. When the terminal is used as the monitoring and broadcasting equipment to send video data, the method comprises the following steps:

step 301: in a video networking conference, acquiring information of a participant terminal;

such as two participant terminals, or three participant terminals, or more participant terminals, etc.

Step 302: judging whether the role type of each reference terminal is monitoring equipment, if so, executing step 303; otherwise, go to step 306;

in this embodiment, the judgment is made according to the participant terminal information, and if it is judged that the current participant terminal is the speaker, the current participant terminal is used as the monitoring device to transmit video data.

Step 303: judging whether the video data stream to be transmitted by the monitoring device comprises I frame data or not, if so, executing step 304; otherwise, go to step 306;

step 304: acquiring SEI information of monitoring equipment, and inserting the SEI information into the I frame data;

step 305: transmitting the video data stream after the SEI information is inserted;

step 306: the video data stream is processed according to the existing service.

Referring to fig. 4, another application example diagram of a local video loop display method in a video conference according to an embodiment of the present invention is shown; the video conference of this embodiment is still exemplified by a video networking conference, and the method includes:

step 401: in a video networking conference, acquiring terminal information of a participant;

in this step, there may be two participant terminals, or three participant terminals, or more participant terminals, or the like. The present embodiment is not limited.

Step 402: judging whether the role type of each participant terminal is a common participant and whether the participant terminal is a single screen for watching the video of the monitoring and broadcasting equipment, if so, executing a step 403; otherwise, go to step 406;

step 403: analyzing the received video data stream to obtain an analysis result;

step 404: judging whether the analysis result comprises I frame data or not, if so, executing step 405; otherwise, execute step 406;

step 405: judging whether SEI information is included in the I frame data, if not, executing step 406; if yes, go to step 407;

in the step, if the I frame data stream is judged to be included, whether H264 or H265 is acquired, then the I frame data meeting the condition is found by filtering from the received video data stream according to the initial code+NAL header (for example, the H264 filtering condition is 00 00 00 01 06 00), namely, the I frame data is indicated to include SEI information, and the subsequent data is analyzed according to SEI information rules: SEI payload content (monitoring device information).

Step 406: processing according to the existing service; i.e. the video data stream is processed according to the existing service.

Step 407: determining whether a local loop display processing thread exists, and if not, executing step 408: otherwise, go to step 409;

Step 408: creating a local loop display processing thread, and then executing step 409;

step 409: the acquired SEI information is sent to the local loop display service processing thread for processing;

step 410: analyzing the received SEI payload content (monitoring and broadcasting equipment information) information by a local video loop display service processing thread to acquire the equipment number of the current terminal;

step 411: and circularly comparing the device number of the current terminal with each channel information in the monitoring device, and judging whether the number (terminal_number) of each channel information is consistent with the number of the current terminal device or not: if so, then step 412 is performed: otherwise: step 417 is performed:

step 412: judging whether the current terminal video is in the video of the monitoring device, if so, executing step 413: otherwise, go to step 417;

step 413: according to parameters such as a split screen mode, a stream channel number, screen resolution and the like, the position of the local video loop display is calculated:

for example, the split screen mode of the monitoring and broadcasting device is two split screens (left and right display):

the current terminal obtains the current terminal display allocation rate 1920 x 1080 when the current terminal has the channel number 0 (the subscript starts from 0, i.e. on the first screen of the monitoring device), and the position of the local video loop display is:

X＝0，Y＝1080/4，width＝1920/2，height＝1080/2

If the current channel number of the terminal on the monitoring device is 1 (i.e. on the second screen), the local video loop display is located at the following position:

X＝1920/2，Y＝1080/4，width＝1920/2，height＝1080/2

for another example, the split screen mode of the monitoring and broadcasting device is a four-split screen (grid):

the current channel number of the terminal on the monitoring device is 0, and then the position of the local video loop display is:

X＝0，Y＝0，width＝1920/2，height＝1080/2

the current channel number of the terminal on the monitoring device is 1, and then the position of the local video loop display is:

X＝1920/2，Y＝0，width＝1920/2，height＝1080/2

the current channel number of the terminal on the monitoring device is 2, and then the position of the local video loop display is:

X＝0，Y＝1080/2，width＝1920/2，height＝1080/2

the current channel number of the terminal on the monitoring device is 3, and then the position of the local video loop display is:

X＝1920/2，Y＝1080/2，width＝1920/2，height＝1080/2

it should be noted that, the split screen mode in this embodiment may be other modes, and the local video loop display position may be calculated by a corresponding method.

Step 414: acquiring an ID number corresponding to a video output layer (VO) used when the current terminal equipment outputs a video;

for example, 3 video output layers are supported on the chip of the current terminal device, the ID numbers are 0/1/2, and the ID of the video output layer used by the current device is 0.

Step 415: and a channel is newly created on a video output layer (VO) through a video output channel creation interface provided by the terminal chip, and the channel is used for local video loop display.

For example, the current terminal device is in a single-screen mode display, the original service creates a channel 0 on the video output layer 0 for displaying the video sent by the monitoring device, and at this time, a channel number 1 is newly created to be used as a local video loop for displaying.

Step 416: and acquiring the group ID and the channel number of the local video source in the video processing subsystem VPSS, and binding the group ID and the channel number in the VPSS to the newly created VO channel through a system binding interface provided by the terminal chip.

After binding, the data generated by the data source will be automatically sent to the recipient, for example: the local video data collected by the current terminal is output through a channel 1 of a decoding module VDEC, a video hardware decoding interface is provided, and a video decoding function is realized), and the local video data is bound with a VPSS (virtual private network) through a system binding interface and is bound in a No. 0 channel with the VPSS group ID of 64.

That is, after the binding is completed, the VPSS will send the local video source to the VO for outputting on the terminal device, and the newly created VO channel 1 displays the local video source and sticks to the current terminal picture in the monitored video picture.

Step 417: detecting whether the local video loop display is turned on, if so, executing step 418; otherwise, go to step 419;

In this step, when it is determined that the number (terminal_number) of each channel information is inconsistent with the number of the current terminal device, it is indicated that the current terminal does not play in the monitoring device, and it is necessary to continuously detect whether the local video loop display is turned on.

Step 418: unbinding and destroying the detected local video loop display channel;

in the step, the channels of the position and the VO layer in the VPSS are unbinding, and the unbinding channels are removed from the VO layer;

step 419: no treatment was performed.

In this embodiment, when the terminal device is both the monitoring device and the speaker of the chairperson in the conference, the SEI information is used to assist in judging the above application scenario, and when the SEI information is identified as the terminal of the terminal device, the terminal device creates a channel and directly pastes the video stream of the terminal device to the monitored picture. Meanwhile, the terminal equipment is also provided with a picture acquisition module for acquiring pictures of the conference.

In the embodiment of the invention, in the video service of the video network, when the terminal equipment watches the monitor equipment picture and the monitor picture contains the current terminal equipment picture, the local video is directly acquired and the output channel is created and attached to the own picture in the monitor video, so that the problem of picture asynchronism when the current terminal watches the own video in the monitor picture due to delay of the monitor equipment in video transmission is avoided, and the user experience is improved.

It should be noted that, for simplicity of description, the method embodiments are shown as a series of acts, but it should be understood by those skilled in the art that the present disclosure is not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred embodiments, and that the acts are not necessarily required for the present invention.

Fig. 5 is a block diagram of a local video loop display device in a video conference according to an embodiment of the present invention. The device is applied to a terminal, and when the terminal watches the video of the monitoring and broadcasting equipment through a single screen and the video displayed by the monitoring and broadcasting equipment comprises the video of the terminal, the device comprises: an acquisition module 501, a determination module 502, a creation module 503, a binding module 504, and a loop display module 505, wherein,

an obtaining module 501, configured to obtain, in a video conference, I frame data sent by the monitoring device, where the I frame data includes: monitoring additional information of the broadcasting equipment;

a determining module 502, configured to determine, according to the additional information of the monitoring device, a location where a local video loop of the terminal is displayed;

A creating module 503, configured to newly create a channel on a local video output VO layer of the terminal, where the channel is used for the local video loop display;

a binding module 504, configured to bind the position of the local video in the video processing subsystem VPSS with the channel of the VO layer;

and the loop display module 505 is configured to implement loop display of the local video through the channels bound by the binding module.

Optionally, in another embodiment, based on the foregoing embodiment, the determining module includes: a split screen position determining module and a loop display position determining module, wherein,

Optionally, in another embodiment, based on the foregoing embodiment, the split-screen position module includes:

Optionally, in another embodiment, based on the foregoing embodiment, the loop display position determining module includes:

Optionally, in another embodiment, based on the foregoing embodiment, the creating module includes:

Optionally, in another embodiment, based on the foregoing embodiment, the loop display module includes:

Optionally, in another embodiment, based on the above embodiment, the binding module includes:

Optionally, the method further comprises:

Optionally, in another embodiment, based on the above embodiment, the obtaining module includes

Referring to fig. 6, an embodiment of the present invention provides a local video loop display device in a video conference, where the device is applied to a terminal, and sends a video data stream as a monitoring device at the terminal, and the device includes: an acquisition module 601, an addition module 602 and a placement module 603, wherein,

an obtaining module 601, configured to obtain, in a video conference, additional information of the monitoring device, where the additional information includes: the split screen mode of the monitoring and broadcasting equipment and the terminal information of the video played on each split screen;

an adding module 602, configured to add the additional information to the I-frame data when it is detected that the video data stream to be sent includes the I-frame data;

And the inserting module 603 is configured to insert the I frame data added with the additional information into the video data stream and then send the I frame data, so that a terminal viewing the video data stream can realize loop display of a local video.

Referring also to fig. 7, an embodiment of the present invention provides a local video loop display system in a video conference, where the system at least includes: a first terminal 701 and a second terminal 702, the first terminal 701 and the second terminal 702 being linked by a video conference; wherein the second terminal 702 may comprise a plurality of terminal devices; wherein the first terminal is used as a monitoring and broadcasting device to send video data stream, the second terminal is used as a participant, and the display mode is that when the video of the monitoring and broadcasting device is watched by a single screen,

the first terminal 701 is configured to obtain, in a video conference, additional information of the monitoring device, where the additional information includes: the split screen mode of the monitoring and broadcasting equipment and the terminal information of the video played on each split screen; and adding the additional information to the I frame data when the video data stream to be transmitted is detected to include the I frame data; the I frame data added with the additional information is put into the video data stream and then sent to the second terminal;

The second terminal 702 is configured to, when receiving a video data stream sent by the first terminal, obtain I frame data from the video data stream, obtain additional information of a monitoring device from the I frame data, determine a location where a local video loop is displayed according to the additional information of the monitoring device, and create a channel on the local video output VO layer, where the channel is used for the local video loop display; binding the position of the local video in a video processing subsystem VPSS with a channel of the VO layer, and realizing loop display of the local video through the bound channel.

Optionally, an embodiment of the present invention further provides an electronic device, including:

a processor;

a memory for storing the processor-executable instructions;

Optionally, an embodiment of the present invention further provides a computer readable storage medium, where instructions in the computer readable storage medium, when executed by a processor of an electronic device, enable the electronic device to perform a local video loop display method in a video networking service as described above.

Optionally, an embodiment of the present invention further provides a computer program product, including a computer program or an instruction, where the computer program or the instruction implement the local video loop display method in the video networking service of any one of claims 1 to 10 when executed by a processor of an electronic device.

The specific manner in which the various modules perform the operations in the apparatus of the above embodiments have been described in detail in connection with the embodiments of the method, and will not be described in detail herein.

The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.

Fig. 8 is a block diagram of an electronic device 800 provided by an embodiment of the invention. For example, the electronic device 800 may be a mobile terminal or a server, and in the embodiment of the present invention, the electronic device is taken as an example of the mobile terminal. For example, electronic device 800 may be a mobile phone, computer, digital broadcast terminal, messaging device, game console, tablet device, medical device, exercise device, personal digital assistant, or the like.

Referring to fig. 8, an electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814, and a communication component 816.

The processing component 802 generally controls overall operation of the electronic device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interactions between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

The memory 804 is configured to store various types of data to support operations at the device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

The power supply component 806 provides power to the various components of the electronic device 800. The power components 806 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the electronic device 800.

The multimedia component 808 includes a screen between the electronic device 800 and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or slide action, but also the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and/or a rear camera. The front camera and/or the rear camera may receive external multimedia data when the device 800 is in an operational mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 further includes a speaker for outputting audio signals.

The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be a keyboard, click wheel, buttons, etc. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.

The sensor assembly 814 includes one or more sensors for providing status assessment of various aspects of the electronic device 800. For example, the sensor assembly 814 may detect an on/off state of the device 800, a relative positioning of the components, such as a display and keypad of the electronic device 800, the sensor assembly 814 may also detect a change in position of the electronic device 800 or a component of the electronic device 800, the presence or absence of a user's contact with the electronic device 800, an orientation or acceleration/deceleration of the electronic device 800, and a change in temperature of the electronic device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 816 is configured to facilitate communication between the electronic device 800 and other devices, either wired or wireless. The electronic device 800 may access a wireless network based on a communication standard, such as WiFi, an operator network (e.g., 2G, 3G, 4G, or 5G), or a combination thereof. In one exemplary embodiment, the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.

In an embodiment, the electronic device 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the local video loop display method in the video networking service described above.

In an embodiment, a computer readable storage medium is provided, which when executed by a processor of an electronic device, causes the electronic device 800 to perform the above-described local video loop display method in a video networking service. For example, the computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

In an embodiment, a computer program product is also provided, including a computer program or instructions, which when executed by the processor 820 of the electronic device 800, cause the electronic device 800 to perform the above-described local video loop display method in a video networking service.

Fig. 9 is a block diagram of an apparatus 900 for local video loop back display in a video networking service according to an embodiment of the present invention. For example, apparatus 900 may be provided as a server. Referring to FIG. 9, apparatus 900 includes a processing component 922 that further includes one or more processors, and memory resources represented by memory 932, for storing instructions, such as applications, executable by processing component 922. The application programs stored in memory 932 may include one or more modules that each correspond to a set of instructions. Further, processing component 922 is configured to execute instructions to perform the above-described methods.

The apparatus 900 may also include a power component 926 configured to perform power management of the apparatus 900, a wired or wireless network interface 950 configured to connect the apparatus 900 to a network, and an input output (I/O) interface 958. The device 900 may operate based on an operating system stored in memory 932, such as Windows Server, mac OS XTM, unixTM, linuxTM, freeBSDTM, or the like.

Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.

It is to be understood that the invention is not limited to the precise arrangements and instrumentalities shown in the drawings, which have been described above, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

Claims

1. The method is characterized in that the method is applied to a terminal, and when the terminal is used as a participant and a single screen is used for watching a video of a monitoring device, the video of the monitoring device comprises the video of the terminal, the method comprises the following steps:

and realizing loop display of the local video through the bound channel.

2. The method for displaying a local video loop in a video conference according to claim 1, wherein determining a location of the local video loop of the terminal according to the additional information of the monitoring device comprises:

3. The method for displaying local video loops in a video conference according to claim 2, wherein determining the split screen position of the terminal in the monitor screen according to the information of the terminal displayed on each split screen in the additional information of the monitor screen comprises:

Acquiring the equipment number of the terminal;

4. The method for displaying a local video loop in a video conference according to claim 2, wherein the determining, according to the screen resolution of the monitoring device, the location of the local video loop of the terminal and the split screen mode in the additional information of the monitoring device includes:

5. The method for displaying a local video loop back in a video conference according to claim 1, wherein a channel is newly created on a local video output VO layer of the terminal, and the channel is used for displaying the local video loop back, and comprises:

6. The method for displaying local video loops in a video conference according to claim 1, wherein binding the local video position information in a video processing subsystem VPSS with the channel of the VO layer comprises:

7. The local video loop display method according to any one of claims 1 to 6, wherein in the video conference, I frame data sent by the monitoring device is acquired, the I frame data including: additional information of the monitoring device comprises

8. A local video loop display method in a video conference, wherein the method is applied to a terminal, and video data streams are sent at the terminal as a monitoring device, the method comprising:

9. An electronic device, comprising:

a processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the local video loop back display method in a video networking service as claimed in any one of claims 1 to 8.

10. A computer readable storage medium, wherein instructions in the computer readable storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the local video loop back display method in a video networking service of any one of claims 1 to 8.