WO2023246328A1

WO2023246328A1 - Video conference marking method and system, and terminal, server and storage medium

Info

Publication number: WO2023246328A1
Application number: PCT/CN2023/092221
Authority: WO
Inventors: 耿立华; 夏友祥; 马希通
Original assignee: 京东方科技集团股份有限公司
Priority date: 2022-06-24
Filing date: 2023-05-05
Publication date: 2023-12-28
Also published as: CN115118918A

Abstract

Provided in the embodiments of the present disclosure are a video conference marking method and system, and a terminal, a server and a storage medium. The method comprises: a first terminal outputting a video conference image, wherein the video conference image comprises a mark area defined by using a mark box; the first terminal receiving a mark input into the mark area; and the first terminal sending the mark to a server, such that the server sends the mark to a second terminal, and thus the second terminal displays a video conference image having the mark.

Description

Video conference marking method, system, terminal, server and storage medium

This disclosure claims priority to the Chinese patent application with application number 202210730439.4 and the invention title "Video Conference Marking Method, System, Terminal, Server and Storage Medium" submitted on June 24, 2022, the entire content of which is incorporated by reference. in this disclosure.

Technical field

The present disclosure relates to the field of video conferencing, and in particular to a video conferencing marking method, system, terminal, server and storage medium.

Background technique

In a video conference, participants can share their screen or files as a sharer, and other people can see the content shared by the sharer in real time.

Under normal circumstances, only the sharer can mark the shared content. This type of meeting is more suitable for the sharer to share content one-way with other people, but is not suitable for discussion and interaction among multiple participants.

Contents of the invention

Embodiments of the present disclosure provide a video conference marking method, system, terminal, server and storage medium to solve the problem in related technologies that only the sharer can mark, making it unsuitable for multiple participants to discuss and interact. The technical solutions are as follows:

In a first aspect, a video conference marking method is provided, and the method includes:

The first terminal outputs a video conference image, the video conference image including a mark area defined using a mark frame;

The first terminal receives the mark input in the mark area;

The first terminal sends the mark to the server, so that the server sends the mark to the second terminal, so that the second terminal displays the video conference image with the mark.

Optionally, the first terminal outputs video conference images, including:

Get the mark area setting information;

The mark frame is drawn based on the mark area setting information to output the video conference image with the mark area.

Optionally, the mark area setting information includes at least one of the following parameters:

The number of mark areas, the position of each mark area, the shape of each mark area, the size of each mark area, and the border attributes of each mark area.

Optionally, the video conference image further includes a sharing area, where the sharing area refers to an area where the first terminal shares the picture provided by the first sharer;

The marking area is located within the shared area, or the marking area is located outside the shared area.

Optionally, when the marked area is located outside the sharing area, the marked area has the function of sharing the picture provided by the second sharer.

Optionally, when the first terminal is the initiator of the video conference,

The method also includes:

Obtain a mark area permission setting instruction, which is used to indicate the mark area usage rights of each terminal participating in the conference;

Send the mark area permission setting instruction to the server, so that the server controls the use rights of the mark area by each terminal participating in the conference.

Optionally, the usage rights include at least one of the following:

View permissions, mark permissions.

Optionally, the first terminal sends the mark to the server, including:

Synthesize the marker into the video conference image;

Send the video conference image synthesized with the mark to the server;

or,

The mark and the association information between the mark and the image are sent to the server, so that the server synthesizes the mark into the video conference image.

In a second aspect, a video conference marking method is provided, and the method includes:

The server receives a mark sent by the first terminal, where the mark is input from a mark area defined by a mark frame in the video conference image output by the first terminal;

The server sends the mark to the second terminal, so that the second terminal displays the video conference image with the mark.

Optionally, the server sends the tag to the second terminal, including:

Synthesizing said markers into video conferencing images;

Send the video conference image synthesized with the mark to the second terminal;

or,

The mark and the association information between the mark and the image are sent to the second terminal, so that the second terminal synthesizes the mark into the video conference image.

Optionally, before the server sends the mark to the second terminal, the method further includes:

Determine the terminal with permission to view the marked area;

The server sends the tag to the second terminal, including:

In response to the second terminal being a terminal with viewing authority for the mark area, the mark is sent to the second terminal.

Optionally, before determining the terminal with the marking area viewing permission, the method further includes:

Receive a marking area permission setting instruction sent by the initiating end of the video conference, where the marking area permission setting instruction is used to indicate the marking area usage permissions of each terminal participating in the conference, and the usage permissions include viewing permissions.

Optionally, the usage rights also include marking rights, and the method further includes:

Generate a mark area permission message according to the mark area permission setting instruction;

A marking area authority message is sent to the second terminal to indicate whether the second terminal has marking authority.

Optionally, the usage rights also include marking rights, and the server sends the marking to the second terminal, including:

In response to the first terminal having tag authority, the tag is sent to the second terminal.

Optionally, the method also includes:

In response to the first terminal not having tag authority, the tag is discarded.

In a third aspect, a terminal is provided, the terminal including a processor and a memory;

Wherein, the memory is used to store computer programs;

The processor is configured to execute a computer program stored in the memory to implement the video conference marking method described in any one of the first aspects.

In a fourth aspect, a server is provided, the server including a processor and a memory;

Wherein, the memory is used to store computer programs;

The processor is configured to execute the computer program stored in the memory to implement the video conference marking method described in any one of the second aspects.

A fifth aspect provides a video conferencing system, which includes a terminal as described in the third aspect and a server as described in the fourth aspect.

In a sixth aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores Computer instructions are stored, and when the stored computer instructions are executed by the processor, they can implement the video conference marking method as described in either the first or second aspect.

The beneficial effects brought by the technical solutions provided by the embodiments of the present disclosure are:

In the embodiment of the present disclosure, a solution is proposed that allows each participant to mark or modify the shared content. By setting a marking area in the video conference image for users to mark, the mark is then transmitted to other terminals through the server. Display, so that each terminal can mark the screen, which solves the problem in related technologies that only the sharer can mark, making it unsuitable for discussion and interaction among multiple participants.

Description of the drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the drawings needed to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present disclosure. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without exerting creative efforts.

Figure 1 is a flow chart of a video conference marking method provided by an embodiment of the present disclosure;

Figure 2 is a schematic diagram of a mark provided by an embodiment of the present disclosure;

Figure 3 is a flow chart of a video conference marking method provided by an embodiment of the present disclosure;

Figure 4 is a flow chart of a video conference marking method provided by an embodiment of the present disclosure;

Figure 5 is a schematic interface diagram of a video conference provided by an embodiment of the present disclosure;

Figure 6 is a schematic interface diagram of another video conference provided by an embodiment of the present disclosure;

Figure 7 is a flow chart of a video conference marking method provided by an embodiment of the present disclosure;

Figure 8 is a flow chart of a video conference marking method provided by an embodiment of the present disclosure;

Figure 9 is a flow chart of a video conference marking method provided by an embodiment of the present disclosure;

Figure 10 is a schematic diagram of a permission setting menu provided by an embodiment of the present disclosure;

Figure 11 is a flow chart of a video conference marking method provided by an embodiment of the present disclosure;

Figure 12 is a flow chart of a video conference marking method provided by an embodiment of the present disclosure;

Figure 13 is a schematic structural diagram of a video conferencing system provided by an embodiment of the present disclosure;

Figure 14 is a block diagram of a terminal provided by an embodiment of the present disclosure;

Figure 15 is a block diagram of a server provided by an embodiment of the present disclosure;

Figure 16 is a schematic structural diagram of a computer device provided by an embodiment of the present disclosure.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present disclosure clearer, the embodiments of the present disclosure will be described in further detail below in conjunction with the accompanying drawings.

Figure 1 is a flow chart of a video conference marking method provided by an embodiment of the present disclosure. Referring to Figure 1, the method includes:

101: The first terminal outputs a video conference image, and the video conference image includes a mark area defined by a mark frame.

The first terminal is any terminal participating in the video conference. The first terminal participates in the video conference through a video conferencing application or a video conferencing web page. Taking the video conferencing application as an example, the first terminal outputs the video conference image through the video conferencing application.

The marking box is a pattern drawn in a video conferencing application, and the area within the marking box is a marking area, which can be used for marking.

102: The first terminal receives the mark input in the mark area.

The video conference image output by the video conferencing application includes a mark area. The user can mark the mark area through tools in the video conferencing application, such as a brush tool, so that the terminal receives the mark input by the user.

In addition, the mark can also be in the form of text input or other forms. The text input can be handwritten with a brush or input through a keyboard. This disclosure does not limit this.

103: The first terminal sends the mark to the server, so that the server sends the mark to the second terminal, so that the second terminal displays the video conference image with the mark.

When the terminal sends the mark, it actually sends the mark information, such as the coordinates of each point on the mark and the order in which the points are formed, as well as the attributes of the mark, such as color, thickness, line type, etc.

FIG. 2 is a schematic diagram of a mark provided by an embodiment of the present disclosure. Referring to FIG. 2 , the line thickness and color of the marks of different participants participating in the video conference may be the same or different. For example, the mark thickness of participant A and participant B is different, and the mark line type of participant B and participant C is different.

Wherein, the second terminal and the first terminal are different terminals.

In the embodiment of the present disclosure, a solution is proposed that allows each participant to mark or modify the shared content. By setting a marking area in the video conference image for users to mark, the mark is then transmitted to other terminals through the server. display, so that each terminal can realize the screen Marking solves the problem in related technologies that only the sharer can mark, making it unsuitable for discussion and interaction among multiple participants.

Figure 3 is a flow chart of a video conference marking method provided by an embodiment of the present disclosure. Referring to Figure 3, the method includes:

201: The server receives the mark sent by the first terminal. The mark is input from the mark area defined by the mark box in the video conference image output by the first terminal.

202: The server sends the mark to the second terminal, so that the second terminal displays the video conference image with the mark.

Wherein, the second terminal and the first terminal are different terminals.

Figure 4 is a flow chart of a video conference marking method provided by an embodiment of the present disclosure. Referring to Figure 4, the method includes:

301: The first terminal outputs a video conference image, and the video conference image includes a mark area defined by a mark frame.

Exemplarily, step 301 may include:

Get the mark area setting information;

Draw a mark frame based on the mark area setting information to output a video conference image with a mark area.

By obtaining the setting information of the marking area, and drawing the marking frame according to the setting information of the marking area, the display of the marking area is realized.

Here, when the first terminal is the initiator of the video conference (that is, the conference administrator), the way to obtain the marking area setting information may be to receive the marking area setting instructions input by the user through the marking area setting function in the video conferencing application, The mark area setting command provides mark area setting information. That is, the initiator of the video conference can delimit a markable area. In addition, the first terminal can also send the mark area setting instruction to the server.

When the first terminal is only a participant in the video conference, the method of obtaining the marking area setting information may be: Receive a mark area setting instruction sent by the server, and the mark area setting instruction provides mark area setting information.

Exemplarily, the mark area setting information includes at least one of the following parameters:

For example, the number of marked areas ranges from 1 to N, and N is a positive integer greater than 1. The value of N can be determined based on terminal performance, network speed, etc. The better the terminal performance, the faster the network speed, then the value of N Can be bigger.

The setting of the marking area is achieved through the above setting parameters of the marking area, in which the border attributes can include color, thickness, line type, whether to hide, etc.

Here, the hidden border of the mark area means that the border is hidden when there is no operation, and the border is displayed when there is an operation. When the border of the marked area is hidden, only the operation focus is operated in the marked area, such as the mouse moves or clicks in the marked area, and the touchpad touches the marked area, the border of the marked area will appear. If it exceeds a certain time (for example, 3 seconds) without further operation, the border of the marked area disappears.

Figure 5 is a schematic interface diagram of a video conference provided by an embodiment of the present disclosure. Referring to Figure 5, the number of marking areas can be multiple, for example, 3. The positions of the three marking areas are isolated from each other, and the shapes are all rectangular, where, Marking areas B and C are the same size, and marking area A is different in size. Of course, what is shown in Figure 5 is only an example of the marking area and is not a limitation on the marking area.

Exemplarily, the video conference image also includes a sharing area, which refers to an area where the first terminal shares the picture provided by the first sharer.

As shown in Figure 5, the marked area is located in the shared area. At this time, the size of each shared area cannot exceed the shared area, and different shared areas do not intersect with each other.

FIG. 6 is a schematic interface diagram of another video conference provided by an embodiment of the present disclosure. Referring to FIG. 6 , the mark area is located outside the shared area.

In the embodiment of the present disclosure, the marking area can be within the shared area or outside the shared area, and the setting is relatively flexible.

For example, when the marked area is located outside the shared area, the marked area has the function of sharing the picture provided by the second sharer. In addition to the shared area, the mark area can also realize content sharing in addition to marking. That is to say, during a video conference, multiple users can share at the same time.

The video conference initiator or authorized participants can display the content to be shared in the marked area, including pictures, videos, documents (such as PPT, WORD, EXCEL, etc.), and the shared content is only displayed in the fixed marked area. If the shared content is not displayed, the marking area can be displayed with a solid color background and can be used as a markable whiteboard.

In this case, the marked area is independent from other areas and does not have any dependencies or dependencies. The position, size, shape, etc. of the marking area can be fixed or freely set, and there is no restriction on this.

It should be noted that when the marked area is located within the Sharing Zone, the marked and shared zone conference video images can be sent separately or combined and sent together; when the marked area is outside the Shared Zone, the marked and shared zone conference video images can be sent together. Video images are sent separately. The mark and the conference video image in the mark area are sent separately or combined together for sending. That is, when it is later explained whether the mark and the conference video image are sent separately or combined and sent together, the conference video image may refer to the conference video image in the shared area, or the conference video image in the mark area.

Referring again to Figures 5 and 6, in addition to the sharing area and marking area, the video conference image also includes a chat area, a participant list display area, and other areas.

302: The first terminal receives the mark input in the mark area.

303: The first terminal sends the mark and the associated information between the mark and the image to the server; the server receives the mark sent by the first terminal and the associated information between the mark and the image. The mark is defined by a mark frame in the video conference image output from the first terminal. Entered in the mark area.

When the terminal sends the mark, it actually sends the mark information, such as the coordinates of each point on the mark, and the attributes of the mark, such as color, thickness, line type, etc.

In addition, the terminal also records the time when each point on each mark is generated, so that when synthesizing the mark and the video conference image, the mark and the video conference image can be synthesized at the same time.

Here, the association information between the mark and the image may be the time when each mark point is generated, or may be the number of the video conference image corresponding to the generation of each mark point.

304: The server composited the marker into the video conference image.

The server synthesizes the mark and the video conference image based on the association information between the mark and the image. For example, it synthesizes the marked point generated at the first time and the video frame with the same timestamp, so that when the terminal outputs the video conference image, the marked point is synthesized. Generation and modification can present dynamic effects.

For another example, the marked point and the video frame corresponding to the corresponding video conference image number are synthesized.

The video conference image (video frame) is provided by the sharer of the video conference, such as a third terminal. After receiving the mark uploaded by the first terminal and the video conference image uploaded by the third terminal, the server synthesizes the two, and then Transmit to the second terminal to synthesize the marked video conference image.

For another example, the first terminal is the sharer of the video conference, and the first terminal separately uploads the mark and the video conference image to the server.

305: The server sends the synthesized marked video conference image to the second terminal; the second terminal receives the synthesized marked video conference image.

Wherein, the second terminal and the first terminal are different terminals.

306: The second terminal outputs a synthesized marked video conference image.

In this embodiment of the present disclosure, after the first terminal transmits the mark to the server, the server synthesizes the mark into the video conference image and then transmits it to the second terminal, so that the second terminal can directly output the video conference image containing the mark. In this embodiment, the first terminal uploads the mark, the server is responsible for synthesizing the mark and the video conference image, and then sends the synthesized marked video conference image to the second terminal.

Figure 7 is a flow chart of a video conference marking method provided by an embodiment of the present disclosure. Referring to Figure 7, the method includes:

401: The first terminal outputs a video conference image, and the video conference image includes a mark area defined by a mark frame.

For details of this step, see step 301.

402: The first terminal receives the mark input in the mark area.

See step 302 for details of this step.

403: The first terminal sends the mark and the associated information between the mark and the image to the server; the server receives the mark sent by the first terminal and the associated information between the mark and the image. The mark is defined by a mark frame in the video conference image output from the first terminal. Entered in the mark area.

404: The server sends the tag and the association information between the tag and the image to the second terminal. The second terminal receives the tag sent by the server and the association information between the tag and the image.

Step 404 only sends the tag and the association information between the tag and the image, without synthesizing the tag into the video conference image.

405: The second terminal synthesizes the mark into the video conference image.

The second terminal synthesizes the mark and the video conference image based on the correlation information between the mark and the image, for example For example, the marked points generated at the first time are synthesized with the video frames with the same timestamp, so that when the terminal outputs the video conference image, the generation and modification of the marks can show a dynamic effect.

It is worth noting that if the second terminal is a sharer of the video conference, the second terminal can synthesize the mark into the locally generated video conference image.

If the second terminal is a participant in the video conference, the second terminal also needs to receive the video conference image sent by the server and then synthesize it.

406: The second terminal outputs the synthesized marked video conference image.

In this embodiment of the present disclosure, after the first terminal transmits the mark to the server, the server transmits the mark to the second terminal, so that the second terminal can synthesize the mark into the video conference image, and then output the video conference image containing the mark. In this embodiment, the first terminal uploads the mark, the server sends the mark to the second terminal, and then the second terminal performs mark and video conference image synthesis.

Figure 8 is a flow chart of a video conference marking method provided by an embodiment of the present disclosure. Referring to Figure 8, the method includes:

501: The first terminal outputs a video conference image, and the video conference image includes a mark area defined by a mark frame.

For details of this step, see step 301.

502: The first terminal receives the mark input in the mark area.

See step 302 for details of this step.

503: The first terminal will synthesize the mark into the video conference image.

In the embodiment of the present disclosure, the first terminal is a sharer of the video conference, so that the first terminal can directly synthesize the mark into the video conference image to be uploaded for uploading.

The first terminal synthesizes the mark and the video conference image according to the association information between the mark and the image. For example, the first terminal synthesizes the mark point generated at the first time and the video frame with the same time stamp, so that when the terminal outputs the video conference image, Markup generation and modification can provide dynamic effects.

504: The first terminal sends the synthesized marked video conference image to the server; the server receives the synthesized marked video conference image.

505: The server sends the synthesized marked video conference image to the second terminal; the second terminal receives the synthesized marked video conference image sent by the server.

506: The second terminal outputs a synthesized marked video conference image.

In the embodiment of the present disclosure, the first terminal transmits the synthesized marked video conference image to the server Finally, the server transmits the synthesized marked video conference image to the second terminal, so that the second terminal can directly output the marked video conference image. In this embodiment, the first terminal performs marking and synthesis of the video conference image, and then uploads the synthesized marked video conference image, and the server sends the synthesized marked video conference image to the second terminal.

Figure 9 is a flow chart of a video conference marking method provided by an embodiment of the present disclosure. Referring to Figure 9, the method includes:

601: The first terminal obtains a marking area permission setting instruction. The marking area permission setting instruction is used to indicate the marking area usage permissions of each terminal participating in the conference. The usage permissions include viewing permissions.

Here, the video conferencing application has a marking area permission setting function. When the first terminal is the initiator of the video conference, the user can input marking area permission setting instructions through the permission setting menu corresponding to the marking area permission setting function. That is, the initiator of the video conference can manage the permissions of the marked area.

Among them, the viewing permission (or visible permission) includes two situations: the terminal has the viewing permission and the terminal does not have the viewing permission. When the terminal has viewing permission, participants can see the content in the marked area. When the terminal does not have viewing permission, participants cannot see the marked content in the marked area.

Figure 10 is a schematic diagram of a permission setting menu provided by an embodiment of the present disclosure. Referring to Figure 10, the initiator of the video conference can separately set permissions for all members participating in the conference or for each participant. For example, each participant can set viewing permissions and marking permissions respectively. If selected, it means that they have the corresponding permissions.

Permissions can be set independently for each marked area. Each marked area corresponds to a permission setting menu, which is only displayed during setting and automatically hidden after the setting is completed. The permission setting menu of the marked area is only visible and operated by the initiator of the video conference. The initiator of the video conference has viewing permissions and marking permissions by default and does not need to be set.

602: The first terminal sends a marking area permission setting instruction to the server. The server receives the mark area permission setting instruction.

After receiving the instruction, the server can save the instruction, so that the terminal authority management can be performed based on the content in the instruction.

603: The first terminal sends a mark to the server; the server receives the mark sent by the first terminal, and the mark is input from the mark area defined by the mark frame in the video conference image output by the first terminal.

Here, the method of transmitting the mark between the first terminal and the server may refer to the corresponding steps in Figure 4, Figure 7 or Figure 8.

604: The server executes the mark area permission setting instruction to determine the terminal with the mark area viewing permission.

For example, referring to Figure 10, the terminals with viewing permissions at this time are participant A and participant B.

For example, after receiving the mark area permission setting instruction, the server can establish a permission indication table locally and set identification bits for various permissions of each terminal. For example, each terminal sets a viewing permission identification bit correspondingly, and 1 indicates that it has viewing permission. 0 indicates that there is no viewing permission, which facilitates the server to quickly determine whether the terminal has viewing permission.

605: The server sends the tag to the terminal with viewing permissions.

When the terminals with viewing permission are participant A and participant B, the server sends the tag to the terminals corresponding to participant A and participant B. At this time, the marks in the mark area can be displayed normally on the terminals of participant A and participant B, but the mark in the mark area cannot be displayed on participant C. At this time, the mark area can be displayed as blank.

Here, for the way of transmitting tags between the server and the terminal with viewing authority, please refer to the corresponding steps in Figure 4, Figure 7 or Figure 8.

In the embodiment of the present disclosure, the terminal sends a permission setting instruction to the server to indicate the viewing permission of each terminal, and the server sends a mark to the terminal with viewing permission to realize the management of viewing permission.

Figure 11 is a flow chart of a video conference marking method provided by an embodiment of the present disclosure. Referring to Figure 11, the method includes:

701: The first terminal obtains a marking area permission setting instruction. The marking area permission setting instruction is used to indicate the marking area usage permissions of each terminal participating in the conference. The usage permissions also include marking permissions.

Marking permission refers to whether participants can mark in the marking area. When the terminal has marking permission, participants can mark in the marking area. When the terminal does not have marking permission, participants cannot mark in the marking area. . When the viewing permission of a terminal is set to no viewing permission, the marking permission is automatically set to no marking permission.

When the viewing permission of a terminal is set to no viewing permission, the marking permission is automatically set to no marking permission.

Here the tag permissions can include tag adding permissions and tag modifying permissions. The mark adding permission refers to the permission to add marks in the mark area, and the mark modification permission refers to the permission to modify marks in the mark area. In the embodiment of the present disclosure, the mark adding permission and the mark modifying permission can be set at the same time. In other embodiments, the two can also be set separately.

For example, different terminals have different mark modification permissions. For example, the terminals of ordinary participants can only erase the content marked by themselves, while the conference initiator can erase all marked content. When modification (such as erasure) is performed, the location information of the modified mark will be uploaded to the server, and the server system will update the mark to other terminals based on the location information of the modified mark.

There are many ways to switch between marking and modifying operations, such as using different keys. Select the marking button to start marking, and select the modifying button to perform operations such as erasing.

Referring to Figure 10 again, in the terminal permission settings, in addition to setting viewing permissions, you can also set marking permissions.

702: The first terminal sends a mark area permission setting instruction to the server. The server receives the mark area permission setting instruction.

See step 602 for details of this step.

703: The server sends a marking area permission message to the second terminal to indicate whether the second terminal has marking permission; the second terminal receives the marking area permission message sent by the server.

704: The second terminal determines whether to provide tag and tag modification functions according to the tag area permission message.

For example, after receiving the marking area permission message, the second terminal can determine whether it has the functions of marking and marking modification, and if it has the above functions, provide the functions in the video conferencing application. If the above function is not available, the function will not be provided in the video conferencing application. For example, if this function is not provided, the brush in the marking area of the video conferencing application cannot be used, etc.

For participants, when they have marking permission, they can use peripherals (such as mouse, touchpad) to mark in the marking area. The marking method is writing (for example, click the left mouse button on the location that needs to be marked). key, move the mouse to draw the shape that needs to be marked, such as using the touch pad, press and hold the position that needs to be marked, and move to draw the shape that needs to be marked), the content of the mark (the location information of the mark) is passed through the participant's corresponding The network connected to the terminal is uploaded to the server (cloud), and the server distributes the tags to other participants.

In an embodiment of the present disclosure, the second terminal provides or does not provide the user with the functions of marking and marking modification according to whether it has marking authority.

In the embodiment of the present disclosure, by determining the permissions of each participant for each marked area, such as viewing, marking or modifying, etc., participants can enjoy the corresponding operation permissions of this area, which is more adaptable to various videos. Meeting scenes provide participants with a more convenient and smooth communication experience.

Figure 12 is a flow chart of a video conference marking method provided by an embodiment of the present disclosure. Referring to Figure 12, the method includes:

801: The first terminal obtains the marking area permission setting instruction. The marking area permission setting instruction is used to indicate parameters. The marking area usage rights of each terminal in the conference, and the usage rights also include marking rights.

See step 701 for details of this step.

802: The first terminal sends a marking area permission setting instruction to the server. The server receives the mark area permission setting instruction.

See step 602 for details of this step.

803: The first terminal sends a mark to the server; the server receives the mark sent by the first terminal, and the mark is input from the mark area defined by the mark frame in the video conference image output by the first terminal.

804: The server determines whether the first terminal has marking authority according to the marking area authority setting instruction.

For example, after receiving the marking area permission setting instruction, the server can establish a permission indication table locally and set identification bits for various permissions of each terminal. For example, each terminal sets a marking permission identification bit correspondingly, and 1 indicates that it has marking authority. 0 indicates that there is no marking permission, which facilitates the server to quickly determine whether the terminal has marking permission.

Similarly, the server can also receive tags sent by other terminals, determine the tag permissions of other terminals according to the tag area permission setting instructions, and then determine whether to issue the tag of the terminal.

805: In response to the first terminal having the tag authority, the server sends the tag to the second terminal; the second terminal receives the tag.

806: In response to the first terminal not having the marking authority, the server discards the marking.

In this embodiment of the present disclosure, the terminal provides users with the functions of tagging and tag modification, and allows any user to upload tags to the server. The server determines whether to issue tags to other terminals based on the permissions of each terminal. That is, there is a server to manage the tag permissions of each terminal.

Combining the processes of Figure 9 and Figure 12, it can be seen that after receiving the tag sent by terminal A, the server can first determine whether the terminal A has the tag authority. If it has the tag authority, it will send the tag of terminal A to other terminals. When sending the tag of terminal A to other terminals, it is necessary to determine which terminals have the viewing authority. After determining the terminals with the viewing authority, send the tag of terminal A to the terminal with the viewing authority.

Figure 13 is a schematic structural diagram of a video conferencing system provided by an embodiment of the present disclosure. Referring to Figure 13, the system includes a server S and multiple terminals. The server and the terminal are respectively used to execute the video conference marking method proposed above.

For example, multiple terminals correspond to multiple participants A to D, and there is one conference initiator among the multiple terminals, which is not limited by this disclosure.

The following description takes the example of participants A to C having viewing permissions, D not having viewing permissions, A to B having tags, and C to D not having tags.

As shown in Figure 13, both participants A and B can upload and receive tags, so that the A tag input by participant A and the B tag input by participant B are displayed in the tag area. Although participant C cannot mark, he has viewing permission. Therefore, the server will send the received A mark and B mark to participant C's terminal, so that the mark area of participant C's terminal also displays A. mark and B mark. Since participant D does not have viewing permission, the mark area is displayed as blank.

Figure 14 is a block diagram of a terminal provided by an embodiment of the present disclosure. As shown in Figure 14, the terminal includes: a hardware layer 1401, a driver layer 1402, an operating system 1403, and a video conferencing application 1404. The video conferencing application 1404 includes conventional modules for implementing video conferencing, such as user interface (UI) module 1441, audio and video codec module 1442, file/desktop sharing module 1443, conference management module 1444, terminal peripherals scheduling module 1445, Audio and video collection/playback module 1446 and communication protocol stack 1447. The above modules are common modules in video conferencing applications and will not be described in detail here.

In order to implement the marking function proposed by this disclosure, the video conference application 1404 also includes: a marking UI module 1448, a marking authority management module 1449, a marking area management module 1450, a marking location acquisition module 1451, a marking information overlay module 1452, and a marking information sending module. 1453 and mark information receiving module 1454.

Among them, the mark UI module 1448 is used to draw graphical interfaces such as mark areas and rights management menus on the video conference interface according to the user's needs. The tag authority management module 1449 is used at the video conference initiating end to determine the authority of each participant according to the administrator's settings, and transmits it to each participant terminal through the server. The participant terminal will issue the authority according to the administrator's settings. permissions to determine the participants' marking permissions and limit the participants' operations. The marking area management module 1450 is used to control the marking UI module to draw the marking area and control its display or hiding according to the received information such as the size and position of the marking area. The mark position acquisition module 1451 is used to obtain mark position information according to the mark operation. The pixel point in the upper left corner of the sharing area or the mark area is marked as (0, 0), and the pixel number increases from the (0, 0) point to the right and downward. When marking or erasing operations, the mark position acquisition module will obtain the coordinates and order of the selected pixels, that is, the coordinates and order of each point on the mark line. The mark information sending module 1453 is used to send mark area information such as pixel coordinates and sequence to the server according to the requirements of the communication protocol. The marking information receiving module 1454 is used to receive the position and sequence information of marking or erasing pixels and the marking area information sent by the server in accordance with the requirements of the communication protocol; the marking information overlay module 1452 is used to According to the position and sequence information of the received pixel mark or erasure, the mark is synthesized into the corresponding position in the video conference image, or the mark at the corresponding position is erased.

It should be noted that the mark information receiving module 1454 and the mark information overlay module 1452 in the terminal are optional modules. For example, when the mark and the video conference image are synthesized on the server, the mark information receiving module 1454 and the mark information may not be included in the terminal. Information overlay module 1452.

It should be noted that when the terminal provided in the above embodiment conducts a video conference, only the division of the above functional modules is used as an example. In actual applications, the above function allocation can be completed by different functional modules as needed, that is, the device The internal structure is divided into different functional modules to complete all or part of the functions described above. In addition, the terminal and video conference marking method embodiments provided in the above embodiments belong to the same concept. Please refer to the method embodiments for details of the implementation process, which will not be described again here.

Figure 15 is a block diagram of a server provided by an embodiment of the present disclosure. As shown in Figure 15, the server includes: server hardware 1501 (composed of single or multiple servers), operating system 1502, and video conferencing system 1503. The video conference system 1503 includes conventional modules for implementing video conferences, such as conference management service module 1531, streaming media service module 1532, audio and video codec service module 1533, file storage service module 1534, monitoring service module 1535, statistical analysis service module 1536, UI module 1537 and communication protocol stack 1538, etc.

In order to realize the marking function proposed by this disclosure, the video conferencing application 1503 also includes: a rights management service module 1539, an area management service module 1540, a marking overlay service module 1541, a marking information sending module 1542, and a marking information receiving module 1543.

Among them, the rights management service module 1539 is used to obtain the rights information of each participant and manage the rights of each participant's terminal. The mark overlay service module 1541 is used to use different overlay strategies for terminals with different permissions based on permission information. For example, if participant A does not have viewing permission, the mark will not be sent to participant A, and only the video conference image will be forwarded to A; For another example, if participant B has the marking permission, B's mark will be synthesized into the video conference image; for another example, if participant C has viewing permission, but does not have marking permission, C's mark will not be synthesized into the video conference image. on the image, but the tags of other participants with tag permission will be synthesized and sent to C. If the synthesis process is completed on the terminal, the server will only process the tag or erase information and forward it directly, and will not combine the tag and Video conferencing image synthesis. The area management service module 1540 is used to record and update information such as the coordinates and size of the marking area in real time, and forward it to each participant. Participants will establish marking areas on the terminal conference interface based on this information. The mark information sending module 1542 and the mark information receiving module 1543 are used to transmit marks, erasure positions and sequences. sequence information.

It should be noted that the mark overlay service module 1541 in the server is an optional module. For example, when marks and video conference images are synthesized on the terminal, the mark overlay service module 1541 may not be included in the server.

As shown in Figure 16, an embodiment of the present disclosure also provides a computer device 1600. The computer device 1600 is the aforementioned terminal or server. The computer device 1600 may be used to perform the video conference marking method provided in the above embodiments. Referring to Figure 16, the computer device 1600 includes: a memory 1601, a processor 1602 and a display component 1603. Those skilled in the art can understand that the structure of the computer device 1600 shown in Figure 16 does not constitute a limitation on the computer device 1600. Actual applications may include more or fewer components than shown, some combinations of components, or different component arrangements. in:

The memory 1601 can be used to store computer programs and modules. The memory 1601 can mainly include a program storage area and a data storage area, where the program storage area can store an operating system, at least one application program required for a function, etc. Memory 1601 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 1601 may also include a memory controller to provide the processor 1602 with access to the memory 1601 .

The processor 1602 executes various functional applications and data processing by running software programs and modules stored in the memory 1601 .

The display component 1603 is used to display images. The display component 1603 can include a display panel. Optionally, the display panel can be configured in the form of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode, organic light-emitting diode), etc. .

In an exemplary embodiment, a computer-readable storage medium is also provided. The computer-readable storage medium is a non-volatile storage medium. A computer program is stored in the computer-readable storage medium. When the computer-readable storage medium When the computer program in the medium is executed by the processor, it can execute the video conference marking method provided by the embodiment of the present disclosure.

In an exemplary embodiment, a computer program product is also provided. Instructions are stored in the computer program product. When the computer program product is run on a computer, it enables the computer to execute the video conference marking method provided by the embodiment of the present disclosure.

In an exemplary embodiment, a chip is also provided. The chip includes a programmable logic circuit and/or program instructions, and when the chip is run, it can execute the video conference marking method provided by the embodiment of the present disclosure.

Those of ordinary skill in the art can understand that all or part of the steps to implement the above embodiments can be completed by hardware, or can be completed by instructing relevant hardware through a program. The program can be stored in a computer-readable storage medium. The above-mentioned The storage media mentioned can be read-only memory, magnetic disks or optical disks, etc.

The above are only optional embodiments of the present disclosure and are not intended to limit the present disclosure. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present disclosure shall be included in the protection of the present disclosure. within the range.

Claims

A video conference marking method, characterized in that the method includes:

The first terminal outputs a video conference image, the video conference image including a mark area defined using a mark frame;

The first terminal receives the mark input in the mark area;

The first terminal sends the mark to the server, so that the server sends the mark to the second terminal, so that the second terminal displays the video conference image with the mark.
The method according to claim 1, characterized in that the first terminal outputs a video conference image, including:

Get the mark area setting information;

The mark frame is drawn based on the mark area setting information to output the video conference image with the mark area.
The method according to claim 2, characterized in that the mark area setting information includes at least one of the following parameters:

The number of mark areas, the position of each mark area, the shape of each mark area, the size of each mark area, and the border attributes of each mark area.
The method according to any one of claims 1 to 3, characterized in that the video conference image further includes a sharing area, and the sharing area refers to the area where the first terminal shares the picture provided by the first sharer;

The marking area is located within the shared area, or the marking area is located outside the shared area.
The method according to claim 4, characterized in that when the marked area is located outside the shared area, the marked area has the function of sharing the picture provided by the second sharer.
The method according to any one of claims 1 to 3, characterized in that the first terminal is the initiator of the video conference, and the method further includes:

Send a mark area permission setting instruction to the server, so that the server controls the use rights of each terminal participating in the conference to the mark area.
The method according to claim 6, characterized in that the usage rights include at least one of the following:

View permissions, mark permissions.
The method according to any one of claims 1 to 3, characterized in that the first terminal sends the mark to the server, including:

Synthesize the marker into the video conference image;

Send the video conference image synthesized with the mark to the server;

or,

The mark and the association information between the mark and the image are sent to the server, so that the server synthesizes the mark into the video conference image.
A video conference marking method, characterized in that the method includes:

The server receives a mark sent by the first terminal, where the mark is input from a mark area defined by a mark frame in the video conference image output by the first terminal;

The server sends the mark to the second terminal, so that the second terminal displays the video conference image with the mark.
The method according to claim 9, characterized in that the server sends the mark to the second terminal, including:

Synthesizing said markers into video conferencing images;

Send the video conference image synthesized with the mark to the second terminal;

or,

The mark and the association information between the mark and the image are sent to the second terminal, so that the second terminal synthesizes the mark into the video conference image.
The method according to claim 9 or 10, characterized in that, before the server sends the mark to the second terminal, the method further includes:

Determine the terminal with permission to view the marked area;

The server sends the tag to the second terminal, including:

In response to the second terminal being a terminal with viewing authority for the mark area, the mark is sent to the second terminal.
The method according to claim 11, characterized in that before determining the terminal with the marking area viewing authority, the method further includes:

Receive a marking area permission setting instruction sent by the initiating end of the video conference, where the marking area permission setting instruction is used to indicate the marking area usage permissions of each terminal participating in the conference, and the usage permissions include viewing permissions.
The method according to claim 12, characterized in that the use permission also includes marking permission, and the method further includes:

Generate a mark area permission message according to the mark area permission setting instruction;

A marking area authority message is sent to the second terminal to indicate whether the second terminal has marking authority.
The method according to claim 12, characterized in that the usage rights also include marking rights, and the server sends the marking to the second terminal, including:

In response to the first terminal having tag authority, the tag is sent to the second terminal.
The method of claim 14, further comprising:

In response to the first terminal not having tag authority, the tag is discarded.
A terminal, characterized in that the terminal includes a processor and a memory;

Wherein, the memory is used to store computer programs;

The processor is configured to execute the computer program stored in the memory to implement the video conference marking method described in any one of claims 1 to 8.
A server, characterized in that the server includes a processor and a memory;

Wherein, the memory is used to store computer programs;

The processor is configured to execute the computer program stored in the memory to implement the video conference marking method described in any one of claims 9 to 15.
A video conferencing system, characterized in that the video conferencing system includes a terminal as claimed in claim 16 and a server as claimed in claim 17.
A computer-readable storage medium, characterized in that computer instructions are stored in the computer-readable storage medium, and when the stored computer instructions are executed by a processor, the video described in any one of claims 1 to 8 can be realized. A method for marking a conference, or a method for marking a video conference as described in any one of claims 9 to 15.