CN115118918A - Video conference marking method, system, terminal, server and storage medium - Google Patents

Video conference marking method, system, terminal, server and storage medium Download PDF

Info

Publication number
CN115118918A
CN115118918A CN202210730439.4A CN202210730439A CN115118918A CN 115118918 A CN115118918 A CN 115118918A CN 202210730439 A CN202210730439 A CN 202210730439A CN 115118918 A CN115118918 A CN 115118918A
Authority
CN
China
Prior art keywords
mark
terminal
video conference
area
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210730439.4A
Other languages
Chinese (zh)
Inventor
耿立华
夏友祥
马希通
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BOE Technology Group Co Ltd
Original Assignee
BOE Technology Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BOE Technology Group Co Ltd filed Critical BOE Technology Group Co Ltd
Priority to CN202210730439.4A priority Critical patent/CN115118918A/en
Publication of CN115118918A publication Critical patent/CN115118918A/en
Priority to PCT/CN2023/092221 priority patent/WO2023246328A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/50Image enhancement or restoration by the use of more than one image, e.g. averaging, subtraction
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30204Marker

Abstract

The embodiment of the disclosure provides a video conference marking method, a video conference marking system, a video conference marking terminal, a video conference marking server and a video conference marking storage medium. The method comprises the following steps: a first terminal outputting a video conference image including a marker region defined using a marker frame; the first terminal receives the mark input in the mark area; and the first terminal sends the mark to a server so that the server sends the mark to a second terminal, and the second terminal displays the video conference image with the mark.

Description

Video conference marking method, system, terminal, server and storage medium
Technical Field
The present disclosure relates to the field of video conferences, and in particular, to a method, a system, a terminal, a server, and a storage medium for marking a video conference.
Background
In the video conference, participants can share screens or files as sharers, and other people can see the content shared by the sharers in real time.
Generally, only the sharers can mark the shared content, and the conference is suitable for the sharers to share the content to other persons in one way and is not suitable for discussion interaction among a plurality of participants.
Disclosure of Invention
The embodiment of the disclosure provides a marking method, a marking system, a terminal, a server and a storage medium for a video conference, and aims to solve the problem that only sharers can mark in the related art, so that the related art is not suitable for discussion and interaction of a plurality of participants. The technical scheme is as follows:
in a first aspect, a method for marking a video conference is provided, where the method includes:
a first terminal outputting a video conference image including a marker region defined using a marker frame;
the first terminal receives the mark input in the mark area;
and the first terminal sends the mark to a server so that the server sends the mark to a second terminal, and the second terminal displays the video conference image with the mark.
Optionally, the first terminal outputs a video conference image, including:
acquiring mark area setting information;
drawing the mark frame based on the mark zone setting information to output the video conference image with the mark zone.
Optionally, the flag setting information includes at least one of the following parameters:
the number of mark areas, the position of each mark area, the shape of each mark area, the size of each mark area, and the border property of each mark area.
Optionally, the video conference image further includes a shared area, where the shared area refers to an area where the first terminal shares a picture provided by a first sharer;
the mark area is located in the shared area, or the mark area is located outside the shared area.
Optionally, when the mark area is located outside the sharing area, the mark area has a function of sharing a picture provided by a second sharer.
Optionally, when the first terminal is an initiating terminal of the video conference,
the method further comprises the following steps:
acquiring a mark area authority setting instruction, wherein the mark area authority setting instruction is used for indicating the mark area use authority of each terminal participating in the conference;
and sending the mark area permission setting instruction to the server so that the server controls the use permission of each terminal participating in the conference to the mark area.
Optionally, the usage rights include at least one of:
viewing authority and marking authority.
Optionally, the sending, by the first terminal, the tag to a server includes:
synthesizing the marker into the video conference image;
sending the video conference image synthesized with the mark to the server;
alternatively, the first and second electrodes may be,
and sending the mark and the associated information of the mark and the image to a server so that the server synthesizes the mark into the video conference image.
In a second aspect, a method for tagging a video conference is provided, the method comprising:
the server receives a mark sent by a first terminal, wherein the mark is input from a mark area defined by a mark frame in a video conference image output by the first terminal;
and the server sends the mark to a second terminal, so that the second terminal displays the video conference image with the mark.
Optionally, the sending, by the server, the flag to the second terminal includes:
synthesizing the marker into a video conference image;
sending the video conference image synthesized with the mark to the second terminal;
alternatively, the first and second electrodes may be,
and sending the mark and the associated information of the mark and the image to the second terminal so that the second terminal synthesizes the mark into a video conference image.
Optionally, before the server sends the flag to the second terminal, the method further includes:
determining a terminal with a mark area viewing authority;
the server sends the mark to a second terminal, and the method comprises the following steps:
and responding to the fact that the second terminal is a terminal with a mark area viewing authority, and sending the mark to the second terminal.
Optionally, before the determining the terminal having the viewing right of the mark area, the method further includes:
receiving a mark area permission setting instruction sent by an initiating terminal of a video conference, wherein the mark area permission setting instruction is used for indicating mark area use permissions of all terminals participating in the conference, and the use permissions comprise viewing permissions.
Optionally, the usage right further includes a marking right, and the method further includes:
generating a mark area authority message according to the mark area authority setting instruction;
and sending a mark zone authority message to the second terminal to indicate whether the second terminal has mark authority or not.
Optionally, the usage right further includes a mark right, and the server sends the mark to the second terminal, including:
and responding to the first terminal having the marking authority, and sending the mark to the second terminal.
Optionally, the method further comprises:
and in response to the first terminal not having the marking authority, discarding the mark.
In a third aspect, a terminal is provided that includes a processor and a memory;
wherein the memory is used for storing a computer program;
the processor is configured to execute the computer program stored in the memory to implement the video conference marking method according to any one of the first aspect.
In a fourth aspect, a server is provided that includes a processor and a memory;
wherein the memory is used for storing a computer program;
the processor is configured to execute the computer program stored in the memory to implement the video conference marking method according to any one of the second aspect.
In a fifth aspect, a video conference system is provided, the video conference system comprising the terminal according to the third aspect and the server according to the fourth aspect.
In a sixth aspect, there is provided a computer readable storage medium having stored thereon computer instructions that, when executed by a processor, are capable of implementing a method of tagging a video conference as claimed in any one of the first or second aspects.
The technical scheme provided by the embodiment of the disclosure has the following beneficial effects:
in the embodiment of the disclosure, a scheme for enabling each participant to mark or modify shared content is provided, a mark area is set in a video conference image for a user to mark, and the marked mark area is transmitted to other terminals through a server to be displayed, so that each terminal can mark a picture, and the problem that only the participant can mark to cause unsuitability for discussion and interaction of a plurality of participants in the related art is solved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present disclosure, and it is obvious for those skilled in the art to obtain other drawings based on the drawings without creative efforts.
Fig. 1 is a flowchart of a method for marking a video conference according to an embodiment of the present disclosure;
FIG. 2 is a schematic illustration of a marking provided by an embodiment of the present disclosure;
fig. 3 is a flowchart of a method for marking a video conference according to an embodiment of the present disclosure;
fig. 4 is a flowchart of a method for marking a video conference according to an embodiment of the present disclosure;
fig. 5 is a schematic interface diagram of a video conference provided by an embodiment of the present disclosure;
FIG. 6 is a schematic interface diagram of another video conference provided by an embodiment of the present disclosure;
fig. 7 is a flowchart of a method for marking a video conference according to an embodiment of the present disclosure;
fig. 8 is a flowchart of a method for marking a video conference according to an embodiment of the present disclosure;
fig. 9 is a flowchart of a method for marking a video conference according to an embodiment of the present disclosure;
FIG. 10 is a diagram illustrating a rights setting menu provided by an embodiment of the present disclosure;
fig. 11 is a flowchart of a method for marking a video conference according to an embodiment of the present disclosure;
fig. 12 is a flowchart of a method for marking a video conference according to an embodiment of the present disclosure;
fig. 13 is a schematic structural diagram of a video conference system provided in an embodiment of the present disclosure;
fig. 14 is a block diagram of a terminal according to an embodiment of the present disclosure;
fig. 15 is a block diagram of a server provided by an embodiment of the present disclosure;
fig. 16 is a schematic structural diagram of a computer device provided in an embodiment of the present disclosure.
Detailed Description
To make the objects, technical solutions and advantages of the present disclosure more apparent, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.
Fig. 1 is a flowchart of a method for marking a video conference according to an embodiment of the present disclosure. Referring to fig. 1, the method includes:
101: the first terminal outputs a video conference image including a marker region defined using a marker box.
Wherein the first terminal is any terminal participating in the video conference. The first terminal participates in the video conference through the video conference application or the video conference webpage, and outputs a video conference image through the video conference application by taking the video conference application as an example.
The marking frame is a pattern drawn in a video conference application, and an area in the marking frame is a marking area and can be used for marking.
102: the first terminal receives a mark input in the mark area.
The video conference image output by the video conference application comprises a mark area, and a user can mark the mark area through a tool in the video conference application, such as a brush tool, so that the terminal receives the mark input by the user.
In addition, the mark may be a text input or other forms, and the text input may be either handwritten by a brush pen or input by a keyboard, which is not limited by the present disclosure.
103: the first terminal sends the mark to the server, so that the server sends the mark to the second terminal, and the second terminal displays the video conference image with the mark.
When the terminal sends the mark, the terminal actually sends the information of the mark, such as the coordinates of each point on the mark, the sequence of each point, and the attributes of the mark, such as color, thickness, line type, and the like.
Fig. 2 is a schematic diagram of a marker provided by an embodiment of the present disclosure, and referring to fig. 2, line thickness and color of the markers of different participants participating in a video conference may be the same or different. For example, participant A and participant B have different labels, and participant B and participant C have different label lines.
The second terminal and the first terminal are different terminals.
In the embodiment of the disclosure, a scheme for enabling each participant to mark or modify shared content is provided, a mark area is set in a video conference image for a user to mark, and the marked mark area is transmitted to other terminals through a server to be displayed, so that each terminal can mark a picture, and the problem that only the participant can mark to cause unsuitability for discussion and interaction of a plurality of participants in the related art is solved.
Fig. 3 is a flowchart of a method for marking a video conference according to an embodiment of the present disclosure. Referring to fig. 3, the method includes:
201: the server receives the mark sent by the first terminal, and the mark is input from the video conference image output by the first terminal by using the mark area defined by the mark frame.
202: the server sends the mark to the second terminal, so that the second terminal displays the video conference image with the mark.
The second terminal and the first terminal are different terminals.
In the embodiment of the disclosure, a scheme for enabling each participant to mark or modify shared content is provided, a mark area is set in a video conference image for a user to mark, and the marked mark area is transmitted to other terminals through a server to be displayed, so that each terminal can mark a picture, and the problem that only the participant can mark to cause unsuitability for discussion and interaction of a plurality of participants in the related art is solved.
Fig. 4 is a flowchart of a video conference marking method according to an embodiment of the present disclosure. Referring to fig. 4, the method includes:
301: the first terminal outputs a video conference image including a marker region defined using a marker frame.
Illustratively, step 301 may include:
acquiring mark area setting information;
a marker box is drawn based on the marker region setting information to output a video conference image with a marker region.
The marking area setting information is obtained, and the marking frame is drawn according to the marking area setting information, so that the marking area is displayed.
Here, when the first terminal is an initiating terminal of the video conference (i.e., a conference administrator), the manner of acquiring the marker region setting information may be to receive a marker region setting instruction input by a user through a marker region setting function in the video conference application, where the marker region setting instruction provides the marker region setting information. That is, the originating end of the videoconference can define markable marker zones. In addition, the first terminal may also transmit the flag region setting instruction to the server.
When the first terminal is only a participant of the video conference, the manner of obtaining the flag area setting information may be to receive a flag area setting instruction sent by the server, where the flag area setting instruction provides the flag area setting information.
Illustratively, the flag setting information includes at least one of the following parameters:
the number of mark areas, the position of each mark area, the shape of each mark area, the size of each mark area, and the border property of each mark area.
For example, the number range of the mark areas is 1 to N, N is a positive integer greater than 1, the value of N can be determined according to the terminal performance, the network speed, and the like, the better the terminal performance is, the faster the network speed is, the larger the value of N can be.
The setting of the mark area is realized through the setting parameters of the mark area, wherein the border attribute can comprise color, thickness, line type, whether to be hidden and the like.
Here, the frame hiding of the mark area means that the frame is hidden when no operation is performed and the frame is displayed when an operation is performed. When the frame of the mark area is hidden, only the operation focus has operation in the mark area, such as a mouse moving or clicking in the mark area, and the touch pad has touch operation in the mark area, the frame of the mark area will appear, and if the operation is not continued for a certain time (for example, 3 seconds), the frame of the mark area disappears.
Fig. 5 is a schematic interface diagram of a video conference provided by an embodiment of the present disclosure, and referring to fig. 5, the number of the mark areas may be multiple, for example, 3, the positions of the 3 mark areas are isolated from each other, and the mark areas are all rectangular in shape, where the mark areas B and C have the same size, and the mark area a has a different size. Of course, the illustration in FIG. 5 is merely an example of a mark region and is not intended to limit the mark region.
Illustratively, the video conference image further includes a shared area, which refers to an area where the first terminal shares a screen provided by the first sharer.
As shown in fig. 5, the mark region is located within the shared region. At this time, the size of each shared region cannot exceed the shared region, and different shared regions are not intersected.
Fig. 6 is a schematic interface diagram of another video conference provided by the embodiment of the present disclosure, and referring to fig. 6, a mark-up area is located outside a shared area.
In the embodiment of the present disclosure, the mark area may be in the shared area or outside the shared area, and the setting is flexible.
Illustratively, when the mark-up area is located outside the shared area, the mark-up area has a function of sharing a screen provided by the second sharer. Besides the mark area is in the sharing area, content sharing can be realized besides marking. That is, in the case of a video conference, a plurality of users may share the video conference at the same time.
The video conference initiator or authorized participants can display the content to be shared in the mark area, including pictures, videos, documents (such as PPT, WORD, EXCEL and the like), and the shared content is only displayed in the fixed mark area. If the shared content is not displayed, the mark area can be displayed with a monochrome background and can be used as a markable whiteboard.
In this case, the mark region and the other regions are independent, and there is no dependency or dependency. The position, size, shape, etc. of the mark area may be fixed or may be freely set, which is not limited thereto.
It should be noted that, when the mark area is located in the shared area, the conference video images of the mark area and the shared area may be sent separately or combined together; when the mark area is located outside the shared area, the conference video images of the mark and the shared area can be sent separately, or the conference video images of the mark and the mark area can be sent separately or combined together. That is, when it is described later that the marker and the conference video image are transmitted separately or combined together, the conference video image may refer to a conference video image in the shared area or a conference video image in the marker area.
Referring again to fig. 5 and 6, the videoconference image includes areas such as a chat area and a participant list display area, in addition to the sharing area and the mark area.
302: the first terminal receives a mark input in the mark area.
The video conference image output by the video conference application comprises a mark area, and a user can mark the mark area through a tool in the video conference application, such as a brush tool, so that the terminal receives the mark input by the user.
303: the first terminal sends the mark and the associated information of the mark and the image to a server; the server receives a mark and associated information of the mark and the image, wherein the mark is sent by the first terminal and is input by a mark area defined by a mark frame in the video conference image output by the first terminal.
When the terminal sends the mark, the terminal actually sends the information of the mark, such as the coordinates of each point on the mark, and the attribute of the mark, such as color, thickness, line shape, and the like.
In addition, the terminal records the time generated by each point on each mark, so that when the mark and the video conference image are combined, the mark and the video conference image can be combined according to the same time.
Here, the association information between the marker and the image may be the time when each of the markers is generated, or may be the number of the video conference image corresponding to each of the markers.
304: the server synthesizes the tags into the video conference images.
The server carries out the composition of the mark and the video conference image according to the associated information of the mark and the image, for example, the point of the mark generated at the first time is synthesized with the video frame with the same time stamp, thereby leading the generation and the modification of the mark to present dynamic effect when the terminal outputs the video conference image.
As another example, the marked points and the video frames corresponding to the numbers of the corresponding video conference images are synthesized.
The server receives the mark uploaded by the first terminal and the video conference image uploaded by the third terminal, synthesizes the mark and the video conference image, and transmits the synthesized video conference image to the second terminal to synthesize the marked video conference image.
For another example, the first terminal is a sharer of the video conference, and the first terminal uploads the mark and the video conference image to the server separately.
305: the server sends the video conference image synthesized with the mark to a second terminal; and the second terminal receives the video conference image combined with the mark.
The second terminal and the first terminal are different terminals.
306: and the second terminal outputs the video conference image synthesized with the mark.
In the embodiment of the present disclosure, after the first terminal transmits the mark to the server, the server synthesizes the mark into the video conference image, and then transmits the video conference image to the second terminal, so that the second terminal can directly output the video conference image containing the mark. In this embodiment, the first terminal uploads the tag, and the server is responsible for synthesizing the tag with the video conference image and then sends the video conference image synthesized with the tag to the second terminal.
Fig. 7 is a flowchart of a method for marking a video conference according to an embodiment of the present disclosure. Referring to fig. 7, the method includes:
401: the first terminal outputs a video conference image including a marker region defined using a marker frame.
See step 301 for details of this step.
402: the first terminal receives a mark input in the mark area.
See step 302 for details of this step.
403: the first terminal sends the mark and the associated information of the mark and the image to a server; the server receives a mark and associated information of the mark and the image, wherein the mark is sent by the first terminal and is input by a mark area defined by a mark frame in the video conference image output by the first terminal.
When the terminal sends the mark, the terminal actually sends the information of the mark, such as the coordinates of each point on the mark, and the attribute of the mark, such as color, thickness, line shape, and the like.
In addition, the terminal records the time generated by each point on each mark, so that when the mark and the video conference image are combined, the mark and the video conference image can be combined according to the same time.
404: and the server sends the mark and the associated information of the mark and the image to the second terminal. And the second terminal receives the mark and the associated information of the mark and the image sent by the server.
Step 404 only sends the tag and its associated information with the image without compositing the tag into the video conference image.
405: the second terminal synthesizes the marker into the video conference image.
The second terminal carries out the composition of the mark and the video conference image according to the associated information of the mark and the image, for example, the marked point generated at the first time and the video frame with the same time stamp are combined, thereby leading the generation and modification of the mark to present dynamic effect when the terminal outputs the video conference image.
It should be noted that, if the second terminal is a sharer of the video conference, the second terminal may synthesize the mark into the locally generated video conference image.
If the second terminal is a participant of the video conference, the second terminal also needs to receive the video conference image sent by the server and then synthesize the video conference image.
406: and the second terminal outputs the video conference image synthesized with the mark.
In the embodiment of the present disclosure, after the first terminal transmits the mark to the server, the server transmits the mark to the second terminal, so that the second terminal can synthesize the mark into the video conference image and then output the video conference image containing the mark. In this embodiment, the first terminal uploads the tag, the server sends the tag to the second terminal, and then the second terminal performs the tag and video conference image synthesis.
Fig. 8 is a flowchart of a method for marking a video conference according to an embodiment of the present disclosure. Referring to fig. 8, the method includes:
501: the first terminal outputs a video conference image including a marker region defined using a marker frame.
See step 301 for details of this step.
502: the first terminal receives a mark input in the mark area.
See step 302 for details of this step.
503: the first terminal will synthesize the tag into the video conference image.
In the embodiment of the disclosure, the first terminal is a sharer of the video conference, so that the first terminal can directly synthesize the mark into the video conference image to be uploaded for uploading.
The first terminal carries out the composition of the mark and the video conference image according to the associated information of the mark and the image, for example, the marked point generated at the first time and the video frame with the same time stamp are combined, thereby leading the generation and modification of the mark to present dynamic effect when the terminal outputs the video conference image.
504: the first terminal sends the video conference image synthesized with the mark to a server; the server receives the video conference image combined with the marker.
505: the server sends the video conference image synthesized with the mark to a second terminal; and the second terminal receives the video conference image which is sent by the server and combined with the mark.
506: and the second terminal outputs the video conference image synthesized with the mark.
In the embodiment of the disclosure, after the first terminal transmits the video conference image combined with the mark to the server, the server transmits the video conference image combined with the mark to the second terminal, so that the second terminal can directly output the video conference image containing the mark. In this embodiment, the first terminal synthesizes the mark and the video conference image, then uploads the video conference image synthesized with the mark, and the server sends the video conference image synthesized with the mark to the second terminal.
Fig. 9 is a flowchart of a method for marking a video conference according to an embodiment of the present disclosure. Referring to fig. 9, the method includes:
601: the first terminal acquires a mark area permission setting instruction, wherein the mark area permission setting instruction is used for indicating the mark area use permission of each terminal participating in the conference, and the use permission comprises viewing permission.
Here, the video conference application has a flag area authority setting function, and when the first terminal is an initiating terminal of the video conference, the user can input a flag area authority setting instruction through an authority setting menu corresponding to the flag area authority setting function. That is, the originating end of the videoconference can manage the authority of the marker zone.
The viewing right (or referred to as a visible right) includes two cases that the terminal has the viewing right and the terminal does not have the viewing right. When the terminal has the viewing right, the participant can see the content in the mark area, and when the terminal does not have the viewing right, the participant cannot see the mark content in the mark area.
Fig. 10 is a schematic diagram of an authority setting menu provided by an embodiment of the present disclosure, and referring to fig. 10, an initiating end of a video conference may perform authority setting on all members or each participant participating in the conference. For example, each participant can set viewing rights and marking rights, and the selection indicates that the participant has the corresponding rights.
And each marking area can be independently provided with an authority, each marking area corresponds to an authority setting menu, the authority setting menu is displayed only during setting, the authority setting menu is automatically hidden after the setting is finished, and only the initiating terminal of the video conference can be seen and operated. The video conference initiator has the viewing permission and the marking permission by default and does not need to be set.
602: and the first terminal sends a mark area authority setting instruction to the server. And the server receives a mark area authority setting instruction.
After receiving the instruction, the server can store the instruction, so that the authority management of the terminal can be performed according to the content in the instruction.
603: the first terminal sends a mark to the server; the server receives the mark sent by the first terminal, and the mark is input from the video conference image output by the first terminal by using the mark area defined by the mark frame.
Here, the manner of transmitting the token between the first terminal and the server may refer to corresponding steps in fig. 4, fig. 7, or fig. 8.
604: and the server executes the mark area authority setting instruction and determines the terminal with the mark area viewing authority.
For example, referring to fig. 10, the terminals having the viewing right at this time are participant a and participant B.
Illustratively, after receiving the mark area permission setting instruction, the server may establish a permission indication table locally, and set an identification bit for each permission of each terminal, for example, each terminal correspondingly sets a viewing permission identification bit, where 1 indicates that there is a viewing permission, and 0 indicates that there is no viewing permission, so that the server can conveniently and quickly determine whether a terminal has the viewing permission.
605: the server sends the indicia to the terminal having viewing rights.
When the terminals with the viewing right are participant a and participant B, the server sends the mark to the terminals corresponding to participant a and participant B. At this time, the marks in the mark area can be normally displayed in the terminals of participant a and participant B, while participant C cannot display the marks in the mark area, and the mark area can be displayed as a blank.
Here, the manner of transmitting the mark between the server and the terminal having the viewing right may refer to corresponding steps in fig. 4, fig. 7, or fig. 8.
In the embodiment of the disclosure, the terminal sends the permission setting instruction to the server to indicate the viewing permission of each terminal, and the server sends the mark to the terminal with the viewing permission to realize the management of the viewing permission.
Fig. 11 is a flowchart of a method for marking a video conference according to an embodiment of the present disclosure. Referring to fig. 11, the method includes:
701: the first terminal acquires a mark area authority setting instruction, wherein the mark area authority setting instruction is used for indicating the mark area use authority of each terminal participating in the conference, and the use authority further comprises mark authority.
The marking authority is whether the participant can mark in the marking area or not, when the terminal has the marking authority, the participant can mark in the marking area, and when the terminal does not have the marking authority, the participant cannot mark in the marking area. And when the viewing authority of a certain terminal is set to be the non-viewing authority, the marking authority is automatically set to be the non-marking authority.
And when the viewing authority of a certain terminal is set to be the non-viewing authority, the marking authority is automatically set to be the non-marking authority.
Here the tag rights may include tag addition rights and tag modification rights. Wherein the mark adding authority refers to the authority for adding marks in the mark area, and the mark modifying authority refers to the authority for modifying marks in the mark area. In the embodiment of the present disclosure, the tag addition authority and the tag modification authority may be set simultaneously, or in other embodiments, the two may be set separately.
Illustratively, the tag modification rights may differ for different terminals. For example, the terminal of the general participant can only erase the content marked by the general participant, while the conference initiating terminal can modify (e.g., erase) all the marked content, the position information of the modified mark is uploaded to the server, and the server system updates the mark to other terminals according to the position information of the modified mark.
The switching between the marking operation and the modifying operation can be realized by different keys, for example, the marking operation can be started by selecting the marking key, and the erasing operation can be performed by selecting the modifying key.
Referring again to fig. 10, the authority setting of the terminal may set a marking authority in addition to the viewing authority.
702: and the first terminal sends a mark area authority setting instruction to the server. And the server receives a mark area authority setting instruction.
See step 602 for details of this step.
703: the server sends a marking area authority message to the second terminal to indicate whether the second terminal has marking authority; and the second terminal receives the mark area authority message sent by the server.
704: the second terminal determines whether to provide the tag and the tag modification function according to the tag area authority message.
Illustratively, after receiving the tag region authority message, the second terminal may determine whether itself has the tag and the tag modification function, and if so, provide the function in the video conference application. If the function is not provided, the function is not provided in the video conference application, for example, when the function is not provided, a brush of a marker area in the video conference application cannot be used, and the like.
For the participant, when the participant has the marking right, the participant can mark in the marking area through a peripheral (such as a mouse and a touch pad) and the like, the marking method includes writing (for example, clicking a left mouse button at a position needing to be marked, moving the mouse to draw a shape needing to be marked, for example, pressing the position needing to be marked by using the touch pad, and moving the shape needing to be marked), the content of the mark (the position information of the mark) is uploaded to a server (cloud) through a network connected with a terminal corresponding to the participant, and the mark is distributed to other participants through the server.
In the disclosed embodiment, the second terminal provides or does not provide the user with the functions of marking and marking modification according to whether the second terminal has the marking authority.
In the embodiment of the disclosure, the authority of each participant in each marked area is determined, such as checking, marking or modifying, so that the participants can enjoy the operation authority corresponding to the area, and thus, the method can be more suitable for various video conference scenes, and brings more convenient and unobstructed communication experience for the participants.
Fig. 12 is a flowchart of a method for marking a video conference according to an embodiment of the present disclosure. Referring to fig. 12, the method includes:
801: the first terminal acquires a mark area authority setting instruction, wherein the mark area authority setting instruction is used for indicating the mark area use authority of each terminal participating in the conference, and the use authority further comprises mark authority.
See step 701 for details of this step.
802: and the first terminal sends a mark area authority setting instruction to the server. And the server receives a mark area authority setting instruction.
See step 602 for details of this step.
803: the first terminal sends a mark to the server; the server receives the mark sent by the first terminal, and the mark is input from the video conference image output by the first terminal by using the mark area defined by the mark frame.
804: and the server determines whether the first terminal has the marking authority or not according to the marking area authority setting instruction.
For example, after receiving the mark area permission setting instruction, the server may locally establish a permission indication table, and set an identification bit for each permission of each terminal, for example, each terminal correspondingly sets a mark permission identification bit, where 1 indicates that there is a mark permission, and 0 indicates that there is no mark permission, so that the server can conveniently and quickly determine whether the terminal has the mark permission.
Similarly, the server may also receive a flag sent by another terminal, determine the flag authority of the other terminal according to the flag area authority setting instruction, and then determine whether to issue the flag of the terminal.
805: in response to the first terminal having the marking authority, the server sends the mark to the second terminal; the second terminal receives the token.
806: in response to the first terminal not having the marking authority, the server discards the mark.
In the embodiment of the disclosure, the terminal provides the user with the functions of marking and marking modification, any user is allowed to upload the mark to the server, and the server determines whether to issue the mark to other terminals according to the authority of each terminal. I.e. there is a server to manage the marking rights of the respective terminals.
As can be seen from the flows shown in fig. 9 and fig. 12, after receiving the mark sent by the terminal a, the server may first determine whether the terminal a has the mark authority, and if so, send the mark of the terminal a to other terminals. When the mark of the terminal A is sent to other terminals, which terminals have the viewing permission need to be determined, and after the terminals having the viewing permission are determined, the mark of the terminal A is sent to the terminals having the viewing permission.
Fig. 13 is a schematic structural diagram of a video conference system according to an embodiment of the present disclosure. Referring to fig. 13, the system includes a server S and a plurality of terminals. The server and the terminal are respectively configured to perform the video conference tagging method set forth in the foregoing.
For example, the plurality of terminals correspond to the plurality of participants a to D, and one conference initiating end exists among the plurality of terminals.
The following description will take the example where participants A-C have viewing permissions, D does not have viewing permissions, A-B have labels, and C-D do not have labels.
As shown in fig. 13, both participants a and B may upload and receive the indicia such that the a indicia entered by participant a and the B indicia entered by participant B are displayed in the indicia area. Participant C, although unable to make the mark, has viewing rights, and thus the server will send the received a mark and B mark to participant C's terminal, so that participant C's terminal mark area will also display a mark and B mark. Whereas participant D, because it has no viewing rights, the marked area appears blank.
Fig. 14 is a block diagram of a terminal according to an embodiment of the present disclosure. As shown in fig. 14, the terminal includes: a hardware layer 1401, a driver layer 1402, an operating system 1403, and a video conferencing application 1404. The videoconference application 1404 includes conventional modules to implement a videoconference, such as a User Interface (UI) module 1441, an audio-video codec module 1442, a file/desktop sharing module 1443, a conference management module 1444, a terminal peripheral scheduling module 1445, an audio-video capture/play module 1446, and a communication protocol stack 1447. The above modules are conventional modules in video conference applications, and are not described herein.
To implement the tagging functionality proposed by the present disclosure, the video conferencing application 1404 further comprises: a marking UI module 1448, a marking authority management module 1449, a marking area management module 1450, a marking position acquisition module 1451, a marking information superposition module 1452, a marking information transmission module 1453, and a marking information reception module 1454.
The marking UI module 1448 is configured to draw graphical interfaces such as a marking area and an authority management menu on an interface of the video conference according to a user's requirement. The marking authority management module 1449 is configured to determine, at the video conference initiating end, the authority of each participant according to the setting of the administrator, and transmit the authority to each participant terminal through the server, where the participant terminal determines the marking authority of the participant according to the authority issued by the administrator, and limits the operation of the participant. The marking area management module 1450 is configured to control the marking UI module to draw the marking area and control display or blank the marking area according to the received information, such as the size and the position of the marking area. The marking position obtaining module 1451 is configured to obtain marking position information according to a marking operation, where a pixel point at an upper left corner of the sharing area or the marking area is marked as (0, 0), a pixel number increases from the (0, 0) point to the right and downwards, and when the marking operation or the erasing operation is performed, the marking position obtaining module obtains a coordinate and a sequence of a selected pixel, that is, a coordinate and a sequence of each point on the marking line. The marking information sending module 1453 is configured to send marking area information such as pixel coordinates and sequence to a server according to a requirement of a communication protocol. The marking information receiving module 1454 is configured to receive the marking or erasing pixel position and sequence information and the marking area information sent by the server according to the requirement of the communication protocol; the mark information overlaying module 1452 is configured to combine the mark with the corresponding position in the video conference image or erase the mark at the corresponding position according to the received pixel mark or erased position and sequence information.
Note that the tag information receiving module 1454 and the tag information superimposing module 1452 in the terminal are optional modules, and for example, when the tag and the video conference image are combined at the server, the tag information receiving module 1454 and the tag information superimposing module 1452 may not be included in the terminal.
It should be noted that: in the terminal provided in the foregoing embodiment, when performing a video conference, only the division of the functional modules is illustrated, and in practical applications, the functions may be distributed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the embodiment of the method for marking a terminal and a video conference provided by the above embodiment belongs to the same concept, and the implementation process thereof is described in detail in the embodiment of the method and is not described herein again.
Fig. 15 is a block diagram of a server according to an embodiment of the present disclosure. As shown in fig. 15, the server includes: server hardware 1501 (single or multiple servers), operating system 1502, and video conferencing system 1503. The video conference system 1503 includes conventional modules for implementing a video conference, such as a conference management service module 1531, a streaming media service module 1532, an audio/video codec service module 1533, a file storage service module 1534, a listening service module 1535, a statistical analysis service module 1536, a UI module 1537, and a communication protocol stack 1538.
To implement the tagging functionality proposed by the present disclosure, the video conference application 1503 further includes: a rights management service module 1539, a region management service module 1540, a tag overlay service module 1541, a tag information transmitting module 1542, and a tag information receiving module 1543.
The rights management service module 1539 is configured to obtain rights information of each participant, and manage rights of each participant terminal. The mark superposition service module 1541 is configured to use different superposition policies for terminals with different permissions according to the permission information, for example, if the participant a has no permission to view, the mark is not sent to the participant a, and only the video conference image is forwarded to the participant a; for example, if the participant B has the marking authority, the mark of the participant B is synthesized on the video conference image; for another example, if participant C has viewing right but does not have marking right, the marker of C will not be synthesized to the video conference image, but the markers of other participants with marking right will be synthesized and sent to C, if the synthesizing process is completed at the terminal, the server only processes the marker or erases the information and directly forwards the information, and the marker and the video conference image will not be synthesized. The area management service module 1540 is configured to record and update information such as coordinates and size of the marked area in real time, and forward the information to each participant, where the participant establishes the marked area in the terminal conference interface according to the information. The mark information sending module 1542 and the mark information receiving module 1543 are used for transmitting information such as a mark, an erased position, a sequence and the like.
It should be noted that the tag overlay service module 1541 in the server is an optional module, for example, when the tag and the videoconference image are combined at the terminal, the tag overlay service module 1541 may not be included in the server.
As shown in fig. 16, an embodiment of the present disclosure further provides a computer device 1600, where the computer device 1600 is the aforementioned terminal or server. The computer device 1600 may be used to perform the tagging method for video conferences provided in the various embodiments described above. Referring to fig. 16, the computer apparatus 1600 includes: memory 1601, processor 1602 and display component 1603, it will be understood by those skilled in the art that the configuration of computer device 1600 shown in fig. 16 is not limiting of computer device 1600, and in actual practice may include more or fewer components than shown, or some components may be combined, or a different arrangement of components. Wherein:
the memory 1601 may be used to store computer programs and modules, and the memory 1601 may mainly include a program storage area and a data storage area, where the program storage area may store an operating system, an application program required for at least one function, and the like. The memory 1601 may include high speed random access memory and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 1601 may also include a memory controller to provide the processor 1602 access to the memory 1601.
The processor 1602 executes various functional applications and data processing by executing software programs and modules stored in the memory 1601.
The Display component 1603 is used for displaying an image, and the Display component 1603 may include a Display panel, which may be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like.
In an exemplary embodiment, there is also provided a computer-readable storage medium, which is a non-volatile storage medium, and in which a computer program is stored, and when the computer program in the computer-readable storage medium is executed by a processor, the method for marking a video conference provided by the embodiments of the present disclosure can be performed.
In an exemplary embodiment, a computer program product is also provided, which has instructions stored therein, which when run on a computer, enable the computer to perform the tagging method for a video conference provided by an embodiment of the present disclosure.
In an exemplary embodiment, a chip is further provided, where the chip includes a programmable logic circuit and/or program instructions, and when the chip is running, the chip can execute the video conference marking method provided by the embodiment of the disclosure.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The above description is intended to be exemplary only and not to limit the present disclosure, and any modification, equivalent replacement, or improvement made without departing from the spirit and scope of the present disclosure is to be considered as the same as the present disclosure.

Claims (19)

1. A method for tagging a video conference, the method comprising:
a first terminal outputting a video conference image including a marker region defined using a marker frame;
the first terminal receives the mark input in the mark area;
and the first terminal sends the mark to a server so that the server sends the mark to a second terminal, and the second terminal displays the video conference image with the mark.
2. The method of claim 1, wherein the first terminal outputs video conference images, comprising:
acquiring mark area setting information;
drawing the mark frame based on the mark region setting information to output the video conference image with the mark region.
3. The method according to claim 2, wherein the flag setting information includes at least one of the following parameters:
the number of mark areas, the position of each mark area, the shape of each mark area, the size of each mark area, and the border property of each mark area.
4. The method according to any one of claims 1 to 3, wherein the video conference image further includes a shared area, the shared area being an area where the first terminal shares a screen provided by a first sharer;
the mark area is located in the shared area, or the mark area is located outside the shared area.
5. The method according to claim 4, wherein the marked area has a function of sharing a picture provided by a second sharer when the marked area is located outside the shared area.
6. The method of any of claims 1 to 3, wherein the first terminal is an initiating end of the video conference, the method further comprising:
and sending a mark area permission setting instruction to the server so that the server controls the use permission of each terminal participating in the conference to the mark area.
7. The method of claim 6, wherein the usage rights comprise at least one of:
viewing authority and marking authority.
8. The method according to any of claims 1 to 3, wherein the first terminal sending the token to a server comprises:
synthesizing the marker into the video conference image;
sending the video conference image synthesized with the mark to the server;
alternatively, the first and second electrodes may be,
and sending the mark and the associated information of the mark and the image to a server so that the server synthesizes the mark into the video conference image.
9. A method for marking a videoconference, the method comprising:
the server receives a mark sent by a first terminal, wherein the mark is input from a mark area defined by a mark frame in a video conference image output by the first terminal;
and the server sends the mark to a second terminal, so that the second terminal displays the video conference image with the mark.
10. The method of claim 9, wherein the server sending the token to the second terminal comprises:
synthesizing the marker into a video conference image;
sending the video conference image synthesized with the mark to the second terminal;
alternatively, the first and second electrodes may be,
and sending the mark and the associated information of the mark and the image to the second terminal so that the second terminal synthesizes the mark into a video conference image.
11. The method according to claim 9 or 10, wherein before the server sends the token to the second terminal, the method further comprises:
determining a terminal with a mark area viewing authority;
the server sends the mark to a second terminal, and the method comprises the following steps:
and responding to the fact that the second terminal is a terminal with a mark area viewing authority, and sending the mark to the second terminal.
12. The method of claim 11, wherein prior to said determining the terminal having the mark zone viewing permission, the method further comprises:
receiving a mark area permission setting instruction sent by an initiating terminal of a video conference, wherein the mark area permission setting instruction is used for indicating mark area use permissions of all terminals participating in the conference, and the use permissions comprise viewing permissions.
13. The method of claim 12, wherein the usage rights further comprise a tagging right, the method further comprising:
generating a mark area authority message according to the mark area authority setting instruction;
and sending a mark zone authority message to the second terminal to indicate whether the second terminal has mark authority or not.
14. The method of claim 12, wherein the usage rights further include a label right, and wherein the server sends the label to the second terminal, comprising:
and responding to the first terminal having the marking authority, and sending the mark to the second terminal.
15. The method of claim 14, further comprising:
and in response to the first terminal not having the marking authority, discarding the mark.
16. A terminal, characterized in that the terminal comprises a processor and a memory;
wherein the memory is used for storing a computer program;
the processor is configured to execute the computer program stored in the memory to implement the video conference marking method according to any one of claims 1 to 8.
17. A server, comprising a processor and a memory;
wherein the memory is used for storing a computer program;
the processor is configured to execute the computer program stored in the memory to implement the video conference marking method according to any one of claims 9 to 15.
18. A video conferencing system, characterized in that the video conferencing system comprises a terminal as claimed in claim 16 and a server as claimed in claim 17.
19. A computer readable storage medium having stored thereon computer instructions which, when executed by a processor, are capable of implementing a method for tagging a video conference according to any one of claims 1 to 8 or a method for tagging a video conference according to any one of claims 9 to 15.
CN202210730439.4A 2022-06-24 2022-06-24 Video conference marking method, system, terminal, server and storage medium Pending CN115118918A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202210730439.4A CN115118918A (en) 2022-06-24 2022-06-24 Video conference marking method, system, terminal, server and storage medium
PCT/CN2023/092221 WO2023246328A1 (en) 2022-06-24 2023-05-05 Video conference marking method and system, and terminal, server and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210730439.4A CN115118918A (en) 2022-06-24 2022-06-24 Video conference marking method, system, terminal, server and storage medium

Publications (1)

Publication Number Publication Date
CN115118918A true CN115118918A (en) 2022-09-27

Family

ID=83330914

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210730439.4A Pending CN115118918A (en) 2022-06-24 2022-06-24 Video conference marking method, system, terminal, server and storage medium

Country Status (2)

Country Link
CN (1) CN115118918A (en)
WO (1) WO2023246328A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023246328A1 (en) * 2022-06-24 2023-12-28 京东方科技集团股份有限公司 Video conference marking method and system, and terminal, server and storage medium

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2579588B1 (en) * 2011-10-04 2019-12-04 Ricoh Company, Ltd. Collaborative meeting systems that enable parallel multi-user input to mark up screens
US9165290B2 (en) * 2011-11-02 2015-10-20 Microsoft Technology Licensing, Llc Sharing notes in online meetings
US9113033B2 (en) * 2012-08-28 2015-08-18 Microsoft Technology Licensing, Llc Mobile video conferencing with digital annotation
CN104363407B (en) * 2014-10-31 2018-04-27 华为技术有限公司 A kind of video conferencing system means of communication and related device
US9961302B1 (en) * 2016-12-13 2018-05-01 Cisco Technology, Inc. Video conference annotation
CN110708492A (en) * 2019-09-12 2020-01-17 福建星网智慧软件有限公司 Video conference content interaction method and system
CN113741837A (en) * 2020-05-30 2021-12-03 华为技术有限公司 Information processing method, device, system and storage medium
CN111770061A (en) * 2020-06-02 2020-10-13 西安极蜂天下信息科技有限公司 Conference demonstration method, device and system
CN111654661B (en) * 2020-06-17 2022-03-01 深圳康佳电子科技有限公司 Video conference annotation method, video conference server and storage medium
CN112084756B (en) * 2020-09-08 2023-10-10 远光软件股份有限公司 Conference file generation method and device and electronic equipment
CN112966480A (en) * 2021-03-18 2021-06-15 深圳云之家网络有限公司 Teleconference annotation method and related equipment thereof
CN113542257B (en) * 2021-07-12 2023-09-26 维沃移动通信有限公司 Video processing method, video processing device, electronic apparatus, and storage medium
CN114417784A (en) * 2022-01-20 2022-04-29 北京字跳网络技术有限公司 Comment display method, device, equipment and medium for document
CN115118918A (en) * 2022-06-24 2022-09-27 京东方科技集团股份有限公司 Video conference marking method, system, terminal, server and storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023246328A1 (en) * 2022-06-24 2023-12-28 京东方科技集团股份有限公司 Video conference marking method and system, and terminal, server and storage medium

Also Published As

Publication number Publication date
WO2023246328A1 (en) 2023-12-28

Similar Documents

Publication Publication Date Title
CN109348161B (en) Method for displaying annotation information and electronic equipment
US9640144B2 (en) Projector, figure input/display apparatus, portable terminal, and program
US11799677B2 (en) Annotation layer permissions
EP2756667B1 (en) Electronic tool and methods for meetings
CN110727361A (en) Information interaction method, interaction system and application
CN111741324B (en) Recording playback method and device and electronic equipment
US20230328200A1 (en) Compositing Content From Multiple Users Of A Conference
EP2579588B1 (en) Collaborative meeting systems that enable parallel multi-user input to mark up screens
CN113778360B (en) Screen projection method and electronic equipment
JP3840195B2 (en) Drawing apparatus and control method thereof
US20240031317A1 (en) Image Sharing Method and Electronic Device
US10241736B2 (en) System, display position determination method, and computer-readable recording medium
WO2023246328A1 (en) Video conference marking method and system, and terminal, server and storage medium
CN105306872A (en) Method, apparatus and system for controlling multipoint video conference
JP6361728B2 (en) Transmission control system, transmission system, transmission control method, and recording medium
JP2013232123A (en) Electronic conference system, terminal, and file providing server
US20150007054A1 (en) Capture, Store and Transmit Snapshots of Online Collaborative Sessions
US20230195403A1 (en) Information processing method and electronic device
CN114866835A (en) Bullet screen display method, bullet screen display device and electronic equipment
JP6238334B2 (en) Terminal device, comment distribution system, and program
JP2013033105A (en) Projection system, pc terminal program and projector program
JP2016099773A (en) Terminal device, reproduction method, program, and image sharing system
JP6714942B1 (en) Communication system, computer program, and information processing method
KR102174290B1 (en) Overlay boarding function service system and method on video and image screen during video conference
CN112672089A (en) Conference control and conferencing method, device, server, terminal and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination