TWI832477B - Screen sharing method of video conference and video conference system - Google Patents

Abstract

A screen sharing method of video conference and a video conference system are provided. The method includes the following steps. A video conference is performed, and a first video conference image of a first electronic device is captured. Screen content of the first video conference screen is recognized by using a machine learning model. Whether the first video conferencing image matches a sharing image is determined through comparing the image content of the first video conference image and the image content of the sharing image, wherein the sharing image is generated by a second electronic device. Based on the matching result between the first video conference image and the sharing image, a corresponding image sharing status notification is provided by the second electronic device.

Description

Video conferencing screen sharing method and video conferencing system

The present invention relates to a video conferencing system, and in particular, to a video conferencing screen sharing method and a video conferencing system.

With the outbreak of the new coronavirus in various places, the demand for many people to use video conferencing for remote work or online classes at home has increased sharply. During a video conference, it is common to encounter a meeting situation where the presenter shares the screen so that other conference participants can simultaneously view the documents or presentations shared by the presenter. In this conference situation, since the presenter usually cannot determine whether other conference participants have successfully received the shared screen, the presenter often needs to ask each conference participant whether they have seen the correct shared screen, which will significantly delay the online process. The conduct of the meeting. If there are many meeting participants, asking each meeting participant one by one will cause considerable trouble to the presenter sharing the screen.

In view of this, the present invention proposes a video conference screen sharing method and video conference system, which can automatically confirm whether each conference participant in the video conference has successfully seen the content shared by the speaker, greatly improving the smoothness and efficiency of the video conference. .

An embodiment of the present invention provides a video conference screen sharing method, which is suitable for a video conference system and includes the following steps. Conduct a video conference and capture the first video conference screen of the first electronic device. Use a machine learning model to identify the screen content of the first video conference screen. By comparing the screen content of the first video conference screen with the screen content of the shared screen, it is determined whether the first video conference screen matches the shared screen, wherein the shared screen is generated by the second electronic device. Based on the matching result between the first video conference picture and the shared picture, the second electronic device provides a corresponding picture sharing status notification.

An embodiment of the present invention provides a video conferencing system, which includes a first electronic device, a second electronic device and a conference server. The conference server is connected to the first electronic device and the second electronic device. The first electronic device conducts a video conference and captures the first video conference screen. The first electronic device uses a machine learning model to identify the picture content of the first video conference picture. By comparing the screen content of the first video conference screen with the screen content of the shared screen, the first electronic device determines whether the first video conference screen matches the shared screen. The second electronic device generates the sharing screen. Based on the matching result between the first video conference screen and the shared screen, the conference server controls the second electronic device to provide a corresponding screen sharing status notification.

In order to make the above-mentioned features and advantages of the present invention more obvious and easy to understand, embodiments are given below and described in detail with reference to the accompanying drawings.

Some embodiments of the present invention will be described in detail with reference to the accompanying drawings. The component symbols cited in the following description will be regarded as the same or similar components when the same component symbols appear in different drawings. These embodiments are only part of the present invention and do not disclose all possible implementations of the present invention. Rather, these embodiments are merely examples of methods and systems within the scope of the patent application of the present invention.

FIG. 1 is a block diagram of a video conferencing system according to an embodiment of the present invention. Referring to FIG. 1 , the video conference system 10 includes a plurality of electronic devices 110 , 120 , 130 , 140 and a conference server 200 . This embodiment uses four electronic devices as an example for description, but the present invention is not limited to this. The electronic devices 110 to 140 can be implemented as electronic devices with network connection capabilities, such as smart phones, tablet computers, notebook computers, or desktop computers, and the present invention is not limited thereto.

The electronic devices 110 to 140 can be connected to the conference server 200 via the network, execute the video conferencing software through their respective processors, and display the video conferencing operation interface through their respective displays in response to the execution of the video conferencing software, so as to allow users U1, U2, U3, and U4 can conduct online conferences through electronic devices 110 to 140. More specifically, each electronic device 110-140 may have a network connection device, a display, a storage device and a processor.

The displays of the electronic devices 110 to 140 can display video conference operation interfaces for users U1, U2, U3, and U4 to view. They can be any type of display device, and the present invention is not limited thereto. The network connection device of the electronic devices 110-140 provides a network connection function so that the electronic devices 110-140 can connect to the network, such as a mobile network communication module, a WiFi module, or a wireless/wired network. Cards and so on.

The storage devices of the electronic devices 110 to 140 can be used to store files, images, instructions, program codes, software components, etc., and can be, for example, any type of fixed or removable random access memory (RAM). ), read-only memory (ROM), flash memory, hard disk or other similar devices, integrated circuits and combinations thereof.

The processors of the electronic devices 110 to 140 can execute program codes, software modules, instructions, etc. recorded in the storage devices. The processor can be a Central Processing Unit (CPU), or other programmable general-purpose or special-purpose microprocessor (Microprocessor), Digital Signal Processor (DSP), programmable Controllers, Application Specific Integrated Circuits (ASICs), Programmable Logic Devices (PLD), or other similar devices or combinations of these devices.

In the embodiment of the present invention, assuming that the user U1 of the electronic device 110 is the speaker of the online conference, the user U1 will operate the electronic device 110 to share the entire display screen or a specific window screen of the electronic device 110 with other users U2, U3, and U4. The electronic devices 120, 130, and 140 can display the sharing screen provided by the electronic device 110. That is to say, the presenter's electronic device 110 generates a sharing screen, and the sharing screen may be a complete desktop screen of the electronic device 110 or a window screen of a certain application window. Based on the matching results between the video conference screen and the shared screen displayed by each electronic device 120, 130, 140, the conference server 200 can determine whether each electronic device 120, 130, 140 has correctly received the shared screen, and accordingly control the speaker's The electronic device 110 provides corresponding screen sharing status notification. The screen sharing status notification includes a screen sharing success notification or a screen sharing failure notification.

In some embodiments, when any one of the electronic devices 120, 130, and 140 does not receive the shared screen, the conference server 200 can control the electronic device 110 to provide a screen sharing failure notification through the video conference operating interface. When each of the electronic devices 120, 130, and 140 correctly receives the shared screen, the conference server 200 can control the electronic device 110 to provide a successful screen sharing notification through the video conference operating interface. In this way, user U1 can know whether other users U2, U3, and U4 see the shared screen as expected based on the screen sharing status notification on the video conference operation interface, without having to ask each one one by one.

FIG. 2 is a flow chart of a video conference screen sharing method according to an embodiment of the present invention. Please refer to Figure 2. The method of this embodiment is applicable to the video conferencing system 10 of the above embodiment. In order to clearly illustrate the present invention, the detailed steps of this embodiment will be described below using the conference server 200, the electronic device 110, and the electronic device 120 in the video conferencing system 10 as an example.

In step S210, the first electronic device 120 conducts a video conference and captures the first video conference screen of the first electronic device 120. Specifically, the first electronic device 120 can start the video conference by executing the video conference software. In addition, the first electronic device 120 can determine whether the currently executing program is video conferencing software through an application programming interface (API) of the operating system. In response to detecting that the first electronic device 120 is executing the video conferencing software, the first electronic device 120 may capture the application screen or desktop through another API of the operating system. For example, the first electronic device 120 can use a screen capture technology such as the "Desktop Duplication API" of the Windows operating system to obtain the first video conference screen.

In step S220, the first electronic device 120 uses a machine learning model to identify the screen content of the first video conference screen. Specifically, the trained machine learning model may be recorded in the storage device of the first electronic device 120 . The first electronic device 120 may first perform image cutting and other image processing on the first video conference screen, and then input the processed first video conference screen into the machine learning model to identify the screen content of the first video conference screen. The above machine learning model can be used to identify text and image objects in the first video conference screen, etc. In other words, the machine learning model includes a text recognition model or an object detection model, and the screen content of the first video conference screen may include at least one character or at least one image object.

In step S230, by comparing the screen content of the first video conference screen with the screen content of the shared screen, the first electronic device 120 determines whether the first video conference screen matches the shared screen. Here, the sharing screen is generated by the second electronic device 110, and the screen content of the sharing screen may include at least one reference character or at least one reference image object. That is to say, the screen content of the shared screen generated by the second electronic device 110 can also be recognized through the same machine learning model. In some embodiments, the second electronic device 110 may transmit the screen content of the shared screen to the conference server 200 after identifying the screen content of the shared screen. Then, the conference server 200 broadcasts the screen content of the shared screen to each electronic device in the video conference. Therefore, after the first electronic device 120 receives the screen content of the shared screen from the conference server 200, the first electronic device 120 can compare the screen content of the first video conference screen and the screen content of the shared screen.

In step S240, based on the matching result between the first video conference screen and the shared screen, the second electronic device 110 provides a corresponding screen sharing status notification. The screen sharing status notification includes a screen sharing success notification or a screen sharing failure notification. In this way, the user U1 who is the presenter can know whether other users see the shared screen as expected based on the screen sharing status notification on the video conference operation interface.

In some embodiments, in response to the first video conferencing screen matching the sharing screen and the plurality of second video conferencing screens of the plurality of third electronic devices 130 and 140 matching the sharing screen, the video conferencing operation interface of the second electronic device 110 is provided. Notification of successful sharing of a screen. Specifically, in some embodiments, the first electronic device 120 may provide the corresponding report message to the conference server 200 based on the matching result between the first video conference screen and the shared screen. Similarly, the third electronic devices 130 and 140 in the video conferencing system will also perform operations similar to steps S210 to S230 respectively to provide corresponding report messages based on the matching results of the respective second video conferencing images and the shared images. Give 200 to the conference server. Therefore, the conference server 200 can determine whether the shared screen is correctly shared to the first electronic device 120 and the third electronic device 130 and 140 other than the second electronic device 110 in the video conference system 10 according to the received report message, so as to control The presenter's second electronic device 110 provides a corresponding screen sharing status notification.

In some embodiments, when the first electronic device 120 determines that the first video conference screen does not match the shared screen, the first electronic device 120 may provide the first video conference screen to the conference server 200 for reconfirmation to avoid machine learning errors. Model identification errors lead to misjudgment of matching results. Examples will be listed below to further illustrate.

FIG. 3 is a flow chart of a video conference screen sharing method according to an embodiment of the present invention. Please refer to Figure 3. The method of this embodiment is applicable to the video conferencing system 10 of the above embodiment. In order to clearly illustrate the present invention, the detailed steps of this embodiment will be described below using the conference server 200, the electronic device 110, and the electronic device 120 in the video conferencing system 10 as an example.

In step S301, the first electronic device 120 conducts a video conference and captures the first video conference screen of the first electronic device 120.

In step S302, the first electronic device 120 uses the object detection model to detect at least one image object in the first video conference screen. The object detection model for object detection is, for example, R-CNN, Fast R-CNN, Faster R-CNN, YOLO or SSD, etc., and the present invention is not limited thereto. In some embodiments, the object detection model can output object recognition results in the model input image, and the object recognition results include object classification results and object frames.

In step S303, the first electronic device 120 uses a text recognition model to recognize at least one character in the first video conference screen. Specifically, the first electronic device 120 can first convert the first video conference screen into a grayscale image and perform image pre-processing, and then use optical character recognition (Optical Character Recognition, OCR) technology to identify the characters in the grayscale image. At least one character.

On the other hand, in step S304, the second electronic device 110 conducts a video conference and captures the shared screen of the second electronic device 110. In step S305, the second electronic device 110 uses the object detection model to detect at least one reference image object in the shared screen. In step S306, the second electronic device 110 uses the text recognition model to recognize at least one reference character in the shared screen. It should be noted that the first electronic device 120 and the second electronic device 110 can use the same machine learning model to identify the screen content. In other words, the same machine learning model can be deployed in every electronic device in the video conferencing system.

In step S307, the first electronic device 120 compares at least one image object of the first video conference screen with at least one reference image object of the shared screen. In step S308, the first electronic device 120 compares at least one character of the first video conference screen with at least one reference character of the shared screen. In step S309, the first electronic device 120 determines whether at least one image object is the same as at least one reference image object and at least one character is the same as at least one reference character. Specifically, the first electronic device 120 may compare the image object set of the first video conference screen with the reference image object set of the shared screen, and determine whether the two sets are equal. Similarly, the first electronic device 120 can compare the character set of the first video conference screen with the reference character set of the shared screen, and determine whether the two sets are equal.

For example, please refer to FIG. 4 , which is a schematic diagram of comparing a video conference screen and a sharing screen according to an embodiment of the present invention. The second electronic device 110 can recognize the screen content of the shared screen S1 through the object detection model and the text recognition model. In more detail, the second electronic device 110 can identify a plurality of reference characters from the shared screen S1, such as the reference character RC1 of "creator". The second electronic device 110 can identify multiple reference image objects from the sharing screen S1, such as the reference image object Robj1 classified as “DT” and the reference image object classified as “ALL-in-One”.

On the other hand, it is assumed that the first electronic device 120 can recognize multiple characters from the first video conference screen F1, such as the character C1_1 of “creator”. The first electronic device 110 can recognize a plurality of image objects from the first video conference screen F1, such as the image object obj1 classified as “DT” and the image object classified as “ALL-in-One”. In this example, the first electronic device 110 can determine that all the reference characters in the shared screen S1 are the same as all the characters in the first video conference screen F1. Furthermore, the first electronic device 110 may determine that all the reference image objects in the sharing screen S1 are the same as all the image objects in the first video conference screen F1. Therefore, the first electronic device 120 determines that the first video conference picture F1 matches the sharing picture.

On the other hand, assume that the first electronic device 120 can recognize multiple characters from the first video conference screen F2, such as the character C2_1 of “come”, and does not detect any characters from the first video conference screen F2. Image object. In this example, the first electronic device 110 can determine that the characters in the first video conference screen F2 are different from the reference characters in the sharing screen S1, and determine that the reference image object in the sharing screen S1 is not the same as the first video conference screen. Image object in screen F2. Therefore, the first electronic device 120 determines that the first video conference picture F2 does not match the sharing picture.

Then, if the determination in step S309 is yes, in step S310, in response to the fact that at least one image object is the same as at least one reference image object and at least one character is the same as at least one reference character, the first electronic device 120 determines the first video conference screen Match share screen. Afterwards, in step S311, a successful screen sharing notification is provided through the video conference operating interface of the second electronic device 110. For example, as shown in FIG. 5C , it is a schematic diagram of providing screen sharing status notification according to an embodiment of the present invention. The video conference operation interface 53 of the second electronic device 110 may display a screen sharing success notification N3 to inform the presenter that other conference participants have correctly received the shared screen.

If the determination in step S309 is negative, in step S312, in response to the fact that at least one image object is not the same as at least one reference image object or at least one character is not the same as at least one reference character, the first electronic device 120 determines that the first video conference screen Shared screen not matched.

Therefore, in step S313, in response to the fact that the first video conference screen does not match the shared screen, the conference server 200 determines the difference between the first video conference screen and the shared screen based on the grayscale data of the first video conference screen and the grayscale data of the shared screen. Spend. Specifically, the first electronic device 120 can transmit the first video conference screen to the conference server 200, and the conference server 200 can determine the first video based on the grayscale data of the first video conference screen and the grayscale data of the shared screen. The difference between the meeting screen and the shared screen.

Specifically, in some embodiments, the conference server 200 may convert the first video conference screen and the sharing screen into grayscale images respectively. Then, in some embodiments, the conference server 200 can obtain a gray-scale distribution map based on the gray-scale image of the first video conference screen, and can obtain another gray-scale distribution map based on the gray-scale image of the shared conference screen. By accumulating the number of pixels with the same grayscale value (for example, 0~256) in the two grayscale distribution maps, the conference server 200 can calculate the degree of difference between the first video conference screen and the shared screen. Alternatively, in other embodiments, the conference server 200 can obtain a grayscale difference map by subtracting the grayscale values of the same pixel position on the grayscale image of the shared conference screen and the grayscale image of the first video conference screen. After that, the conference server 200 can determine whether each gray-scale difference value on this gray-scale difference map exceeds the difference threshold value one by one, and use the number of gray-scale difference values that exceed the difference threshold value as the first video conference screen and sharing screen. degree of difference.

In step S314, the conference server 200 determines whether the difference between the first video conference screen and the shared screen meets a preset condition. In some embodiments, the conference server 200 can determine whether the difference between the first video conference screen and the shared screen is less than a threshold value, and the setting of the threshold value can be designed according to actual applications. In other words, the conference server 200 determines whether the first video conference screen matches the shared screen based on the grayscale data of the first video conference screen and the grayscale data of the shared screen.

If the difference between the first video conference screen and the shared screen meets the preset condition (yes in step S309), in step S310, the conference server 200 determines that the first video conference screen matches the shared screen. If the difference between the first video conference screen and the shared screen meets the preset conditions, it means that the first video conference screen matches the shared screen, and the identification of the machine learning model has misjudged. After that, step S311 continues, and a screen sharing success notification is provided through the video conference operation interface of the second electronic device 110 .

On the other hand, if the difference between the first video conference screen and the shared screen does not meet the preset condition (no in step S309), in step S315, a screen sharing failure notification is provided through the video conference operating interface of the second electronic device 110. For example, as shown in FIG. 5A , it is a schematic diagram of providing screen sharing status notification according to an embodiment of the present invention. The video conference operation interface 51 of the second electronic device 110 may display a screen sharing failure notification N1, and the screen sharing failure notification N1 provided by the second electronic device 110 may present the conference participant name A1 corresponding to the first electronic device 120, to inform the presenter which meeting participants did not receive the share screen correctly.

In addition, if the difference between the first video conference screen and the shared screen does not meet the preset condition (no in step S309), in step S316, another screen sharing failure notification is provided through the video conference operation interface of the first electronic device 120. FIG. 5B is a schematic diagram of providing screen sharing status notification according to an embodiment of the present invention. The video conference operation interface 52 of the first electronic device 120 may display a screen sharing failure notification N2 to inform the user U2 of the first electronic device 120 that the shared screen shared by the presenter has not been correctly received.

Please refer to FIG. 6 , which is a flow chart of a conference server controlling an electronic device to provide screen sharing status notification according to an embodiment of the present invention. In order to clearly illustrate the present invention, the detailed steps of this embodiment will be described below using each device in the video conferencing system 10 as an example.

In this embodiment, assuming that the user U1 of the electronic device 110 is the presenter, the electronic device 110 generates a sharing screen. In step S601, the conference server 200 receives a video conference screen or a screen matching confirmation message from one of the electronic devices 120, 130, and 140. In some embodiments, when the electronic device 120, 130, 140 determines that the video conference picture matches the shared picture, the electronic device 120, 130, 140 may provide a picture matching confirmation message to the conference server 200. On the other hand, when the electronic devices 120, 130, and 140 determine that the video conference images do not match the shared images, the electronic devices 120, 130, and 140 may provide the video conference images to the conference server 200.

If the conference server 200 receives the video conference screen of one of the electronic devices 120, 130, and 140, in step S602, the conference server 200 converts the sharing screen and the video conference screen of one of the electronic devices 120, 130, and 140 into gray. level image. In step S603, the conference server 200 determines whether the video conference picture matches the shared picture based on the grayscale image.

If the determination in step S603 is negative, in step S604, the conference server 200 records the problem participant list. Specifically, if the conference server 200 determines that the video conference screen does not match the shared screen based on the grayscale image, the conference server 200 may record the conference participant name of the electronic device that provides the video conference screen to the problem participant list.

If the determination in step S603 is yes, in step S605, the conference server 200 determines whether the screen matching status of all conference participants has been analyzed. In addition, if the conference server 200 receives the screen matching confirmation message from one of the electronic devices 120, 130, and 140, following step S605, the conference server 200 determines whether the screen matching status of all conference participants has been analyzed.

If the determination in step S605 is No, return to step S601. If the determination in step S605 is yes, it means that the analysis of the screen matching status of the electronic devices 120, 130, and 140 has been completed. In step S606, the conference server 200 determines whether there is a conference participant whose video conference screen does not match the shared screen by reading the problem participant list. If the determination in step S606 is yes, in step S607, the conference server 200 controls the electronic device 110 to provide a screen sharing failure notification. If the determination in step S606 is negative, in step S608, the conference server 200 controls the electronic device 110 to provide a screen sharing success notification.

In summary, in embodiments of the present invention, a machine learning model can be used to analyze the conference images played by the electronic devices of each conference participant, and the above analysis results can be compared with the speaker's shared content. In addition, in order to avoid misjudgments by the machine learning model and lead to incorrect screen matching results, the grayscale data of the shared screen can be compared with the grayscale data of the video conference screen to reconfirm the screen matching results. In response to whether the comparison results of the conference images of each conference participant are in line with expectations or not as expected, a screen sharing success notification or a screen sharing failure notification can be automatically provided to the presenter, thereby improving the smoothness and convenience of the video conference.

Although the present invention has been disclosed above through embodiments, they are not intended to limit the present invention. Anyone with ordinary knowledge in the technical field may make some modifications and modifications without departing from the spirit and scope of the present invention. Therefore, The protection scope of the present invention shall be determined by the appended patent application scope.

10:Video conferencing system

110～140: Electronic devices

200:Conference server

U1,U2,U3,U4: User processor

140:Camera

51,52,53: Video conferencing operation interface

N1, N2: Screen sharing failure notification

N3: Screen sharing success notification

A1: Name of conference participant

C1_1,C2_1:Character

RC1: base character

S1: Share the screen

F1, F2: Video conference screen

obj1:image object

Robj1: Baseline image object

S210～S240, S301～S316, S601～S608: steps

FIG. 1 is a block diagram of a video conferencing system according to an embodiment of the present invention. FIG. 2 is a flow chart of a video conference screen sharing method according to an embodiment of the present invention. FIG. 3 is a flow chart of a video conference screen sharing method according to an embodiment of the present invention. FIG. 4 is a schematic diagram of comparing a video conference screen and a sharing screen according to an embodiment of the present invention. 5A to 5C are schematic diagrams of providing screen sharing status notification according to an embodiment of the present invention. FIG. 6 is a flowchart of a conference server controlling an electronic device to provide screen sharing status notification according to an embodiment of the present invention.

S210~S240: steps

Claims (20)

A video conference screen sharing method, suitable for video conference systems, the method includes: conducting a video conference, capturing the first video conference screen of the first electronic device; using a machine learning model to identify the first video conference screen by comparing the screen content of the first video conference screen with the screen content of a shared screen, determining whether the first video conference screen of the first electronic device matches the screen content of a second electronic device Sharing the picture, wherein the sharing picture is generated by the second electronic device; and based on the matching result of the first video conference picture of the first electronic device and the sharing picture of the second electronic device, by The second electronic device provides corresponding screen sharing status notification. The screen sharing method of a video conference as described in claim 1, wherein the step of using the machine learning model to identify the screen content of the first video conference screen includes: using an object detection model to detect the first video conference At least one image object in the screen; and using a text recognition model to identify at least one character in the first video conference screen. The video conference screen sharing method as described in claim 2, wherein the screen content of the first video conference screen is compared with the screen content of the shared screen. The step of determining whether the first video conference screen matches the shared screen includes: comparing the at least one image object of the first video conference screen with at least one reference image object of the shared screen; comparing To the at least one character of the first video conference picture and the at least one reference character of the shared picture; and in response to the at least one image object being the same as the at least one reference image object and the at least one If the characters are the same as the at least one reference character, it is determined that the first video conference picture matches the shared picture. The screen sharing method of a video conference as described in claim 3, wherein it is determined whether the first video conference screen matches the shared screen by comparing the screen content of the first video conference screen with the screen content of the shared screen. The step of the picture includes: in response to the at least one image object not being the same as the at least one reference image object or the at least one character not being the same as the at least one reference character, determining that the first video conference picture is not the same as the at least one reference character. Matches said shared screen. The video conference screen sharing method as described in claim 3, the method further includes: using the object detection model to detect the at least one reference image object in the shared screen; and using the text recognition model Identify the at least one reference character in the shared screen. The screen sharing method of video conference as described in claim 1, wherein based on the matching result of the first video conference screen and the shared screen, the second electronic device provides the corresponding screen sharing status notification The step includes: in response to the fact that the first video conference screen does not match the shared screen, determining the first video conference screen and the shared screen according to the grayscale data of the first video conference screen and the grayscale data of the shared screen. the difference of the shared screen; and if the difference of the first video conference screen and the shared screen does not meet a preset condition, provide a screen sharing through the video conference operating interface of the second electronic device Failure notification. The screen sharing method of a video conference as described in claim 6, wherein the screen sharing failure notification provided by the second electronic device presents a conference participant name corresponding to the first electronic device. The video conference screen sharing method as described in claim 6, the method further includes: if the difference between the first video conference screen and the shared screen does not meet the preset condition, through the third A video conference operating interface of an electronic device provides another screen sharing failure notification. The video conference screen sharing method as described in claim 6, the method further includes: if the difference between the first video conference screen and the shared screen meets the preset condition, determine the first The video conference screen matches the shared screen. The screen sharing method of video conference as described in claim 1, wherein based on the matching result of the first video conference screen and the shared screen, the second electronic device provides the corresponding screen sharing status notification The step includes: in response to the first video conferencing screen matching the sharing screen and the plurality of second video conferencing screens of the plurality of third electronic devices matching the sharing screen, operating the video conferencing via the second electronic device The interface provides a screen sharing success notification. A video conference system includes: a first electronic device, conducting a video conference, capturing a first video conference picture, using a machine learning model to identify the picture content of the first video conference picture, and comparing the The screen content of the first video conference screen and the screen content of a shared screen are used to determine whether the first video conference screen of the first electronic device matches the shared screen; a second electronic device generates the shared screen; and a conference server, connecting the first electronic device and the second electronic device, based on the matching of the first video conference screen of the first electronic device and the shared screen of the second electronic device As a result, the second electronic device is controlled to provide a corresponding screen sharing status notification. The video conference system of claim 11, wherein the first electronic device uses an object detection model to detect at least one image object in the first video conference screen, and uses a text recognition model to identify the first At least one character in the video conference screen. The video conferencing system of claim 11, wherein the first electronic device compares the at least one image object of the first video conferencing screen with at least one reference image object of the shared screen, and compares the The at least one character of the first video conference picture is the same as the at least one base character of the shared picture, and the at least one image object is the same as the at least one base image object and the at least one character is the same Based on the at least one reference character, it is determined that the first video conference picture matches the shared picture. The video conferencing system of claim 13, wherein the first electronic device responds that the at least one image object is not the same as the at least one reference image object or the at least one character is not the same as the at least one Reference characters are used to determine that the first video conference picture does not match the shared picture. The video conferencing system of claim 13, wherein the second electronic device uses the object detection model to detect the at least one reference image object in the shared screen, and uses the text recognition model to identify the The at least one base character in the shared screen. The video conferencing system of claim 11, wherein in response to the first video conferencing screen not matching the shared screen, the conference server matches the shared screen based on the grayscale data of the first video conferencing screen. The grayscale data determines the degree of difference between the first video conference screen and the shared screen, wherein if the difference between the first video conference screen and the shared screen does not meet a preset condition, the third The two electronic devices provide a screen sharing failure notification through the video conference operating interface of the second electronic device. The video conferencing system of claim 16, wherein the screen sharing failure notification provided by the second electronic device presents conference participant names corresponding to the first electronic device. The video conferencing system of claim 16, wherein if the difference between the first video conferencing screen and the shared screen does not meet the preset condition, the first electronic device communicates via the first electronic The device's video conferencing interface provides another screen sharing failure notification. The video conference system of claim 16, wherein if the difference between the first video conference screen and the shared screen meets the preset condition, the conference server determines that the first video conference screen Matches said shared screen. The video conferencing system of claim 11, further comprising: a plurality of third electronic devices connected to the conferencing server, wherein the response to the first video conferencing screen matches the sharing screen and the third electronic device A plurality of second video conferencing screens of the device match the sharing screen, and the second electronic device provides a screen sharing success notification through the video conferencing operating interface of the second electronic device.