CN111010529A - Video conference method and system capable of realizing multi-person real-time annotation - Google Patents
Video conference method and system capable of realizing multi-person real-time annotation Download PDFInfo
- Publication number
- CN111010529A CN111010529A CN201911363155.0A CN201911363155A CN111010529A CN 111010529 A CN111010529 A CN 111010529A CN 201911363155 A CN201911363155 A CN 201911363155A CN 111010529 A CN111010529 A CN 111010529A
- Authority
- CN
- China
- Prior art keywords
- annotation
- conference
- video
- control module
- annotated
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
Abstract
The invention relates to the technical field of conference equipment, in particular to a video conference method and a system capable of realizing multi-person real-time annotation; the method comprises the steps of obtaining a picture layer to be annotated, which is required to be displayed by a conference, receiving a plurality of annotation instructions generated by different annotation modules, converting the annotation instructions into annotation tracks with different colors respectively, superposing the annotation tracks to the picture layer to be annotated in real time to form an annotation superposition layer, recording the annotation superposition layer generated in real time at each moment, and generating an annotation process video; the system comprises a display module, a plurality of annotation modules, a control module and a centralized control module. The invention realizes that multiple offline persons participate in modifying the conferenced and displayed content by receiving a plurality of annotation instructions simultaneously during displaying the projected content of the conference; meanwhile, an online conference can be developed through the cloud server, so that multiple online persons can participate in annotation at the same time, and the progress of a conference agenda is promoted.
Description
Technical Field
The invention relates to the technical field of conference equipment, in particular to a video conference method and a video conference system capable of realizing multi-person real-time annotation.
Background
In the prior art, the offline meeting modes are generally divided into two modes, one mode is that a speaker projects a display page on a curtain for explanation or discussion, and the two display pages are shared by all meeting participants; the two conferencing forms have poor editability of the display content.
For a conference (for example, a conference such as technical drawing discussion and product development process discussion) requiring multiple people to issue opinions, multiple people are usually required to participate in the suggestion and comment and modify the displayed content, so that the final conference sharing consensus is achieved, any conference sharing form is difficult to support, and conference recording personnel often cannot perfectly reproduce the conference content.
Disclosure of Invention
The invention aims to overcome the defects that the prior conference display equipment cannot allow a plurality of people to participate in annotation at the same time, and the conference progress and communication efficiency are influenced.
In order to achieve the above object, the present invention provides a video conference method capable of being annotated by multiple persons in real time, which comprises the following steps:
the annotation system acquires a to-be-annotated picture layer required to be displayed by the conference, projects the to-be-annotated picture layer and receives annotation instructions generated by a plurality of different annotation modules;
the annotation system converts each annotation instruction into annotation tracks of different colors respectively, and superimposes each annotation track on the picture layer to be annotated in real time to form an annotation superimposed layer;
recording the annotation superposition layer generated in real time at each moment, generating an annotation process video, recording a conference audio signal of a conference environment, and synchronously integrating the annotation process video and the conference audio signal.
Further, the video conference method capable of being annotated by multiple persons in real time further comprises the following steps:
recognizing voice information in the conference audio signal, and converting the voice information into character information;
and synchronously associating the text information with the annotation process video, and establishing a link for jumping to a specific node of the annotation process video through the text information.
Further, the video conference method capable of being annotated by multiple persons in real time further comprises the following steps:
identifying the face information of the participants, and delivering the face information of the participants who speak to the annotation process video which is recorded.
Further, the video conference method capable of being annotated by multiple persons in real time further comprises the following steps:
the remote conference participants perform video and voice interaction with the annotation system through the mobile terminal, and the mobile terminal acquires the recorded annotation process video and conference audio signals and sends the remote video signals and the remote audio signals to the annotation system.
Further, the video conference method capable of being annotated by multiple persons in real time further comprises the following steps:
the local commenting system interacts with an online commenting system through a wide area network, and the online commenting system acquires the uploaded local picture layer to be commented or directly remotely calls the local picture layer to be commented which is not uploaded for display;
and adding annotation content to the local to-be-annotated picture layer which is being displayed on the online annotating system on line by the local annotating system or the online annotating system, and updating the annotation content to each interacting annotating system after annotation.
The invention also provides a multi-person real-time commenting video conference system, which comprises a commenting system, wherein the commenting system comprises a display module, a plurality of commenting modules, a control module and a centralized control module;
the annotation module is used for generating an annotation instruction in real time;
the centralized control module is used for managing all the accessed annotation modules in a centralized manner and outputting one or more annotation instructions generated by the annotation modules to the control module;
the control module is used for acquiring or calling a to-be-annotated picture layer required to be displayed by a locally preset conference from an external terminal, converting the to-be-annotated picture layer into annotation tracks with different colors according to annotation instructions received from the centralized control module, and superposing the annotation tracks to the to-be-annotated picture layer in real time, so that an annotation superposed layer is formed, the annotation superposed layer generated in real time at each moment is recorded, and an annotation process video is generated;
the display module is used for acquiring the annotation superposition layer at each moment or the annotation flow video formed by the annotation superposition layers at each moment;
each annotating module is respectively in communication connection with the input end of the centralized control module, the output end of the centralized control module is in communication connection with the input end of the control module, and the output end of the control module is in communication connection with the input end of the display module.
Furthermore, the annotating system also comprises a sound collection module for collecting conference audio signals and a face collection module for identifying face information of participants, wherein the sound collection module and the face collection module are respectively electrically connected with the control module, the conference audio signals and the annotating process video are synchronously stored in the control module, the control module judges a speaker according to the tone, the loudness, the generation direction and the face information of the conference audio signals, and puts the face information of the speaker in the recorded annotating process video in real time.
Furthermore, the control module is provided with a voice recognition unit, the voice recognition unit is used for screening voice information in the conference audio signal and converting the voice information into text information, and the control module associates the text information with corresponding content of the annotation process video and establishes a link for jumping to the corresponding content of the annotation process video through the text information.
Furthermore, the multi-user real-time annotation video conference system further comprises a cloud server, wherein the cloud server is in communication connection with the control module and is used for storing the annotation overlay layer or the annotation process video uploaded by the control module and downloading the uploaded annotation overlay layer or the annotation process video by the control module.
Furthermore, the video conference system capable of realizing multi-person real-time annotation further comprises a mobile terminal, wherein the mobile terminal is in communication connection with the annotation system through a cloud server, and the mobile terminal is used for acquiring the annotation process video and the conference audio signal which are recorded at present and sending a remote video signal and a remote audio signal to the annotation system.
Furthermore, the cloud server is further used for being in real-time communication connection with at least two groups of annotation systems, each group of annotation systems acquires an image layer to be annotated, which is required to be displayed by the conference, from the cloud server or directly calls the image layer to be annotated, which is stored by the other annotation system, through the cloud server, any annotation system interacting with the cloud server generates an annotation superposition layer and then uploads the annotation superposition layer to the cloud server in real time, and the rest of annotation systems acquire the annotation superposition layer from the cloud server for displaying or further annotating.
The invention has the beneficial effects that: the conference projection content is displayed, a plurality of annotation instructions are received at the same time, and therefore offline multi-people participate in modifying the conference display content; meanwhile, an online conference can be developed through the cloud server, online multiple persons are supported to participate in annotation, and conference agenda progress is promoted.
Drawings
FIG. 1: the invention discloses a structural schematic diagram of a first embodiment of a video conference system capable of being annotated by multiple persons in real time.
FIG. 2: the invention discloses a structural schematic diagram of a second embodiment of a video conference system capable of being annotated by multiple persons in real time.
FIG. 3: the invention discloses a flow diagram of a first embodiment of a video conference method capable of being annotated by multiple persons in real time.
FIG. 4: the invention discloses a flow diagram of a second embodiment of a video conference method capable of being annotated by multiple persons in real time.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the embodiments and the accompanying drawings.
It should be noted that suffixes such as "system", "module", or "unit" used for representing elements are only for facilitating the description of the present invention, and have no specific meaning in itself.
Example one
Fig. 1 is a schematic structural diagram of a video conference system capable of real-time annotation by multiple people according to an embodiment of the present invention. As shown in fig. 1, the multi-person real-time annotating video conference system includes an annotating system 100, a cloud server 200 and a mobile terminal 300, and the following describes each component of the multi-person real-time annotating video conference system in this embodiment in detail with reference to fig. 1:
in practical applications, the annotating system 100, the cloud server 200 and the mobile terminal 300 maintain communication connection through a wide area network, and the annotating system 100 includes a plurality of annotating modules 110, a centralized control module 120, a control module 130, a display module 140, a sound collection module 150 and a face collection module 160.
The structure of the annotation system 100 is: each annotating module 110 is respectively connected with the input end of the centralized control module 120 in a communication way, the output end of the centralized control module 120 is connected with the input end of the control module 130 in a communication way, the sound collecting module 150 is electrically connected with the control module 130, the output end of the control module 130 is connected with the input end of the display module 140 in a communication way, and the sound collecting module 150 and the human face collecting module 160 are respectively connected with the input end of the control module 130 in a communication way.
The annotating module 110 is used for generating annotating instructions in real time, the annotating module 110 can be a mouse, a touch pad, a touch screen or a touch pen, the annotating module 110 is connected with the centralized control module 120 through a wired or wireless (bluetooth), and one annotating module 110 corresponds to one independent output channel in the centralized control module 120.
The centralized control module 120 is configured to centrally manage all the accessed annotating modules 110, and a user can selectively set annotating instructions generated by the accessed annotating modules 110 through the centralized control module 120; specifically, the user outputs or masks the corresponding annotation command by opening or closing the output channel. The function of the centralized control module 120 may be implemented by hardware or software, where the hardware implementation may be to set an electronic switch to control the on/off of the output channel, and the software implementation may be to set a corresponding output channel on/off control panel to control the on/off of the output channel on the panel.
The sound collection module 150 is an omnidirectional microphone for collecting conference audio signals in a field environment.
The face collecting module 160 is a camera for collecting face information of the participants on site.
The control module 130 is used for managing the overall logic of the annotation system 100, and the control module 130 includes a collecting unit 131, a processing unit 132, a communication unit 133, a storage unit 134 and a voice recognition unit 135. Wherein:
the collecting unit 131 (such as a pulse signal sensor, a photoelectric sensor or a wireless signal receiver) is configured to obtain the annotation command output by the centralized control module 120, and transmit the annotation command to the processing unit 132;
the processing unit 132 (e.g., a CPU or a GPU) is configured to obtain or retrieve a to-be-annotated picture layer required to be displayed in a locally preset conference from an external terminal (e.g., a mobile phone, a tablet computer, a laptop, a palm-top computer, a personal digital assistant, a portable media player, a navigation device, a wearable device, a pedometer, and the like, as well as a digital TV, a desktop computer, and the like), form an annotation picture layer according to an annotation instruction received from the centralized control module 120, superimpose each annotation picture layer at that time on the to-be-annotated picture layer in real time, generate a corresponding annotation superimposed layer, record and store the annotation superimposed layer, generate an annotation process video, and integrate the annotation process video and a conference audio signal generated in real time;
the voice recognition unit 135 is used to screen the voice information in the conference audio signal, and recognize the tone, loudness and direction of production of the voice information, so that the processing unit 132 can determine the identity of the speaker. It should be noted that the voice recognition unit 135 distinguishes the current speaker through three parameters, namely, the tone, the loudness and the generation direction of the voice information, if at least one of the three parameters, namely, the tone, the loudness and the generation direction, changes significantly, it is determined that another person is speaking, the approximate location information of the speaker is sent to the processing unit 132, the processing unit 132 recognizes the current speaker in combination with the dynamic change of the face information of the conference participants collected by the face collection module 160, and projects the face information of the current speaker into the annotation process video being recorded for prompting.
The communication unit 133 (such as a wifi module, a 4g module, or a network cable) is used for interconnecting the processing unit 132 and the cloud processor;
the storage unit 134 is used for storing historical picture layers to be annotated, annotation process videos and conference audio signals.
The display module 140 (e.g., an LCD display screen, etc.) is configured to obtain the annotation overlay layer or the annotation process video at each time, and project the image content corresponding to the annotation overlay layer or the annotation process video at each time in real time.
The cloud server 200 is in communication connection with the control module 130 in real time, and the cloud server 200 is configured to manage locally uploaded content, including storing the annotation overlay or the annotation process video uploaded by the control module 130 and allowing the control module 130 to download the uploaded annotation overlay or the annotation process video.
The mobile terminal 300 may be a smart phone, a tablet computer, a notebook computer, a palm top computer, a personal digital assistant, a portable media player, a navigation device, a wearable device, a pedometer, etc., and a digital TV, a desktop computer, etc., for participating in a conference through remote video communication with the annotation system 100 of the conference site through the cloud server 200.
Although not shown in fig. 1, the annotation system 100 can further include a remote control module or the like for wirelessly controlling the operating state of the annotation system 100, which is not described herein.
In practical application, the annotation screen layer includes a reference position graph of the annotation module 110 and an annotation instruction corresponding to the annotation module 110, so as to facilitate a user to annotate the annotation screen layer, in the annotation screen layer, the reference position graph (cursor) corresponding to each annotation module 110 is presented in different forms, including different colors and different shapes, and the path forms corresponding to the annotation instructions of each annotation module 110 are also different, including different colors and different line diameters.
Referring to fig. 3, a schematic flow diagram of a video conference method for multi-user real-time annotation provided by an embodiment of the present invention is shown, where the video conference method for multi-user real-time annotation realized by a video conference system for multi-user real-time annotation in the present embodiment includes the following steps:
and S11, acquiring a picture layer to be annotated, which needs to be displayed in the conference, and receiving a plurality of annotation instructions generated by different annotation modules.
And S12, converting the annotation instructions into annotation tracks of different colors respectively, and superposing the annotation tracks to the picture layer to be annotated in real time to form an annotation superposition layer.
And S13, recording the annotation superposition layer generated in real time at each moment, generating an annotation process video, recording a conference audio signal of the conference environment, and synchronously integrating the annotation process video and the conference audio signal.
For some occasions needing multiple persons to participate in speaking, such as research and development conferences or technical scheme discussion conferences, the conference projection equipment can only support a single person to carry out real-time annotation, the annotation modules 110 need to be spoken in turn and used in turn, and only one person can carry out annotation at the same time, which is quite inconvenient.
In this embodiment, the video conference system capable of annotating multiple persons in real time supports simultaneous use of multiple annotating modules 110, so that multiple persons can participate in annotation on site at the same time. Specifically, the control module 130 obtains a to-be-annotated picture layer to be displayed from an external terminal, where the to-be-annotated picture layer may be obtained by downloading from the cloud server 200, obtaining via bluetooth, obtaining via other network, or obtaining via a usb disk, and the to-be-annotated picture layer may be a technical drawing, a process flow diagram, an engineering blueprint, a text document, a slide, or the like, and is displayed via the display module 140 after being obtained; when a conference is in progress, participants respectively control one annotation module 110 to send out annotation instructions, the control module 130 obtains the annotation instructions in real time, and converts all the obtained annotation instructions into annotation tracks of different colors respectively to be superposed on a picture layer to be annotated, so that a multi-user annotation effect is achieved.
Meanwhile, the control module 130 has a recording and storing function, so as to facilitate the user to reserve and share the conference record, the control module 130 records the process of annotating the picture layer to be annotated by the user, which may be recording in the whole process or recording in a selected time interval, and during the recording, the conference audio signal of the surrounding environment is collected at the same time, and the annotation flow video and the conference audio signal are integrated, so that the user can store the annotation flow video and the conference record in the storage unit 134 of the control module 130 as the conference record, and when the user can recall or upload the integrated annotation flow video again, and recall the integrated annotation flow video again, the user can re-annotate on a certain annotation layer of the annotation flow video, and update the content of the annotation flow video.
Further, the video conference method capable of being annotated by multiple persons in real time further comprises the following steps:
and S21, recognizing the voice information in the conference audio signal and converting the voice information into character information.
And S22, synchronously associating the text information with the annotation process video, and establishing a link for jumping to a specific node of the annotation process video through the text information.
During the conference, the sound collection module 150 records the conference audio signal in real time, the voice recognition unit 135 recognizes the voice information in real time and converts the voice information into text information, and after the conference is finished, the general content of the conference can be mastered quickly through the text information; the processing unit 132 further associates the text information with the annotation process video synchronously, so that the user can jump to a corresponding node of the annotation process video to start watching by selecting the text information, specifically, a generating node of the voice information corresponding to the recorded text information, and the voice information and the annotation process video are integrated synchronously, so as to find the corresponding node of the annotation process video.
Further, the video conference method capable of being annotated by multiple persons in real time further comprises the following steps:
and S31, identifying the face information of the conference participants, and delivering the face information of the conference participants who are speaking to the recorded annotation process video.
In the process of a conference, the recorded annotation process video does not contain a recorded field environment, in order to enable a person watching the annotation process video to easily know the identity of a speaker, the face acquisition module 160 acquires face information of field participants in real time, and the processing unit 132 determines the identity of the speaker according to dynamic changes of the face information and the approximate generation position of the audio signal and projects the identity of the speaker into the annotation process video. Specifically, the annotation process video projected by the display module 140 is divided into at least two parts, one part is a to-be-annotated picture layer being annotated, and the other part is a conference participant information display part, where the face information of the current speaker is displayed on the conference participant information display part.
Further, the video conference method capable of being annotated by multiple persons in real time further comprises the following steps:
s41, the remote conference participant performs video and voice interaction with the annotation system 100 through the mobile terminal 300, and the mobile terminal 300 obtains the recorded annotation process video and conference audio signal, and sends the remote video signal and the remote audio signal to the annotation system 100.
If some people can not participate in the offline conference on site, the people can use the mobile terminal 300 to connect with the cloud server 200, then remotely access the onsite annotation system 100, the remote conference participants can obtain the video of the annotation process and the audio signal of the conference recorded on site through the mobile terminal 300, and the onsite annotation system 100 can also obtain the remote video signal and the remote audio signal transmitted by the mobile terminal 300, so that the remote conference participants participate in the conference discussion.
Example two
Please refer to fig. 2, which is a schematic structural diagram of a video conference system capable of real-time annotation by multiple people according to a second embodiment of the present invention. This but video conference system of many people real-time endorsements includes cloud server 200 and a plurality of endorsement system 100, and wherein, each endorsement system 100 passes through wide area network and is connected with cloud server 200 communication, and the specific structure component part of endorsement system 100, part function and the independent offline conferencing mode all are the same with above-mentioned embodiment one to this embodiment also can contain above-mentioned mobile terminal 300, and the repeated description is omitted here.
In this embodiment, the cloud server 200 is connected to at least two groups of annotation systems 100 in real-time communication, so that the annotation systems 100 can transmit data to each other. Specifically, the annotation system 100 obtains, in real time, a to-be-annotated picture layer to be displayed from the cloud server 200, where the to-be-annotated picture layer may be stored in the cloud server 200 in advance, or one of the annotation systems 100 may be temporarily uploaded to the cloud server 200, or one of the annotation systems 100 may be directly invoked from another interacting annotation system 100, and in the interaction process, after any one of the annotation systems 100 annotates the to-be-annotated picture layer, an annotation result thereof is updated to other interacting annotation systems 100 in real time to be displayed.
Referring to fig. 4, a schematic flow diagram of a video conference method capable of multi-user real-time annotation is provided for a second embodiment of the present invention, where the video conference method capable of multi-user real-time annotation in the present embodiment is described below, and the video conference method capable of multi-user real-time annotation includes the following steps:
s51, the local annotation system 100 interacts with the online annotation system 100 through a wide area network, and the online annotation system 100 acquires the uploaded local image layer to be annotated or directly remotely calls the local image layer to be annotated which is not uploaded for display;
s52, the local annotation system 100 or the online annotation system 100 adds annotation content to the local image layer to be annotated being displayed on the line, and updates the annotation content to each interactive annotation system 100 after annotation.
Specifically, the video conference system capable of annotating multiple people in real time provided by the embodiment can support online conferences and support online annotation of multiple people at the same time. Before a teleconference is carried out, each annotation system 100 acquires a to-be-annotated picture layer required to be displayed, wherein the acquisition mode is that one annotation system 100 actively uploads the to-be-annotated picture layer required to be displayed in the teleconference to a server, and other annotation systems 100 acquire the to-be-annotated picture layer in real time from a cloud server 200; or one annotation system 100 can temporarily and remotely control another annotation system 100 to call the required picture layer to be annotated for displaying.
In the meeting process, any one annotation system 100 can annotate the acquired picture layer to be annotated, and the control module 130 of the annotation system 100 uploads the superimposed annotation content to the previous picture layer to be annotated to the cloud server 200 in real time so as to update the superimposed annotation content to other annotation systems 100; in the teleconference, the conference audio signal obtained by the sound collection module 150 is transmitted to the other interacting annotation systems 100 through the cloud server 200 in real time for playing.
In summary, the video conference method and system capable of being annotated by multiple persons in real time provided by the invention receive multiple annotation instructions simultaneously during displaying the conference projection content, thereby realizing that the offline multiple persons participate in modifying the conference display content; meanwhile, an online conference can be developed through the cloud server, online multiple persons are supported to participate in annotation, conference agenda progress is promoted, and the method has remarkable progress significance.
Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art will understand that various changes, modifications and substitutions can be made without departing from the spirit and scope of the invention as defined by the appended claims. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (11)
1. A video conference method capable of being annotated by multiple persons in real time is suitable for an annotation system capable of being annotated by multiple persons in real time, and is characterized by comprising the following steps:
the annotation system acquires a to-be-annotated picture layer required to be displayed by the conference, projects the to-be-annotated picture layer and receives annotation instructions generated by a plurality of different annotation modules;
the annotation system converts each annotation instruction into annotation tracks of different colors respectively, and superimposes each annotation track on the picture layer to be annotated in real time to form an annotation superimposed layer;
recording the annotation superposition layer generated in real time at each moment, generating an annotation process video, recording a conference audio signal of a conference environment, and synchronously integrating the annotation process video and the conference audio signal.
2. The method for video conferencing with real-time annotation by multiple people according to claim 1, further comprising the steps of:
recognizing voice information in the conference audio signal, and converting the voice information into character information;
and synchronously associating the text information with the annotation process video, and establishing a link for jumping to a specific node of the annotation process video through the text information.
3. The method for video conferencing with real-time annotation by multiple people according to claim 1, further comprising the steps of: identifying the face information of the participants, and delivering the face information of the participants who speak to the annotation process video which is recorded.
4. The method for video conferencing with real-time annotation by multiple people according to claim 1, further comprising the steps of: the remote conference participants perform video and voice interaction with the annotation system through the mobile terminal, and the mobile terminal acquires the recorded annotation process video and conference audio signals and sends the remote video signals and the remote audio signals to the annotation system.
5. The method for video conferencing with real-time annotation by multiple people according to claim 1, further comprising the steps of:
the local commenting system interacts with an online commenting system through a wide area network, and the online commenting system acquires the uploaded local picture layer to be commented or directly remotely calls the local picture layer to be commented which is not uploaded for display;
and adding annotation content to the local to-be-annotated picture layer which is being displayed on the online annotating system on line by the local annotating system or the online annotating system, and updating the annotation content to each interacting annotating system after annotation.
6. A video conference system capable of realizing multi-person real-time annotation comprises an annotation system, and is characterized in that the annotation system comprises a display module, a plurality of annotation modules, a control module and a centralized control module;
the annotation module is used for generating annotation instructions in real time;
the centralized control module is used for managing all the accessed annotation modules in a centralized manner and outputting one or more annotation instructions generated by the annotation modules to the control module;
the control module is used for acquiring or calling a to-be-annotated picture layer required to be displayed by a locally preset conference from an external terminal, converting the to-be-annotated picture layer into annotation tracks with different colors according to annotation instructions received from the centralized control module, and superposing the annotation tracks to the to-be-annotated picture layer in real time, so that an annotation superposed layer is formed, the annotation superposed layer generated in real time at each moment is recorded, and an annotation process video is generated;
the display module is used for acquiring the annotation superposition layer at each moment or the annotation flow video formed by the annotation superposition layers at each moment;
each annotating module is respectively in communication connection with the input end of the centralized control module, the output end of the centralized control module is in communication connection with the input end of the control module, and the output end of the control module is in communication connection with the input end of the display module.
7. The system of claim 6, further comprising a voice collecting module for collecting conference audio signals and a face collecting module for identifying face information of participants, wherein the voice collecting module and the face collecting module are electrically connected to the control module respectively, the conference audio signals and the annotation process video are synchronously stored in the control module, the control module identifies the speaker according to the tone, loudness and generating direction of the conference audio signals and the face information, and puts the face information of the speaker in the recorded annotation process video in real time.
8. The system of claim 7, wherein the control module is provided with a voice recognition unit, the voice recognition unit is configured to filter voice information in the conference audio signal and convert the voice information into text information, and the control module associates the text information with corresponding content of the annotation process video to establish a link for jumping to the corresponding content of the annotation process video through the text information.
9. The multi-user real-time annotation video conference system according to claim 6, further comprising a cloud server, wherein the cloud server is in communication connection with the control module, and the cloud server is used for storing the annotation overlay or the annotation process video uploaded by the control module and allowing the control module to download the uploaded annotation overlay or the annotation process video.
10. The system of any one of claims 6 to 9, further comprising a mobile terminal, wherein the mobile terminal is in communication connection with the annotation system through a cloud server, and the mobile terminal is configured to obtain the recorded annotation process video and conference audio signal, and send a remote video signal and a remote audio signal to the annotation system.
11. The multi-user real-time endorsement video conference system of claim 8, wherein the cloud server is further configured to connect at least two sets of endorsement systems in real-time communication, each set of the endorsement systems obtains the to-be-endorsed image layer to be displayed in the conference from the cloud server or directly calls the to-be-endorsed image layer stored in another endorsement system through the cloud server, any one of the endorsement systems that is interacting with the cloud server generates the endorsement overlay and then uploads the generated endorsement overlay to the cloud server in real time, and the other endorsement systems obtain the endorsement overlay from the cloud server for display or further endorsement.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911363155.0A CN111010529A (en) | 2019-12-25 | 2019-12-25 | Video conference method and system capable of realizing multi-person real-time annotation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911363155.0A CN111010529A (en) | 2019-12-25 | 2019-12-25 | Video conference method and system capable of realizing multi-person real-time annotation |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111010529A true CN111010529A (en) | 2020-04-14 |
Family
ID=70117998
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911363155.0A Pending CN111010529A (en) | 2019-12-25 | 2019-12-25 | Video conference method and system capable of realizing multi-person real-time annotation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111010529A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111405234A (en) * | 2020-04-17 | 2020-07-10 | 杭州大轶科技有限公司 | Video conference information system and method with integration of cloud computing and edge computing |
| CN111654661A (en) * | 2020-06-17 | 2020-09-11 | 深圳康佳电子科技有限公司 | Video conference annotation method, video conference server and storage medium |
| CN112804476A (en) * | 2021-01-06 | 2021-05-14 | 武汉兴图新科电子股份有限公司 | Cross-network multi-party interaction and information sharing solution applied to cloud video |
| CN113485567A (en) * | 2021-07-09 | 2021-10-08 | 上海明我信息技术有限公司 | Motion trajectory synchronization method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9509733B2 (en) * | 2013-03-29 | 2016-11-29 | Brother Kogyo Kabushiki Kaisha | Program, communication apparatus and control method |
| CN108769782A (en) * | 2018-06-20 | 2018-11-06 | 广州华欣电子科技有限公司 | A kind of more equipment room screen contents synchronize the method and system of annotation |
| CN109889759A (en) * | 2019-02-02 | 2019-06-14 | 视联动力信息技术股份有限公司 | A kind of exchange method and system regarding networked video meeting |
| CN110210835A (en) * | 2019-06-04 | 2019-09-06 | 成都四通瑞坤科技有限公司 | Control method and system are realized in a kind of intelligent and high-efficiency meeting |
| WO2019180670A1 (en) * | 2018-03-23 | 2019-09-26 | Bansal Sanjay | Immersive telepresence video conference system |
-
2019
- 2019-12-25 CN CN201911363155.0A patent/CN111010529A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9509733B2 (en) * | 2013-03-29 | 2016-11-29 | Brother Kogyo Kabushiki Kaisha | Program, communication apparatus and control method |
| WO2019180670A1 (en) * | 2018-03-23 | 2019-09-26 | Bansal Sanjay | Immersive telepresence video conference system |
| CN108769782A (en) * | 2018-06-20 | 2018-11-06 | 广州华欣电子科技有限公司 | A kind of more equipment room screen contents synchronize the method and system of annotation |
| CN109889759A (en) * | 2019-02-02 | 2019-06-14 | 视联动力信息技术股份有限公司 | A kind of exchange method and system regarding networked video meeting |
| CN110210835A (en) * | 2019-06-04 | 2019-09-06 | 成都四通瑞坤科技有限公司 | Control method and system are realized in a kind of intelligent and high-efficiency meeting |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111405234A (en) * | 2020-04-17 | 2020-07-10 | 杭州大轶科技有限公司 | Video conference information system and method with integration of cloud computing and edge computing |
| CN111654661A (en) * | 2020-06-17 | 2020-09-11 | 深圳康佳电子科技有限公司 | Video conference annotation method, video conference server and storage medium |
| CN111654661B (en) * | 2020-06-17 | 2022-03-01 | 深圳康佳电子科技有限公司 | Video conference annotation method, video conference server and storage medium |
| CN112804476A (en) * | 2021-01-06 | 2021-05-14 | 武汉兴图新科电子股份有限公司 | Cross-network multi-party interaction and information sharing solution applied to cloud video |
| CN113485567A (en) * | 2021-07-09 | 2021-10-08 | 上海明我信息技术有限公司 | Motion trajectory synchronization method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111010529A (en) | Video conference method and system capable of realizing multi-person real-time annotation | |
| US10033967B2 (en) | System and method for interactive video conferencing | |
| US9407866B2 (en) | Joining an electronic conference in response to sound | |
| Ziegler et al. | Present? Remote? Remotely present! New technological approaches to remote simultaneous conference interpreting | |
| US11310463B2 (en) | System and method for providing and interacting with coordinated presentations | |
| WO2012100114A2 (en) | Multiple viewpoint electronic media system | |
| EP3131257B1 (en) | Program, information processing apparatus, and information processing system for use in an electronic conference system | |
| US20130215214A1 (en) | System and method for managing avatarsaddressing a remote participant in a video conference | |
| US11457176B2 (en) | System and method for providing and interacting with coordinated presentations | |
| US20110267421A1 (en) | Method and Apparatus for Two-Way Multimedia Communications | |
| US20190074036A1 (en) | System and method for live video production monitoring and annotation | |
| CN102262344A (en) | Projector capable of sharing images of slides played immediately | |
| JP2006229903A (en) | Conference supporting system, method and computer program | |
| Ronzhin et al. | Context-aware mobile applications for communication in intelligent environment | |
| KR101994044B1 (en) | Smart integrated conference system | |
| WO2023093092A1 (en) | Minuting method, and terminal device and minuting system | |
| JP2005079913A (en) | Content creation system, lecture video creation system, video conference system | |
| JP2023130822A (en) | Apparatus system, imaging apparatus, and display method | |
| CN102263929A (en) | Conference video information real-time publishing system and corresponding devices | |
| CN113157241A (en) | Interaction equipment, interaction device and interaction system | |
| JP2012165170A (en) | Conference device, conference method and conference program | |
| JP2003339034A (en) | Network conference system, network conference method, and network conference program | |
| JP7226600B1 (en) | Recorded information creation system, recorded information creation method, program | |
| JP6823367B2 (en) | Image display system, image display method, and image display program | |
| EP4231632A1 (en) | Display system, display method, and carrier medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200414 |