CN113271429A - Video conference information processing method and device, electronic equipment and system - Google Patents
Video conference information processing method and device, electronic equipment and system Download PDFInfo
- Publication number
- CN113271429A CN113271429A CN202011065612.0A CN202011065612A CN113271429A CN 113271429 A CN113271429 A CN 113271429A CN 202011065612 A CN202011065612 A CN 202011065612A CN 113271429 A CN113271429 A CN 113271429A
- Authority
- CN
- China
- Prior art keywords
- video
- conference
- display image
- terminal display
- video conference
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a video conference information processing method, a video conference information processing device, electronic equipment and a video conference information processing system, and relates to the technical field of image processing. The video conference information processing method comprises the following steps: acquiring video conference information; determining size information of a multi-terminal display image and a conference video stream displayed on the multi-terminal display image; denoising a conference video stream displayed on a multi-terminal display image; and overlapping the denoised multi-terminal display image and the user interaction window, and then sending the image to a video conference host for display. Therefore, the video with high image quality and interactive content display is obtained, and the user can see the interactive information while watching the video with high image quality.
Description
Technical Field
The invention relates to the technical field of video conferences, in particular to a video conference information processing method, a video conference information processing device, electronic equipment and a video conference information processing system.
Background
With the development of network communication technology, users have higher and higher requirements for real-time video interaction, and therefore, a great number of video conference technologies and related devices have been derived. There are a large number of video conferencing devices on the market today, all with certain interactive functions (e.g. comment, allow/deny access to the conference, etc.). With the popularization of 5G and 4K technologies, a video conference APP can provide better experience on various types of display terminals, but in the current market, an interaction function in the display terminal is usually independent of displayed video conference content, a user needs to jump out or interact with the video conference through other channels, and an interaction instruction cannot be sent or received in real time during the video conference, so that the experience of the user is greatly reduced.
Disclosure of Invention
In order to overcome at least the above disadvantages in the prior art, the present invention provides a method, an apparatus, an electronic device and a system for processing video conference information.
In a first aspect, the present invention provides a method for processing video conference information, where the method is performed by a video conference participant, and is characterized by including:
acquiring video conference information, wherein the video conference information comprises conference video streams and a user command set, and the user command set comprises commands used when a user participates in a video conference for interaction;
determining size information of a multi-terminal display image and the conference video stream displayed on the multi-terminal display image;
denoising the conference video stream displayed on the multi-terminal display image;
and overlapping the denoised multi-terminal display image and a user interaction window, and then sending the image to a video conference host for display, wherein the user interaction window is used for displaying interaction contents corresponding to each command in the user command set, and comprises a covered first area determined according to the size information.
In a second aspect, an embodiment of the present invention further provides a video conference information processing apparatus, where the apparatus includes:
the system comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring video conference information, the video conference information comprises conference video streams and a user command set, and the user command set comprises commands used when a user participates in a video conference for interaction;
a determination unit configured to determine a multi-terminal display image and size information of the conference video stream displayed on the multi-terminal display image;
the processing unit is used for denoising the conference video stream displayed on the multi-terminal display image; and
and overlapping the denoised multi-terminal display image and a user interaction window, and then sending the image to a video conference host for display, wherein the user interaction window is used for displaying interaction contents corresponding to each command in the user command set, and comprises a covered first area determined according to the size information.
In a third aspect, an embodiment of the present invention further provides an electronic device, including:
the video conference system comprises a transceiver and a video conference system, wherein the transceiver acquires video conference information, the video conference information comprises conference video streams and a user command set, and the user command set comprises commands used when a user participates in a video conference for interaction;
a first chip that determines a multi-terminal display image and size information of the conference video stream displayed on the multi-terminal display image;
the second chip is used for denoising the conference video stream displayed on the multi-terminal display image;
and overlapping the denoised multi-terminal display image and a user interaction window, and then sending the image to a video conference host for display, wherein the user interaction window is used for displaying interaction contents corresponding to each command in the user command set, and comprises a covered first area determined according to the size information.
In a fourth aspect, an embodiment of the present invention further provides a video conference information processing system, where the system includes a cloud server and the video conference information processing apparatus, where the cloud server includes a processor, a machine-readable storage medium, and a network interface, where the machine-readable storage medium, the network interface, and the processor are connected through a bus system, the network interface is used for being communicatively connected to at least one video conference participant, the machine-readable storage medium is used for storing a program, an instruction, or a code, and the processor is used for executing the program, the instruction, or the code in the machine-readable storage medium to perform the video conference information processing method in any one of the first aspect and the possible designs of the first aspect.
In a fifth aspect, an embodiment of the present invention provides a computer-readable storage medium, where instructions are stored, and when executed, cause a computer to perform the video conference information processing method in the first aspect or any one of the possible designs of the first aspect.
Based on any one of the above aspects, the invention obtains the video conference information; determining size information of a multi-terminal display image and a conference video stream displayed on the multi-terminal display image; denoising a conference video stream displayed on a multi-terminal display image; and overlapping the denoised multi-terminal display image and the user interaction window, and then sending the image to a video conference host for display. Therefore, the video with high image quality and interactive content display is obtained, the user can see the interactive information while watching the video with high image quality, and the experience of the video conference user is enhanced.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.
Fig. 1 is a schematic view of an application scenario of a video conference information processing system according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of a video conference information processing method according to an embodiment of the present invention;
fig. 3 is a functional block diagram of a video conference information processing apparatus according to an embodiment of the present invention;
fig. 4 is a schematic block diagram of a structure of a cloud server for implementing the video conference information processing method according to the embodiment of the present invention.
Detailed Description
The present invention is described in detail below with reference to the drawings, and the specific operation methods in the method embodiments can also be applied to the apparatus embodiments or the system embodiments.
Fig. 1 is an interaction diagram of a video conference information processing system 10 according to an embodiment of the present invention. Video conference information processing system 10 may include a cloud server 100 and video conference participants 200 communicatively coupled to cloud server 100. The video conference information processing system 10 shown in fig. 1 is merely one possible example, and in other possible embodiments, the video conference information processing system 10 may include only a portion of the components shown in fig. 1 or may include other components.
In this embodiment, the video conference participants 200 may include mobile devices, tablet computers, laptop computers, and the like, or any combination thereof. In some embodiments, the mobile device may include a smart home device, a wearable device, a smart mobile device, a virtual reality device, an augmented reality device, or the like, or any combination thereof. In some embodiments, the smart home devices may include control devices of smart electrical devices, smart monitoring devices, smart televisions, smart cameras, and the like, or any combination thereof. In some embodiments, the wearable device may include a smart bracelet, a smart lace, smart glass, a smart helmet, a smart watch, a smart garment, a smart backpack, a smart accessory, or the like, or any combination thereof. In some embodiments, the smart mobile device may include a smartphone, a personal digital assistant, a gaming device, and the like, or any combination thereof. In some embodiments, the virtual reality device and/or the augmented reality device may include a virtual reality helmet, virtual reality glass, a virtual reality patch, an augmented reality helmet, augmented reality glass, an augmented reality patch, or the like, or any combination thereof. For example, the virtual reality device and/or augmented reality device may include various virtual reality products and the like.
In this embodiment, the internet-of-things cloud server 100 and the video conference participant 200 in the video conference information processing system 10 may execute the video conference information processing method described in the following method embodiment in a matching manner, and the specific steps executed by the cloud server 100 and the video conference participant 200 may refer to the detailed description of the following method embodiment.
To solve the technical problem in the foregoing background art, fig. 2 is a schematic flowchart of a video conference information processing method for processing video conference information according to an embodiment of the present invention, where the video conference information processing method provided in this embodiment may be executed by the cloud server 100 shown in fig. 1, and the video conference information processing method is described in detail below.
Step S110, acquiring video conference information, wherein the video conference information comprises a conference video stream and a user command set, and the user command set comprises commands used when a user participates in a video conference for interaction;
step S120, determining a multi-terminal display image and size information displayed by the conference video stream on the multi-terminal display image;
step S130, denoising the conference video stream displayed on the multi-terminal display image;
and step S140, overlapping the denoised multi-terminal display image and a user interaction window, and then sending the image to a video conference host for display, wherein the user interaction window is used for displaying the interaction content corresponding to each command in the user command set, and comprises a covered first area determined according to the size information.
In a possible embodiment, step S120 further comprises:
step S121: and obtaining the multi-terminal display image through a multi-terminal display image fusion technology.
In a possible embodiment, step S130 further comprises:
and adding an identifier on the multi-terminal display image, wherein the identifier is used for determining that the data subjected to denoising processing is a user source corresponding to the conference video stream displayed on the multi-terminal display image.
In a possible embodiment, step S120 further comprises:
step S122: determining the size of the video image in the conference video stream displayed on the multi-terminal display image according to the size of the video image in the conference video stream and the size of the multi-terminal display image;
step S123: and recording four-corner coordinate information or four-side margin information of the video image in the conference video stream on the multi-terminal display image.
Fig. 3 is a schematic functional module diagram of a video conference information processing apparatus 300 according to an embodiment of the present invention, and in this embodiment, functional modules of the video conference information processing apparatus 300 may be divided according to a method embodiment executed by the cloud server 100, that is, the following functional modules corresponding to the video conference information processing apparatus 300 may be used to execute the method embodiments executed by the cloud server 100. The video conference information processing apparatus 300 may include an obtaining unit 310, a determining unit 320, and a processing unit 330, and the functions of the functional modules of the video conference information processing apparatus 300 are described in detail below.
The obtaining unit 310 may be configured to execute step S110 described above, that is, configured to obtain video conference information, where the video conference information includes a conference video stream and a user command set, and the user command set includes a command used when a user participates in a video conference for interaction.
The determining unit 320 may be configured to perform the above-mentioned step S120, namely, to determine the multi-terminal display image and the size information of the conference video stream displayed on the multi-terminal display image.
The processing unit 330 may be configured to execute the above step S130, that is, perform denoising processing on the conference video stream displayed on the multi-terminal display image; and overlapping the denoised multi-terminal display image and a user interaction window, and then sending the image to a video conference host for display, wherein the user interaction window is used for displaying interaction contents corresponding to each command in the user command set, and comprises a covered first area determined according to the size information.
It should be noted that the division of the modules of the above apparatus is only a logical division, and the actual implementation may be wholly or partially integrated into one physical entity, or may be physically separated. And these modules can be realized in the form of software called by processing element; or may be implemented entirely in hardware; and part of the modules can be realized in the form of calling software by the processing element, and part of the modules can be realized in the form of hardware. For example, the obtaining unit 310 may be a processing element separately set up, or may be integrated into a chip of the apparatus, or may be stored in a memory of the apparatus in the form of program code, and the processing element of the apparatus calls and executes the functions of the obtaining unit 310. Other modules are implemented similarly. In addition, all or part of the modules can be integrated together or can be independently realized. The processing element described herein may be an integrated circuit having signal processing capabilities. In implementation, each step of the above method or each module above may be implemented by an integrated logic circuit of hardware in a processor element or an instruction in the form of software.
For example, the above modules may be one or more integrated circuits configured to implement the above methods, such as: one or more Application Specific Integrated Circuits (ASICs), or one or more microprocessors (DSPs), or one or more Field Programmable Gate Arrays (FPGAs), among others. For another example, when some of the above modules are implemented in the form of a processing element scheduler code, the processing element may be a general-purpose processor, such as a Central Processing Unit (CPU) or other processor that can call program code. As another example, these modules may be integrated together, implemented in the form of a system-on-a-chip (SOC).
Fig. 4 is a schematic diagram illustrating a hardware structure of the cloud server 100 for implementing the control device, according to an embodiment of the present invention, as shown in fig. 4, the cloud server 100 may include a processor 110, a machine-readable storage medium 120, a bus 130, and a transceiver 140.
In a specific implementation process, at least one processor 110 executes computer-executable instructions stored in the machine-readable storage medium 120 (for example, included in the video conference information processing apparatus 300 shown in fig. 3), so that the processor 110 may execute the video conference information processing method according to the above method embodiment, where the processor 110, the machine-readable storage medium 120, and the transceiver 140 are connected through the bus 130, and the processor 110 may be configured to control transceiving actions of the transceiver 140, so as to perform data transceiving with the video conference participant 200.
For a specific implementation process of the processor 110, reference may be made to the above-mentioned method embodiments executed by the cloud server 100, and implementation principles and technical effects are similar, which are not described herein again.
In the embodiment shown in fig. 4, it should be understood that the Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present invention may be embodied directly in a hardware processor, or in a combination of the hardware and software modules within the processor.
The machine-readable storage medium 120 may comprise high-speed RAM memory and may also include non-volatile storage NVM, such as at least one disk memory.
The bus 130 may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended ISA (EISA) bus, or the like. The bus 130 may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, the buses in the figures of the present invention are not limited to only one bus or one type of bus.
In addition, an embodiment of the present invention further provides a readable storage medium, where a computer executing instruction is stored in the readable storage medium, and when a processor executes the computer executing instruction, the video conference information processing method for processing video conference information as described above is implemented.
The readable storage medium described above may be implemented by any type of volatile or non-volatile memory device or combination thereof, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk. Readable storage media can be any available media that can be accessed by a general purpose or special purpose computer.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (8)
1. A method for processing video conference information, the method being performed by a video conference participant, the method comprising:
acquiring video conference information, wherein the video conference information comprises conference video streams and a user command set, and the user command set comprises commands used when a user participates in a video conference for interaction;
determining size information of a multi-terminal display image and the conference video stream displayed on the multi-terminal display image;
denoising the conference video stream displayed on the multi-terminal display image;
and overlapping the denoised multi-terminal display image and a user interaction window, and then sending the image to a video conference host for display, wherein the user interaction window is used for displaying interaction contents corresponding to each command in the user command set, and comprises a covered first area determined according to the size information.
2. The method of claim 1, wherein determining the multi-terminal display image comprises:
and obtaining the multi-terminal display image through a multi-terminal display image fusion technology.
3. The method of claim 2, further comprising:
and adding an identifier on the multi-terminal display image, wherein the identifier is used for determining that the data subjected to denoising processing is a user source corresponding to the conference video stream displayed on the multi-terminal display image.
4. The method of claim 1, wherein the determining size information for the conference video stream to be displayed on the multi-terminal display image comprises:
determining the size of the video image in the conference video stream displayed on the multi-terminal display image according to the size of the video image in the conference video stream and the size of the multi-terminal display image;
and recording four-corner coordinate information or four-side margin information of the video image in the conference video stream on the multi-terminal display image.
5. A video conference information processing apparatus characterized by comprising:
the system comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring video conference information, the video conference information comprises conference video streams and a user command set, and the user command set comprises commands used when a user participates in a video conference for interaction;
a determination unit configured to determine a multi-terminal display image and size information of the conference video stream displayed on the multi-terminal display image;
the processing unit is used for denoising the conference video stream displayed on the multi-terminal display image; and
and overlapping the denoised multi-terminal display image and a user interaction window, and then sending the image to a video conference host for display, wherein the user interaction window is used for displaying interaction contents corresponding to each command in the user command set, and comprises a covered first area determined according to the size information.
6. An electronic device, comprising:
the video conference system comprises a transceiver and a video conference system, wherein the transceiver acquires video conference information, the video conference information comprises conference video streams and a user command set, and the user command set comprises commands used when a user participates in a video conference for interaction;
a first chip that determines a multi-terminal display image and size information of the conference video stream displayed on the multi-terminal display image;
the second chip is used for denoising the conference video stream displayed on the multi-terminal display image;
and overlapping the denoised multi-terminal display image and a user interaction window, and then sending the image to a video conference host for display, wherein the user interaction window is used for displaying interaction contents corresponding to each command in the user command set, and comprises a covered first area determined according to the size information.
7. A video conference information processing system comprising a cloud server and the video conference information processing apparatus according to claim 5, wherein the cloud server includes a processor, a machine-readable storage medium, and a network interface, the machine-readable storage medium, the network interface, and the processor are connected via a bus system, the network interface is configured to be communicatively connected to at least one video conference participant, the machine-readable storage medium is configured to store a program, an instruction, or code, and the processor is configured to execute the program, the instruction, or the code in the machine-readable storage medium to perform the video conference information processing method according to any one of claims 1 to 4.
8. A computer-readable storage medium storing instructions/executable code which, when executed by a processor of an electronic device, causes the electronic device to implement the method of any of claims 1-4.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011065612.0A CN113271429A (en) | 2020-09-30 | 2020-09-30 | Video conference information processing method and device, electronic equipment and system |
PCT/CN2020/135587 WO2022068067A1 (en) | 2020-09-30 | 2020-12-11 | Video conference information processing method and apparatus, electronic device and system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011065612.0A CN113271429A (en) | 2020-09-30 | 2020-09-30 | Video conference information processing method and device, electronic equipment and system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN113271429A true CN113271429A (en) | 2021-08-17 |
Family
ID=77227745
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202011065612.0A Withdrawn CN113271429A (en) | 2020-09-30 | 2020-09-30 | Video conference information processing method and device, electronic equipment and system |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN113271429A (en) |
WO (1) | WO2022068067A1 (en) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130201104A1 (en) * | 2012-02-02 | 2013-08-08 | Raymond William Ptucha | Multi-user interactive display system |
US20140118403A1 (en) * | 2012-10-31 | 2014-05-01 | Microsoft Corporation | Auto-adjusting content size rendered on a display |
CN104038722A (en) * | 2013-03-06 | 2014-09-10 | 中兴通讯股份有限公司 | Content interaction method and content interaction system for video conference |
CN111432261A (en) * | 2019-12-31 | 2020-07-17 | 杭州海康威视数字技术股份有限公司 | Video window picture display method and device |
CN111565337A (en) * | 2020-04-26 | 2020-08-21 | 华为技术有限公司 | Image processing method and device and electronic equipment |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110246172A1 (en) * | 2010-03-30 | 2011-10-06 | Polycom, Inc. | Method and System for Adding Translation in a Videoconference |
US9237305B2 (en) * | 2010-10-18 | 2016-01-12 | Apple Inc. | Overlay for a video conferencing application |
CN102036051A (en) * | 2010-12-20 | 2011-04-27 | 华为终端有限公司 | Method and device for prompting in video meeting |
CN109788229B (en) * | 2017-11-10 | 2021-12-07 | 中兴通讯股份有限公司 | Conference fusion method, terminal, server and computer storage medium |
CN110446001A (en) * | 2019-07-12 | 2019-11-12 | 视联动力信息技术股份有限公司 | Video conference processing method, device, electronic equipment and medium based on view networking |
-
2020
- 2020-09-30 CN CN202011065612.0A patent/CN113271429A/en not_active Withdrawn
- 2020-12-11 WO PCT/CN2020/135587 patent/WO2022068067A1/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130201104A1 (en) * | 2012-02-02 | 2013-08-08 | Raymond William Ptucha | Multi-user interactive display system |
US20140118403A1 (en) * | 2012-10-31 | 2014-05-01 | Microsoft Corporation | Auto-adjusting content size rendered on a display |
CN104038722A (en) * | 2013-03-06 | 2014-09-10 | 中兴通讯股份有限公司 | Content interaction method and content interaction system for video conference |
CN111432261A (en) * | 2019-12-31 | 2020-07-17 | 杭州海康威视数字技术股份有限公司 | Video window picture display method and device |
CN111565337A (en) * | 2020-04-26 | 2020-08-21 | 华为技术有限公司 | Image processing method and device and electronic equipment |
Also Published As
Publication number | Publication date |
---|---|
WO2022068067A1 (en) | 2022-04-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10705671B2 (en) | Information sharing method, terminal, and storage medium | |
CN113271428A (en) | Video conference user authentication method, device and system | |
CN106973318B (en) | Aggregated video operation method and device | |
CN111565337A (en) | Image processing method and device and electronic equipment | |
CN113329235A (en) | Audio processing method and device and cloud server | |
CN113747104A (en) | Method and device for displaying document in video conference and cloud server | |
CN113625923B (en) | Remote cloud desktop-based mouse processing method and device, storage medium and equipment | |
CN112084386A (en) | Cloud hosting client information management method and device and server | |
CN113271429A (en) | Video conference information processing method and device, electronic equipment and system | |
CN113747051A (en) | Content display method, device, server and storage medium for video conference | |
CN114363663A (en) | Live broadcast watching method and device and cloud video server | |
CN113207026A (en) | Video recommendation method and device and cloud server | |
CN114415902A (en) | Video display mode changing method and device and cloud server | |
CN113747109A (en) | Video conference permission level determination method and system and video conference server | |
CN113747106A (en) | Method, device and system for controlling terminal in video conference | |
CN110673919A (en) | Screen capturing method and device | |
CN113747107A (en) | Video conference stream transcoding method and device and video conference server | |
CN113794897A (en) | Video live broadcast method and device and cloud live broadcast server | |
CN113286112B (en) | Video conference terminal control method, device and system | |
CN113286116B (en) | Information prompting method and device for monitoring security management and cloud server | |
CN114363642A (en) | Video live broadcast method and device and cloud live broadcast server | |
CN113286111A (en) | Video conference content presentation method, device and system | |
CN113784218A (en) | Video processing method and device and cloud video server | |
CN113747103A (en) | Video conference connection method, device and system | |
CN113286113A (en) | Video conference operation management method, device and system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WW01 | Invention patent application withdrawn after publication | ||
WW01 | Invention patent application withdrawn after publication |
Application publication date: 20210817 |