CN110636243B - Conference control method and MCU - Google Patents
Conference control method and MCU Download PDFInfo
- Publication number
- CN110636243B CN110636243B CN201810650098.3A CN201810650098A CN110636243B CN 110636243 B CN110636243 B CN 110636243B CN 201810650098 A CN201810650098 A CN 201810650098A CN 110636243 B CN110636243 B CN 110636243B
- Authority
- CN
- China
- Prior art keywords
- meeting place
- matched
- image characteristics
- image
- conference
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/152—Multipoint control units therefor
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
The embodiment of the invention discloses a conference control method and an MCU (microprogrammed control unit), wherein the conference control method comprises the steps of extracting corresponding conference room image characteristics from video code streams of a plurality of conference room terminals of a video conference, wherein one conference room image characteristic corresponds to one conference room terminal; comparing whether the meeting place image characteristics corresponding to the plurality of meeting place terminals are matched with the preset image characteristics or not; and when the images are matched, controlling the meeting place terminal corresponding to the matched meeting place image characteristics to automatically obtain the chairman authority, and simultaneously switching the meeting place picture of the meeting place terminal corresponding to the matched meeting place image characteristics into a main picture. Therefore, chairman control and intelligent video switching are automatically carried out, and the user experience of the video conference is greatly enhanced.
Description
Technical Field
The embodiment of the invention relates to the technical field of video conferences, and is not limited to providing a conference control method and an MCU.
Background
Video conferencing is a multimedia communication method for holding real-time, bidirectional and interactive video conference in local and far-end by TV through modern communication network, and is a communication means for holding conference in two or more places by TV technology and equipment through transmission channel. With the development of the mobile internet technology, video conferences have been widely used in multiple scenes in life and work, and can conveniently participate in the conference through a conference television terminal no matter where the video conferences are located, so that the working efficiency is greatly improved, the travel cost is saved, and the video conferences are accepted by more and more common users.
In a multi-party conference of a video conference, no matter in a single-picture mode or a multi-picture mode, manual application is needed to acquire chairman authority, and meanwhile, two modes of switching a chairman end as a main picture (namely, a broadcast source or a video picture corresponding to a chairman terminal occupies the largest screen) are provided: one is that the side with the largest voice is switched to the main picture by voice excitation in a voice control mode; the other is to manually operate a chairman application from the interface, and manually switch a certain meeting place as a main picture by using chairman authority. Therefore, the conference control in the video conference needs to be manually participated, and the user experience is reduced.
Disclosure of Invention
In view of this, an embodiment of the present invention provides a conference control method, which is applied to an MCU and includes:
extracting corresponding meeting place image characteristics from video code streams of a plurality of meeting place terminals of the video conference, wherein one meeting place image characteristic corresponds to one meeting place terminal;
comparing whether the meeting place image characteristics corresponding to the plurality of meeting place terminals are matched with the preset image characteristics or not;
and when the images are matched, controlling the meeting place terminal corresponding to the matched meeting place image characteristics to automatically obtain the chairman authority, and simultaneously switching the meeting place picture of the meeting place terminal corresponding to the matched meeting place image characteristics into a main picture.
The embodiment of the present invention further provides a multipoint control unit MCU, including:
the system comprises an extraction unit, a storage unit and a processing unit, wherein the extraction unit is used for extracting the corresponding conference room image characteristics from the video code streams of a plurality of conference room terminals of a video conference, and one conference room image characteristic corresponds to one conference room terminal;
the comparison unit is used for comparing whether the meeting place image characteristics corresponding to the plurality of meeting place terminals are matched with the preset image characteristics or not;
and the control unit is used for controlling the meeting place terminal corresponding to the matched meeting place image characteristic to automatically obtain the chairman authority when the meeting place terminal is matched with the matched meeting place image characteristic, and simultaneously switching the meeting place picture of the meeting place terminal corresponding to the matched meeting place image characteristic into a main picture.
The embodiment of the present invention further provides a multipoint control unit MCU, including: comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the computer program realizing the conference control method described above when executed by the processor.
The embodiment of the invention also provides a computer readable storage medium, wherein an information processing program is stored on the computer readable storage medium, and the information processing program realizes the steps of the conference control method when being executed by a processor.
Compared with the prior art, the embodiment of the invention provides a conference control method and an MCU (microprogrammed control unit), wherein the conference control method comprises the steps of extracting corresponding conference room image characteristics from video code streams of a plurality of conference room terminals of a video conference, wherein one conference room image characteristic corresponds to one conference room terminal; comparing whether the meeting place image characteristics corresponding to the plurality of meeting place terminals are matched with the preset image characteristics or not; and when the images are matched, controlling the meeting place terminal corresponding to the matched meeting place image characteristics to automatically obtain the chairman authority, and simultaneously switching the meeting place picture of the meeting place terminal corresponding to the matched meeting place image characteristics into a main picture. Therefore, chairman control and intelligent video switching are automatically carried out, and the user experience of the video conference is greatly enhanced.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the example serve to explain the principles of the invention and not to limit the invention.
Fig. 1 is a schematic flowchart of a conference control method according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of a conference control method according to a second embodiment of the present invention;
fig. 3 is a schematic flowchart of a conference control method according to a second embodiment of the present invention;
fig. 4 is a schematic structural diagram of a multipoint control unit MCU according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a conference control system according to a fifth embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict.
The steps illustrated in the flow charts of the figures may be performed in a computer system such as a set of computer-executable instructions. Also, while a logical order is shown in the flow diagrams, in some cases, the steps shown or described may be performed in an order different than here.
At present, in a video conference, both acquisition of chairman authority and switching of a home screen need manual participation, so that physical examination of a user is reduced.
Therefore, the embodiment of the invention provides a novel conference control method and an MCU, wherein the conference control method comprises the following steps: extracting corresponding meeting place image characteristics from video code streams of a plurality of meeting place terminals of the video conference, wherein one meeting place image characteristic corresponds to one meeting place terminal; comparing whether the meeting place image characteristics corresponding to the plurality of meeting place terminals are matched with the preset image characteristics or not; and when the images are matched, controlling the meeting place terminal corresponding to the matched meeting place image characteristics to automatically obtain the chairman authority, and simultaneously switching the meeting place picture of the meeting place terminal corresponding to the matched meeting place image characteristics into a main picture. Therefore, chairman control and intelligent video switching are automatically carried out, and the user experience of the video conference is greatly enhanced.
Example one
Fig. 1 is a schematic flowchart of a conference control method according to an embodiment of the present invention. As shown in fig. 1, the conference control method is applied to a multipoint control unit MCU, and includes:
102, comparing whether meeting place image characteristics corresponding to a plurality of meeting place terminals are matched with preset image characteristics or not;
and 103, when the meeting place image characteristics are matched, controlling the meeting place terminal corresponding to the matched meeting place image characteristics to automatically acquire chairman authority, and simultaneously switching the meeting place picture of the meeting place terminal corresponding to the matched meeting place image characteristics into a main picture.
Before extracting the image characteristics of the conference hall from the video code stream of the video conference, the method also comprises the following steps:
presetting one or more preset image characteristics, and starting an image characteristic matching and main picture switching function;
when a plurality of preset image features are set in advance, priority relationships among the plurality of preset image features are set simultaneously.
Wherein the matched meeting place image characteristics comprise:
when only one meeting place image feature is matched with a preset image feature, taking the meeting place image feature as the matched meeting place image feature;
and when a plurality of meeting place image characteristics are matched with the preset image characteristics, selecting the meeting place image characteristic with the highest priority as the matched meeting place image characteristic.
The preset image characteristics comprise portrait characteristics or meeting place picture characteristics;
when the preset image features are portrait features, respectively extracting the portrait features from video code streams of a plurality of meeting place terminals of the video conference by using a face recognition algorithm as the corresponding meeting place image features;
and when the preset image characteristics are meeting place image characteristics, respectively extracting the meeting place image characteristics from the video code streams of a plurality of meeting place terminals of the video conference by using an image recognition algorithm as the corresponding meeting place image characteristics.
After the meeting place picture corresponding to the meeting place image characteristic is switched to the main picture, the method further comprises the following steps:
periodically extracting the meeting place image characteristics and comparing whether the meeting place image characteristics are matched with preset image characteristics or not
And when the images are not matched, automatically releasing the chairman authority of the meeting place terminal corresponding to the matched meeting place image characteristics.
Before extracting the image characteristics of the conference hall from the video code stream of the video conference, the method also comprises the following steps:
presetting a matching flag bit;
when matching, the matching flag position is OK or 1, and when only one matched meeting place image characteristic exists, the identification of the meeting place terminal corresponding to the matched meeting place image characteristic is recorded; when a plurality of matched meeting place image characteristics exist, recording the identification of the meeting place terminal corresponding to the meeting place image characteristic with the highest priority;
when not matched, the matching flag position is NO or 0.
When the matching is performed, the meeting place terminal corresponding to the matched meeting place image characteristics is controlled to automatically obtain the chairman authority, and meanwhile, the meeting place picture corresponding to the matched meeting place image characteristics is switched into the home picture, including:
and when the matching flag position is detected to be OK or 1, controlling the meeting place terminal corresponding to the identifier to automatically acquire chairman authority according to the recorded identifier of the meeting place terminal, and simultaneously switching the meeting place picture of the meeting place terminal corresponding to the identifier into a main picture.
According to the technical scheme provided by the embodiment of the invention, the extracted meeting place image characteristics are matched with the preset image characteristics, the video terminal corresponding to the matched meeting place image characteristics is controlled to automatically acquire the chairman authority, and meanwhile, the main picture is switched to the meeting place picture of the video terminal corresponding to the matched meeting place image characteristics, so that the meeting control is not required to be manually carried out, more intelligent meeting control is provided, and the user experience of the video meeting service is greatly enhanced.
The conference control method provided by the implementation of the above will be explained in detail by several specific embodiments.
Example two
Fig. 2 is a schematic flow chart of a conference control method according to a second embodiment of the present invention. As shown in fig. 2, the conference control method includes:
after a plurality of conference terminals enter a conference, the MCU sends a preset video picture to each conference terminal, which is the prior art and is not described herein again. At this time, the existing conference control mode, such as voice-activated voice-controlled switching mode or manual switching of a certain meeting place for a chairman authority, can be adopted.
wherein, a setting item can be added on the MCU UI interface such as web/gui, namely, the image feature matching is enabled/disabled to switch the main picture function, and the image feature can be set to be in a portrait mode or a meeting place picture mode.
Before a video conference is held, one or more preset image characteristics which are preset can be introduced into a video conference system; or when the user selects to start the image feature matching and switching the main picture function, prompting to import a preset image feature, wherein the preset image feature can be a picture or a meeting place picture, and the format can be support. When the preset image features are multiple, a corresponding level can be set for each preset image feature, and the level is used for selecting a meeting place terminal corresponding to the high-priority meeting place image feature to acquire the chairman authority and switching the meeting place terminal into a home picture when the multiple meeting place image features are matched with the multiple preset image features, and prompting image feature preset OK when the import system is successfully stored. The types of the preset image features are consistent and are all human images or all singing pictures. When the type of the preset image features is a portrait, setting the image features as a portrait mode, namely setting the image features of the meeting places to be extracted subsequently as the portrait features; and when the type of the preset image characteristics is the meeting place picture, setting the image characteristics as a meeting place picture mode, namely setting the image characteristics of the meeting place to be extracted subsequently as the meeting place picture.
the MCU can acquire video stream pictures sent by all the participants, and through a video decoding algorithm, the conference site pictures are extracted as the image characteristics of the conference site, wherein one image characteristic of the conference site corresponds to one conference site terminal (namely one participant).
When the image features are in a portrait mode, portrait features can be respectively extracted from video code streams of a plurality of conference room terminals of the video conference by using a face recognition algorithm and are used as the respective corresponding conference room image features; when the image features are in the conference room image mode, the image recognition algorithm can be used for respectively extracting the conference room image features from the video code streams of a plurality of conference room terminals of the video conference as the respective corresponding conference room image features.
wherein, the matching can be preset as global matching or partial matching; or presetting the matching degree standard of the matching. The global matching means that the meeting place image features are completely consistent with the preset image features, and the partial matching means that the meeting place image features are not required to be completely consistent with the preset image features, as long as the meeting place image features are partially consistent, for example, 80% consistent. The matching degree standard refers to the degree of matching, for example, the matching degree standard is set to 50%, which means that the meeting place image features are matched with the preset image features as long as 50% of the meeting place image features are consistent with the preset image features; the matching degree standard is set to be 10%, which means that the meeting place image characteristics and the preset image characteristics must be 100% consistent to be considered as matching.
when only one meeting place image feature is matched with a preset image feature, taking the meeting place image feature as the matched meeting place image feature; and when a plurality of meeting place image characteristics are matched with the preset image characteristics, selecting the meeting place image characteristic with the highest priority as the matched meeting place image characteristic.
When the conference images are not matched, the existing conference control mode can be continuously adopted, for example, the current conference image switching mode is kept unchanged.
And step 206, periodically extracting and comparing whether the meeting place image characteristics are matched with the preset image characteristics, and automatically releasing the chairman authority of the meeting place terminal corresponding to the matched meeting place image characteristics when the meeting place image characteristics are not matched.
In this case, as the video conference progresses, the conference site image features of each conference site change again, so that the conference site image features of each conference site need to be periodically extracted, for example, for 10 s. And when the extracted meeting place image characteristics are not matched with the preset image, namely the originally matched meeting place image characteristics disappear, and the original meeting control mode is recovered. For example, the pre-image feature is a portrait of a general manager, and when the general manager leaves the meeting place, the originally matched portrait feature disappears, and the meeting control mode is restored to the original mode. Or, the pre-image feature is a specific background wall of a certain conference place, when a participant of the conference place goes offline, the originally matched image of the conference place disappears, and the conference control mode is restored to the original mode. The original mode refers to an existing meeting place control mode, such as a voice-activated voice-controlled switching mode or a mode of applying for chairman authority to manually switch a certain meeting place as a main picture, and the like.
When the image feature matching switching main picture function is closed, the conference control mode is recovered to the original mode from the image feature matching switching main picture function.
EXAMPLE III
Fig. 3 is a schematic flowchart of a conference control method according to a second embodiment of the present invention. As shown in fig. 3, the conference control method includes:
one or more preset image features can be preset, and when the preset image features are preset, the priority relation among the preset image features is set simultaneously.
for specific extraction and matching operations, reference is made to embodiment two, which is not described herein again.
When the meeting place image characteristics are matched, the matching mark position is OK or 1, and when only one matched meeting place image characteristic exists, the identification of the meeting place terminal corresponding to the matched meeting place image characteristic is recorded; when a plurality of matched meeting place image characteristics exist, recording the identification of the meeting place terminal corresponding to the meeting place image characteristic with the highest priority; when not matched, the matching flag position is NO or 0.
The identifier of the meeting place terminal may be a terminal number (GK/SIP number), an IP, or the like.
the conference terminal corresponding to the recorded identification obtains chairman authority if the current conference has no chairman, and the conference terminal corresponding to the recorded identification obtains the chairman authority if the current conference has the chairman.
And step 304, when the MCU detects that the matching flag bit is NO or 0, controlling the conference control mode to be the original mode.
The conference system comprises a conference place image switching module, a main image switching module and a switching module, wherein the conference place image switching module is used for switching the main image of each party of the current conference to the main image, the main image switching module is used for switching the main image of each party of the current conference to the main image, and the main image switching module is used for switching the main image of each party of the current conference to the main image.
The above steps 303, 304 do not have a fixed order relationship.
According to the technical scheme provided by the second embodiment and the third embodiment of the invention, the main picture can be automatically switched to the corresponding video picture meeting place by matching the extracted meeting place image characteristics with the preset image characteristics, manual switching is not needed, the service experience is enhanced, and the user experience is improved.
Example four
Fig. 4 is a schematic structural diagram of a multipoint control unit MCU according to an embodiment of the present invention. As shown in fig. 4, the MCU includes:
the system comprises an extraction unit, a storage unit and a processing unit, wherein the extraction unit is used for extracting the corresponding conference room image characteristics from the video code streams of a plurality of conference room terminals of a video conference, and one conference room image characteristic corresponds to one conference room terminal;
the comparison unit is used for comparing whether the meeting place image characteristics corresponding to the plurality of meeting place terminals are matched with the preset image characteristics or not;
and the control unit is used for controlling the meeting place terminal corresponding to the matched meeting place image characteristic to automatically obtain the chairman authority when the meeting place terminal is matched with the matched meeting place image characteristic, and simultaneously switching the meeting place picture of the meeting place terminal corresponding to the matched meeting place image characteristic into a main picture.
Wherein, still include:
the system comprises a preset module, a switching module and a display module, wherein the preset module is used for presetting one or more preset image characteristics and starting an image characteristic matching and main picture switching function; when a plurality of preset image features are set in advance, priority relationships among the plurality of preset image features are set simultaneously.
Wherein the matched meeting place image characteristics comprise:
when only one meeting place image feature is matched with a preset image feature, taking the meeting place image feature as the matched meeting place image feature;
and when a plurality of meeting place image characteristics are matched with the preset image characteristics, selecting the meeting place image characteristic with the highest priority as the matched meeting place image characteristic.
The preset image characteristics comprise portrait characteristics or meeting place picture characteristics;
the extraction module is specifically used for respectively extracting the portrait features from the video code streams of a plurality of conference room terminals of the video conference as the respective corresponding conference room image features by using a face recognition algorithm when the preset image features are the portrait features;
and when the preset image characteristics are meeting place image characteristics, respectively extracting the meeting place image characteristics from the video code streams of a plurality of meeting place terminals of the video conference by using an image recognition algorithm as the corresponding meeting place image characteristics.
Wherein, after the meeting place picture corresponding to the meeting place image characteristic is switched into the main picture,
the extraction module is also used for periodically extracting the image characteristics of the meeting place;
the comparison module is also used for periodically comparing whether the extracted meeting place image characteristics are matched with preset image characteristics;
and the control module is also used for automatically releasing the chairman authority of the meeting place terminal corresponding to the matched meeting place image characteristics when the images are not matched.
The preset module is also used for presetting a matching flag bit;
the comparison module is further used for setting the matching flag position as OK or 1 when matching, and recording the identifier of the meeting place terminal corresponding to the matched meeting place image characteristic when only one matched meeting place image characteristic exists; when a plurality of matched meeting place image characteristics exist, recording the identification of the meeting place terminal corresponding to the meeting place image characteristic with the highest priority; when not matched, the matching flag position is NO or 0.
And the control unit is further configured to control the meeting place terminal corresponding to the identifier to automatically obtain the chairman authority according to the recorded identifier of the meeting place terminal when detecting that the matching flag position is OK or 1, and simultaneously switch the meeting place picture of the meeting place terminal corresponding to the identifier into a main picture. And the conference control module is also used for controlling the conference control mode to be the original mode when the MCU detects that the matching flag bit is NO or 0.
EXAMPLE five
Fig. 5 is a schematic structural diagram of a conference control system according to a fifth embodiment of the present invention. As shown in fig. 5, the conference control system includes: MCU, participant terminal 1, 2 … N in multi-party conference.
The participant terminals 1 and 2 … N may be video conference terminals of any form.
In the process of a multi-party conference, when the image feature matching switching main picture function is started, the MCU acquires video stream pictures sent by all participants, namely the participant terminals 1 and 2 … N, and extracts a plurality of key frames as picture features of conference places of each conference place. When the meeting place image characteristics are matched with the preset image characteristics, the matched meeting place automatically acquires the chairman authority, and simultaneously, the matched meeting place picture is switched into a main picture; and if the matched meeting place image characteristics are identified to disappear, the chairman authority can be released strategically, and the original picture switching mode is selected to be recovered.
The embodiment of the invention adds four new functional modules on the basis of the MCU in the existing video conference system: the device comprises an extraction module, a comparison module, a control module and a preset module.
The preset module can be used for presetting one or more preset image characteristics and starting the image characteristic matching and main picture switching function; when a plurality of preset image features are set in advance, priority relationships among the plurality of preset image features are set simultaneously. It can also be used to preset the match flag. Specifically, image feature preset functions are provided, including enabling/disabling the image feature matching switching home screen function, image feature settable portrait or meeting place screen mode, image feature level setting, image feature storage, and the like.
The extracting unit may be configured to extract respective corresponding conference site image features from video code streams of multiple conference site terminals of the video conference, where one conference site image feature corresponds to one conference site terminal. The conference hall image features can also be extracted periodically. Specifically, through algorithms such as video decoding, face recognition, image recognition and the like, image information representing main meeting place characteristics such as faces, portraits or meeting place backgrounds and the like is extracted, current meeting place image characteristics are generated and stored in corresponding meeting place picture characteristic queues.
The matching unit can be used for controlling the meeting place terminal corresponding to the matched meeting place image characteristic to automatically obtain the chairman authority when the meeting place terminal is matched with the matched meeting place image characteristic, and simultaneously switching the meeting place picture of the meeting place terminal corresponding to the matched meeting place image characteristic into a main picture. And the method can also be used for periodically comparing whether the extracted meeting place image characteristics are matched with preset image characteristics. Specifically, whether the meeting place image characteristics are matched with the preset image characteristics is compared, a matching result is output, and a matching flag bit is assigned. When matching, the matching flag position is OK or 1, and when only one matched meeting place image characteristic exists, the identification of the meeting place terminal corresponding to the matched meeting place image characteristic is recorded; when a plurality of matched meeting place image characteristics exist, recording the identification of the meeting place terminal corresponding to the meeting place image characteristic with the highest priority; when not matched, the matching flag position is NO or 0.
The control unit may be configured to, when matching, control the meeting place terminal corresponding to the matched meeting place image feature to automatically obtain the chairman authority, and switch the meeting place picture of the meeting place terminal corresponding to the matched meeting place image feature into a home picture. And the method can be used for automatically releasing the chairman authority of the meeting place terminal corresponding to the matched meeting place image characteristics when the meeting place terminal is not matched with the meeting place terminal. Specifically, the method is further configured to, when it is detected that the matching flag position is OK or 1, control the meeting place terminal corresponding to the identifier to automatically obtain the chairman authority according to the recorded identifier of the meeting place terminal, and switch the meeting place picture of the meeting place terminal corresponding to the identifier into a home picture. And the conference control module is also used for controlling the conference control mode to be the original mode when the MCU detects that the matching flag bit is NO or 0.
The network transceiver module and the audio/video codec module are components of the existing MCU, and their specific functions are not described herein again.
According to the technical scheme provided by the fourth and fifth embodiments of the invention, the main picture can be automatically switched to the corresponding video picture meeting place by matching the extracted meeting place image characteristics with the preset image characteristics, so that manual switching is not needed, the service experience is enhanced, and the user experience is improved.
The embodiment of the invention also provides a Multipoint Control Unit (MCU), which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein when the computer program is executed by the processor, the conference control method is realized.
An embodiment of the present invention further provides a computer-readable storage medium, where an information processing program is stored on the computer-readable storage medium, and when the information processing program is executed by a processor, the information processing program implements the steps of any one of the conference control methods described above.
It will be understood by those of ordinary skill in the art that all or some of the steps of the methods, systems, functional modules/units in the devices disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be performed by several physical components in cooperation. Some or all of the components may be implemented as software executed by a processor, such as a digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as is well known to those of ordinary skill in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can accessed by a computer. In addition, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media as known to those skilled in the art.
Although the embodiments of the present invention have been described above, the above description is only for the convenience of understanding the present invention, and is not intended to limit the present invention. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (9)
1. A conference control method is applied to an MCU and comprises the following steps:
extracting corresponding meeting place image characteristics from video code streams of a plurality of meeting place terminals of the video conference, wherein one meeting place image characteristic corresponds to one meeting place terminal;
comparing whether the meeting place image characteristics corresponding to the plurality of meeting place terminals are matched with the preset image characteristics or not;
when the meeting place image characteristics are matched, the meeting place terminal corresponding to the matched meeting place image characteristics is controlled to automatically obtain chairman authority, and meanwhile, the meeting place picture of the meeting place terminal corresponding to the matched meeting place image characteristics is switched into a main picture;
before extracting the image characteristics of the conference hall from the video code stream of the video conference, the method further comprises the following steps:
presetting a matching flag bit;
when matching, the matching flag position is OK or 1, and when only one matched meeting place image characteristic exists, the identification of the meeting place terminal corresponding to the matched meeting place image characteristic is recorded; when a plurality of matched meeting place image characteristics exist, recording the identification of the meeting place terminal corresponding to the meeting place image characteristic with the highest priority;
when not matched, the matching flag position is NO or 0.
2. The method of claim 1, wherein prior to extracting the venue image features from the video stream of the video conference, the method further comprises:
presetting one or more preset image characteristics, and starting an image characteristic matching and main picture switching function;
when a plurality of preset image features are set in advance, priority relationships among the plurality of preset image features are set simultaneously.
3. The method of claim 2, wherein the matching venue image feature comprises:
when only one meeting place image feature is matched with a preset image feature, taking the meeting place image feature as the matched meeting place image feature;
and when a plurality of meeting place image characteristics are matched with the preset image characteristics, selecting the meeting place image characteristic with the highest priority as the matched meeting place image characteristic.
4. The method of claim 1,
the preset image characteristics comprise portrait characteristics or meeting place picture characteristics;
when the preset image features are portrait features, respectively extracting the portrait features from video code streams of a plurality of meeting place terminals of the video conference by using a face recognition algorithm as the corresponding meeting place image features;
and when the preset image characteristics are meeting place image characteristics, respectively extracting the meeting place image characteristics from the video code streams of a plurality of meeting place terminals of the video conference by using an image recognition algorithm as the corresponding meeting place image characteristics.
5. The method of claim 1, wherein after switching the venue picture corresponding to the venue image feature to a home picture, the method further comprises:
periodically extracting and comparing whether the meeting place image characteristics are matched with the preset image characteristics, and automatically releasing the chairman authority of the meeting place terminal corresponding to the matched meeting place image characteristics when the meeting place image characteristics are not matched.
6. The method according to claim 1, wherein when matching, controlling the meeting place terminal corresponding to the matched meeting place image feature to automatically obtain chairman authority, and simultaneously switching the meeting place picture corresponding to the matched meeting place image feature to a main picture, comprises:
and when the matching flag position is detected to be OK or 1, controlling the meeting place terminal corresponding to the identifier to automatically acquire chairman authority according to the recorded identifier of the meeting place terminal, and simultaneously switching the meeting place picture of the meeting place terminal corresponding to the identifier into a main picture.
7. A multipoint control unit, MCU, comprising:
the system comprises an extraction unit, a storage unit and a processing unit, wherein the extraction unit is used for extracting the corresponding conference room image characteristics from the video code streams of a plurality of conference room terminals of a video conference, and one conference room image characteristic corresponds to one conference room terminal;
the comparison unit is used for comparing whether the meeting place image characteristics corresponding to the plurality of meeting place terminals are matched with the preset image characteristics or not;
the control unit is used for controlling the meeting place terminal corresponding to the matched meeting place image characteristics to automatically acquire chairman authority when the meeting place terminal is matched with the matched meeting place image characteristics, and simultaneously switching the meeting place picture of the meeting place terminal corresponding to the matched meeting place image characteristics into a main picture;
the preset module is used for presetting a matching flag bit;
the comparison unit is further used for setting the matching flag position as OK or 1 when matching, and recording the identifier of the meeting place terminal corresponding to the matched meeting place image characteristic when only one matched meeting place image characteristic exists; when a plurality of matched meeting place image characteristics exist, recording the identification of the meeting place terminal corresponding to the meeting place image characteristic with the highest priority; when not matched, the matching flag position is NO or 0.
8. A multipoint control unit, MCU, comprising a memory, a processor and a computer program stored on said memory and executable on said processor, said computer program, when executed by said processor, implementing a conference control method as claimed in any one of claims 1 to 6.
9. A computer-readable storage medium, characterized in that an information processing program is stored thereon, which when executed by a processor implements the steps of the conference control method according to any one of claims 1 to 6.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810650098.3A CN110636243B (en) | 2018-06-22 | 2018-06-22 | Conference control method and MCU |
| PCT/CN2019/092270 WO2019242726A1 (en) | 2018-06-22 | 2019-06-21 | Conference control method and multipoint control unit |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810650098.3A CN110636243B (en) | 2018-06-22 | 2018-06-22 | Conference control method and MCU |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110636243A CN110636243A (en) | 2019-12-31 |
| CN110636243B true CN110636243B (en) | 2022-03-01 |
Family
ID=68966976
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810650098.3A Active CN110636243B (en) | 2018-06-22 | 2018-06-22 | Conference control method and MCU |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110636243B (en) |
| WO (1) | WO2019242726A1 (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113497900A (en) * | 2021-09-08 | 2021-10-12 | 浙江华创视讯科技有限公司 | Picture control method, computer device and readable storage medium |
| CN117119140B (en) * | 2023-10-24 | 2024-02-02 | 浙江华创视讯科技有限公司 | Method and device for realizing control operation, storage medium and electronic device |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR960036650A (en) * | 1995-03-20 | 1996-10-28 | 김광호 | Video Conference Control System Using Integrated Information Communication Network |
| CN101442654A (en) * | 2008-12-26 | 2009-05-27 | 深圳华为通信技术有限公司 | Method, apparatus and system for switching video object of video communication |
| CN101534411A (en) * | 2009-04-08 | 2009-09-16 | 深圳华为通信技术有限公司 | Control method for video conference, terminal and system based on image |
| CN101707714A (en) * | 2009-11-18 | 2010-05-12 | 深圳华为通信技术有限公司 | Image processing method and device of multi-picture video session |
| CN102572370A (en) * | 2011-01-04 | 2012-07-11 | 华为终端有限公司 | Video conference control method and conference terminal |
| CN102638359A (en) * | 2012-04-10 | 2012-08-15 | 苏州阔地网络科技有限公司 | Video conference guest inviting method and system |
| CN103327290A (en) * | 2013-06-24 | 2013-09-25 | 广东威创视讯科技股份有限公司 | Video conference control method and device |
| CN104038725A (en) * | 2010-09-09 | 2014-09-10 | 华为终端有限公司 | Method and device for adjusting conventioneer image display in multi-screen video conference |
| CN104239766A (en) * | 2014-08-20 | 2014-12-24 | 中广核核电运营有限公司 | Video and audio based identity authentication method and system for nuclear power plants |
| CN104580995A (en) * | 2015-01-28 | 2015-04-29 | 苏州科达科技股份有限公司 | Communication method and device of video conference |
| CN105893948A (en) * | 2016-03-29 | 2016-08-24 | 乐视控股（北京）有限公司 | Method and apparatus for face identification in video conference |
| CN107547823A (en) * | 2016-06-24 | 2018-01-05 | 联想(北京)有限公司 | A kind of information processing method and videoconferencing platform |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100551030C (en) * | 2006-07-17 | 2009-10-14 | 中兴通讯股份有限公司 | A kind of method of many picture controls in cascade connection conference television system |
| US8289363B2 (en) * | 2006-12-28 | 2012-10-16 | Mark Buckler | Video conferencing |
| CN105100521A (en) * | 2014-05-14 | 2015-11-25 | 中兴通讯股份有限公司 | Method and server for realizing ordered speech in teleconference |
-
2018
- 2018-06-22 CN CN201810650098.3A patent/CN110636243B/en active Active
-
2019
- 2019-06-21 WO PCT/CN2019/092270 patent/WO2019242726A1/en active Application Filing
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR960036650A (en) * | 1995-03-20 | 1996-10-28 | 김광호 | Video Conference Control System Using Integrated Information Communication Network |
| CN101442654A (en) * | 2008-12-26 | 2009-05-27 | 深圳华为通信技术有限公司 | Method, apparatus and system for switching video object of video communication |
| CN101534411A (en) * | 2009-04-08 | 2009-09-16 | 深圳华为通信技术有限公司 | Control method for video conference, terminal and system based on image |
| CN101707714A (en) * | 2009-11-18 | 2010-05-12 | 深圳华为通信技术有限公司 | Image processing method and device of multi-picture video session |
| CN104038725A (en) * | 2010-09-09 | 2014-09-10 | 华为终端有限公司 | Method and device for adjusting conventioneer image display in multi-screen video conference |
| CN102572370A (en) * | 2011-01-04 | 2012-07-11 | 华为终端有限公司 | Video conference control method and conference terminal |
| CN102638359A (en) * | 2012-04-10 | 2012-08-15 | 苏州阔地网络科技有限公司 | Video conference guest inviting method and system |
| CN103327290A (en) * | 2013-06-24 | 2013-09-25 | 广东威创视讯科技股份有限公司 | Video conference control method and device |
| CN104239766A (en) * | 2014-08-20 | 2014-12-24 | 中广核核电运营有限公司 | Video and audio based identity authentication method and system for nuclear power plants |
| CN104580995A (en) * | 2015-01-28 | 2015-04-29 | 苏州科达科技股份有限公司 | Communication method and device of video conference |
| CN105893948A (en) * | 2016-03-29 | 2016-08-24 | 乐视控股（北京）有限公司 | Method and apparatus for face identification in video conference |
| CN107547823A (en) * | 2016-06-24 | 2018-01-05 | 联想(北京)有限公司 | A kind of information processing method and videoconferencing platform |
Non-Patent Citations (1)
| Title |
|---|
| 基于多网络的视频会议身份认证技术研究;周志坚;《电脑知识与技术》;20170307;第13卷(第1期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110636243A (en) | 2019-12-31 |
| WO2019242726A1 (en) | 2019-12-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8860776B2 (en) | Conference terminal, conference server, conference system and data processing method | |
| CN102469295B (en) | Conference control method, related equipment and system | |
| US8531502B2 (en) | Method, device and system for presenting virtual conference site of video conference | |
| US9912907B2 (en) | Dynamic video and sound adjustment in a video conference | |
| CN107578777B (en) | Text information display method, device and system, and voice recognition method and device | |
| WO2015070558A1 (en) | Video shooting control method and device | |
| WO2011063763A1 (en) | Method, device and system for conference control including remote display conference places | |
| US20170048284A1 (en) | Non-transitory computer readable medium, information processing apparatus, and information processing system | |
| WO2013163904A1 (en) | Method, device and system for realizing remote group photo by utilizing video conference | |
| US20120287230A1 (en) | Method and device for switching video pictures | |
| CN110636243B (en) | Conference control method and MCU | |
| WO2015003532A1 (en) | Multimedia conferencing establishment method, device and system | |
| EP4106326A1 (en) | Multi-camera automatic framing | |
| CN113676693B (en) | Picture presentation method, video conference system, and readable storage medium | |
| US9013537B2 (en) | Method, device, and network systems for controlling multiple auxiliary streams | |
| WO2016206471A1 (en) | Multimedia service processing method, system and device | |
| EP3734967A1 (en) | Video conference transmission method and apparatus, and mcu | |
| WO2016147538A1 (en) | Videoconference communication device | |
| EP3979630A1 (en) | Conference recording method and apparatus, and conference recording system | |
| CN112601110B (en) | Method and apparatus for content recording and sharing | |
| JP2017092675A (en) | Information processing apparatus, conference system, information processing method, and program | |
| CN112672089A (en) | Conference control and conferencing method, device, server, terminal and storage medium | |
| WO2019223736A1 (en) | Video control method, video conference terminal and multi-point control unit (mcu) | |
| JP7325865B1 (en) | Screen Synthesis Method Using Web Conferencing System | |
| CN116320268A (en) | Remote conference control method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |