CN105592288B - Method for realizing automatic adjustment of meeting place picture and multipoint control unit - Google Patents
Method for realizing automatic adjustment of meeting place picture and multipoint control unit Download PDFInfo
- Publication number
- CN105592288B CN105592288B CN201410624142.5A CN201410624142A CN105592288B CN 105592288 B CN105592288 B CN 105592288B CN 201410624142 A CN201410624142 A CN 201410624142A CN 105592288 B CN105592288 B CN 105592288B
- Authority
- CN
- China
- Prior art keywords
- picture
- meeting place
- proportion
- value
- average value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Analysis (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention provides a method for realizing automatic adjustment of a meeting place picture, which comprises the following steps: receiving video picture data of each meeting place, and respectively decoding the video picture data of each meeting place to obtain a meeting place picture; carrying out mode identification processing on each meeting place picture to obtain a picture proportion average value of an object in each meeting place picture; and adjusting the focal length of the video acquisition equipment once in real time according to a first difference value between the picture proportion average value of the object in each meeting place picture and a first preset meeting place picture proportion value so as to dynamically adjust the picture proportion average value of the object in each meeting place picture. The embodiment of the invention also provides a multipoint control unit for realizing automatic adjustment of the meeting place picture.
Description
Technical Field
The present invention relates to multimedia communication technology, and in particular, to a method and a Multipoint Control Unit (MCU) for automatically adjusting a meeting place picture.
Background
At present, in a video conference system, due to the fact that the number, the positions and the layout of conference rooms in each conference room are different, particularly the layout of video acquisition equipment such as a camera is different, video pictures acquired in each conference room are different, and the picture proportion value of an object in each conference room picture cannot be automatically adjusted; moreover, in the display of a plurality of meeting place pictures, the difference between the picture proportion values of the objects in the meeting place pictures is large, so that the visual effect of the whole video picture is poor. In addition, for each meeting place picture, the object in each meeting place picture does not want the picture proportion value of the object in each meeting place picture to be the maximum, but wants that the picture proportion value of the object in each meeting place picture can be automatically controlled, so that the actual position and size of the object in each meeting place picture can be determined according to the display condition of the video picture. For the above-described situations that exist in video conferencing systems, the video conference participants may need to manually control the video capture devices to adjust.
However, during actual video conference use, participants do not want to control the video capture device manually; or, the participant itself does not master the control method for the video capture device, so that the control of the picture scale value of the object in each meeting place picture cannot be realized.
Disclosure of Invention
In view of this, embodiments of the present invention are expected to provide a method and an MCU for automatically adjusting a meeting place picture, which can adjust a focal length of a video capture device in real time through the MCU to automatically adjust a picture ratio of an object in each meeting place picture.
In order to achieve the above purpose, the technical solution of the embodiment of the present invention is realized as follows:
the embodiment of the invention provides a method for realizing automatic adjustment of a meeting place picture, which comprises the following steps:
receiving video picture data of each meeting place;
decoding the video picture data of each meeting place to obtain a meeting place picture;
carrying out mode identification processing on each meeting place picture to obtain a picture proportion average value of an object in each meeting place picture;
and adjusting the focal length of the video acquisition equipment once in real time according to a first difference value between the picture proportion average value of the object in each meeting place picture and a first preset meeting place picture proportion value so as to dynamically adjust the picture proportion average value of the object in each meeting place picture.
In the above scheme, the method further comprises:
comparing the picture proportion average value of the object in each meeting place picture for one time to obtain a comparison result;
when the primary comparison result is that the picture proportion average values of the objects in the pictures of each meeting place are inconsistent, screening out the minimum value in the picture proportion average values of the objects in the pictures of each meeting place as a second preset picture proportion value of the meeting place;
and according to a second difference value between the picture proportion average value of the object in each meeting place picture and a second preset meeting place picture proportion value, secondarily adjusting the focal length of the video acquisition equipment in real time so as to dynamically adjust the picture proportion average value of the object in each meeting place picture.
In the above scheme, the method further comprises:
carrying out secondary comparison on the picture proportion average value of the object in each meeting place picture to obtain a secondary comparison result;
when the secondary comparison result shows that the picture proportion average values of the objects in each meeting place picture are inconsistent, calculating and determining the arithmetic average value of the picture proportion average values of the objects in all the meeting place pictures as a third preset meeting place picture proportion value;
and carrying out scaling processing on each meeting place picture in real time according to a third difference value between the picture proportion average value of the object in each meeting place picture and a third preset meeting place picture proportion value so as to dynamically adjust the picture proportion average value of the object in each meeting place picture.
In the above scheme, the method further comprises:
coding each adjusted meeting place picture to form new video picture data;
and displaying the new video picture data through video display equipment.
In the above scheme, the method further comprises: and when the object in the meeting place picture is detected to move, dynamically adjusting the picture proportion average value of the object in each meeting place picture again.
The embodiment of the invention also provides an MCU, which comprises a receiving module, a decoding module, a mode identification processing module and a first adjusting module; wherein the content of the first and second substances,
the receiving module is used for receiving the video picture data of each meeting place;
the decoding module is used for respectively decoding the video picture data of each meeting place to obtain a meeting place picture;
the pattern recognition processing module is used for carrying out pattern recognition processing on each meeting place picture to obtain a picture proportion average value of an object in each meeting place picture;
the first adjusting module is used for adjusting the focal length of the video acquisition equipment once in real time according to a first difference value between the picture proportion average value of the object in each meeting place picture and a first preset meeting place picture proportion value so as to dynamically adjust the picture proportion average value of the object in each meeting place picture.
In the above scheme, the MCU further comprises a first comparison module, a screening module, and a second adjustment module; wherein the content of the first and second substances,
the first comparison module is used for comparing the picture proportion average value of the object in each meeting place picture for one time to obtain a comparison result;
the screening module is used for screening out the minimum value in the picture proportion average values of the objects in each meeting place picture as a second preset meeting place picture proportion value when the primary comparison result is that the picture proportion average values of the objects in each meeting place picture are inconsistent;
and the second adjusting module is used for carrying out secondary adjustment on the focal length of the video acquisition equipment in real time according to a second difference value between the picture proportion average value of the object in each meeting place picture and a second preset meeting place picture proportion value so as to dynamically adjust the picture proportion average value of the object in each meeting place picture.
In the above scheme, the MCU further comprises a second comparison module, a calculation module, and a scaling module; wherein the content of the first and second substances,
the second comparison module is used for carrying out secondary comparison on the picture proportion average value of the object in each meeting place picture to obtain a secondary comparison result;
the calculation module is used for calculating and determining the arithmetic mean of the picture proportion mean values of the objects in all the meeting place pictures as a third preset meeting place picture proportion value when the secondary comparison result is that the picture proportion mean values of the objects in each meeting place picture are inconsistent;
and the scaling processing module is used for scaling each meeting place picture in real time according to a third difference value between the picture proportion average value of the object in each meeting place picture and a third preset meeting place picture proportion value so as to dynamically adjust the picture proportion average value of the object in each meeting place picture.
In the above scheme, the MCU further comprises a coding module and a display control module; wherein the content of the first and second substances,
the decoding module is used for coding each adjusted meeting place picture to form new video picture data;
and the display control module is used for realizing video display of the new video picture data through video display equipment.
In the above scheme, the MCU further comprises a detection module; wherein the content of the first and second substances,
the detection module is used for detecting whether an object in a meeting place picture moves or not; when the object in the meeting place picture is detected to move, the dynamic adjustment of the picture proportion average value of the object in each meeting place picture is controlled again.
According to the method for realizing automatic adjustment of the meeting place picture and the MCU, the MCU receives the video picture data of each meeting place, and decodes the video picture data of each meeting place respectively to obtain the meeting place picture; carrying out mode identification processing on each meeting place picture to obtain a picture proportion average value of an object in each meeting place picture; and adjusting the focal length of the video acquisition equipment once in real time according to a first difference value between the picture proportion average value of the object in each meeting place picture and a first preset meeting place picture proportion value so as to dynamically adjust the picture proportion average value of the object in each meeting place picture. Therefore, the focal length of the video acquisition equipment can be adjusted in real time through the MCU, so that the automatic adjustment of the picture proportion value of the object in each meeting place picture is realized, and the visual effect of the whole video picture is improved. In addition, since the picture scale value of the object in each meeting place picture can be automatically controlled, the viewer can determine the actual position and size of the object in each meeting place picture according to the display condition of the video picture.
Drawings
FIG. 1 is a first flowchart illustrating a method for automatically adjusting a meeting place picture according to an embodiment of the present invention;
FIG. 2 is a schematic diagram illustrating an implementation flow of performing pattern recognition processing on each meeting place picture according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a picture scale of objects in pictures of a plurality of meeting places according to an embodiment of the present invention;
FIG. 4 is a second flowchart illustrating a method for automatically adjusting a meeting place picture according to an embodiment of the present invention;
FIG. 5 is a third schematic flowchart illustrating a method for automatically adjusting a meeting place picture according to an embodiment of the present invention;
FIG. 6 is a comparison graph of the effect of scaling the pictures of each meeting place in real time according to the embodiment of the present invention;
FIG. 7 is a fourth flowchart illustrating a method for automatically adjusting a meeting place picture according to an embodiment of the present invention;
FIG. 8 is a fifth flowchart illustrating a method for automatically adjusting a meeting place picture according to an embodiment of the present invention;
FIG. 9 is a schematic diagram of a first MCU configuration according to an embodiment of the present invention;
FIG. 10 is a schematic diagram of a structure of a mode identification processing module in the MCU according to an embodiment of the present invention;
FIG. 11 is a schematic diagram of a second exemplary MCU configuration according to an embodiment of the present invention;
FIG. 12 is a schematic diagram of a third exemplary MCU configuration according to an embodiment of the present invention;
FIG. 13 is a schematic diagram of a fourth exemplary embodiment of the MCU configuration of the present invention;
fig. 14 is a schematic diagram of a composition structure of an MCU according to an embodiment of the present invention.
Detailed Description
In the embodiment of the invention, the MCU receives the video picture data of each meeting place, and respectively decodes the video picture data of each meeting place to obtain a meeting place picture; carrying out mode identification processing on each meeting place picture to obtain a picture proportion average value of an object in each meeting place picture; and adjusting the focal length of the video acquisition equipment once in real time according to a first difference value between the picture proportion average value of the object in each meeting place picture and a first preset meeting place picture proportion value so as to dynamically adjust the picture proportion average value of the object in each meeting place picture.
The present invention will be described in further detail with reference to the accompanying drawings and specific embodiments.
Example one
Fig. 1 is a first schematic flow chart illustrating a method for automatically adjusting a meeting place picture according to an embodiment of the present invention, and as shown in fig. 1, the method for automatically adjusting a meeting place picture according to an embodiment of the present invention includes:
step S101: receiving video picture data of each meeting place;
specifically, the MCU receives video picture data transmitted by the video capture device of each conference site. The video acquisition equipment can comprise a video camera, a video recorder, a camera, a video acquisition card and the like.
Here, it should be noted that, in the video conference system, first, a video capture device captures a video picture, and the captured video picture is encoded according to a preset encoding method and then transmitted to the MCU.
Step S102: decoding the video picture data of each meeting place to obtain a meeting place picture;
specifically, the MCU performs decoding processing on the video picture data according to a decoding mode corresponding to a preset encoding mode to obtain a plurality of meeting place pictures.
Step S103: carrying out mode identification processing on each meeting place picture to obtain a picture proportion average value of an object in each meeting place picture;
here, the object may include any person or any article in a meeting place, etc.; accordingly, the picture of the object may include a picture of any person or any article in the meeting place, and the like.
Specifically, as shown in fig. 2, the MCU performs a pattern recognition process on each of the meeting place pictures, and obtaining a picture ratio average of the object in each of the meeting place pictures includes:
step S1031: carrying out mode recognition processing on each meeting place picture to determine picture information of each object in each meeting place picture;
in the embodiment of the present invention, since the picture of each object is close to a rectangle, the picture information of each object in each meeting place picture determined by the MCU may include the length and width of the picture of each object.
Step S1032: determining the area of each object according to the picture information of each object in each meeting place picture;
specifically, the area of each object can be determined by calculating the product of the length and width of the picture information of each object by the area formula of a rectangle.
Step S1033: obtaining the average area of the objects in each meeting place picture by calculating the arithmetic average value of the areas of all the objects in each meeting place picture;
step S1034: and obtaining the picture proportion average value of the object in each meeting place picture by calculating the ratio of the average area of the object in each meeting place picture to the area of the whole meeting place picture.
Step S104: and adjusting the focal length of the video acquisition equipment once in real time according to a first difference value between the picture proportion average value of the object in each meeting place picture and a first preset meeting place picture proportion value so as to dynamically adjust the picture proportion average value of the object in each meeting place picture.
Here, a first preset conference room picture ratio value option is preset in the MCU, so that a user can select a suitable first preset conference room picture ratio value according to actual needs.
Specifically, fig. 3 is a schematic diagram of a picture scale of objects in pictures of several meeting places according to an embodiment of the present invention, as shown in fig. 3, wherein FIG. 3(a) shows that the first preset site picture scale value is 1/4, when the average value of the picture scale of the object in a certain meeting place picture as shown in fig. 3(b) is 1/2, i.e. when a first difference between said average value of the picture scale of the object in each room picture and a first preset room picture scale value is positive, indicating that the picture proportion of the object in each meeting place picture is larger than the first preset meeting place picture proportion, the MCU sends a command of pushing the focal length of the video acquisition equipment to the video acquisition equipment so as to control the video acquisition equipment to push the focal length far, and dynamically adjusting the picture scale average value of the object in each meeting place picture to ensure that the picture scale average value of the object in each meeting place picture is continuously reduced to or maximally close to the first preset meeting place picture scale value.
Correspondingly, as shown in fig. 3, wherein, the first preset meeting place picture scale value is 1/4 in fig. 3(a), when the average value of the picture scale of the object in a certain meeting place picture as shown in fig. 3(c) is 1/9, i.e. when the first difference between the average value of the picture scale of the object in each of the scene pictures and the first preset scene picture scale value is negative, the picture proportion of the object in each meeting place picture is smaller than the first preset meeting place picture proportion, the MCU sends a command of zooming in the focal length of the video acquisition equipment to control the video acquisition equipment to zoom in the focal length, and dynamically adjusting the picture proportion average value of the object in each meeting place picture to ensure that the picture proportion average value of the object in each meeting place picture is continuously increased to or maximally close to the first preset meeting place picture proportion value.
In the embodiment of the present invention, it should be noted that, due to the limitation of the focal length adjustment range of the video capture device, the average value of the picture proportions of the objects in each meeting place picture may not necessarily reach the first preset meeting place picture proportion value through the one-time adjustment, and therefore, the one-time adjustment of the focal length of the video capture device by the MCU is stopped until the first difference is enlarged.
Example two
Fig. 4 is a second flowchart illustrating a method for automatically adjusting a meeting place picture according to an embodiment of the present invention, where as shown in fig. 4, the method for automatically adjusting a meeting place picture according to an embodiment of the present invention includes:
step S101: receiving video picture data of each meeting place;
step S102: decoding the video picture data of each meeting place to obtain a meeting place picture;
step S103: carrying out mode identification processing on each meeting place picture to obtain a picture proportion average value of an object in each meeting place picture;
step S104: adjusting the focal length of the video acquisition equipment once in real time according to a first difference value between the picture proportion average value of the object in each meeting place picture and a first preset meeting place picture proportion value so as to dynamically adjust the picture proportion average value of the object in each meeting place picture;
steps S101 to S104 in the second embodiment of the present invention may respectively refer to steps S101 to S104 in the first embodiment, and are not described herein for brevity.
Step S201: comparing the picture proportion average value of the object in each meeting place picture for one time to obtain a comparison result;
step S202: when the primary comparison result is that the picture proportion average values of the objects in the pictures of each meeting place are inconsistent, screening out the minimum value in the picture proportion average values of the objects in the pictures of each meeting place as a second preset picture proportion value of the meeting place;
here, it should be noted that, when the result of the one-time comparison indicates that the average value of the picture scale of the object in each meeting place picture is inconsistent, it indicates that the MCU has performed one-time adjustment of the focal length of the video capture device through step S104, and the average value of the picture scale of the object in each meeting place picture does not reach the first preset meeting place picture scale value.
Step S203: and according to a second difference value between the picture proportion average value of the object in each meeting place picture and a second preset meeting place picture proportion value, secondarily adjusting the focal length of the video acquisition equipment in real time so as to dynamically adjust the picture proportion average value of the object in each meeting place picture.
Specifically, when a second difference value between the average value of the picture proportion of the object in each meeting place picture and the second preset meeting place picture proportion value is a positive number, it indicates that the picture proportion of the object in each meeting place picture is greater than the second preset meeting place picture proportion, and the MCU sends a command to push the focal length of the video capture device to control the video capture device to push the focal length far away, so as to dynamically adjust the average value of the picture proportion of the object in each meeting place picture, so that the average value of the picture proportion of the object in each meeting place picture is continuously reduced to or maximally approaches the second preset meeting place picture proportion value.
Correspondingly, when a second difference value between the average picture proportion value of the object in each meeting place picture and the second preset meeting place picture proportion value is a negative number, the picture proportion of the object in each meeting place picture is smaller than the second preset meeting place picture proportion, and the MCU sends a command of zooming in the focal length of the video acquisition equipment to the video acquisition equipment so as to control the video acquisition equipment to zoom in the focal length, so that the average picture proportion value of the object in each meeting place picture is dynamically adjusted, and the average picture proportion value of the object in each meeting place picture is continuously increased to or maximally approaches the second preset meeting place picture proportion value.
In the embodiment of the present invention, it should be noted that, similarly, due to the limitation of the focal length adjustment range of the video capture device, the average value of the picture proportions of the objects in each meeting place picture may not necessarily reach the second preset meeting place picture proportion value through the secondary adjustment, and therefore, the secondary adjustment of the focal length of the video capture device by the MCU is stopped until the second difference value is enlarged.
EXAMPLE III
Fig. 5 is a third schematic flowchart of a method for automatically adjusting a meeting place picture according to an embodiment of the present invention, and as shown in fig. 5, the method for automatically adjusting a meeting place picture according to an embodiment of the present invention includes:
step S101: receiving video picture data of each meeting place;
step S102: decoding the video picture data of each meeting place to obtain a meeting place picture;
step S103: carrying out mode identification processing on each meeting place picture to obtain a picture proportion average value of an object in each meeting place picture;
step S104: adjusting the focal length of the video acquisition equipment once in real time according to a first difference value between the picture proportion average value of the object in each meeting place picture and a first preset meeting place picture proportion value so as to dynamically adjust the picture proportion average value of the object in each meeting place picture;
steps S101 to S104 in the third embodiment of the present invention may respectively refer to steps S101 to S104 in the first embodiment, and are not described herein for brevity.
Step S201: comparing the picture proportion average value of the object in each meeting place picture for one time to obtain a comparison result;
step S202: when the primary comparison result is that the picture proportion average values of the objects in the pictures of each meeting place are inconsistent, screening out the minimum value in the picture proportion average values of the objects in the pictures of each meeting place as a second preset picture proportion value of the meeting place;
step S203: according to a second difference value between the picture proportion average value of the object in each meeting place picture and a second preset meeting place picture proportion value, carrying out secondary adjustment on the focal length of the video acquisition equipment in real time so as to dynamically adjust the picture proportion average value of the object in each meeting place picture;
steps S201 to S203 in the third embodiment of the present invention may respectively refer to steps S201 to S203 in the first embodiment, and are not described herein for brevity.
Step S301: carrying out secondary comparison on the picture proportion average value of the object in each meeting place picture to obtain a secondary comparison result;
step S302: when the secondary comparison result shows that the picture proportion average values of the objects in each meeting place picture are inconsistent, calculating and determining the arithmetic average value of the picture proportion average values of the objects in all the meeting place pictures as a third preset meeting place picture proportion value;
here, it should be noted that, when the result of the secondary comparison indicates that the average value of the picture proportions of the object in each meeting place picture is inconsistent, it indicates that the MCU secondarily adjusts the focal length of the video capture device through step S203, and the average value of the picture proportions of the object in each meeting place picture does not reach the second preset meeting place picture proportion value.
Step S303: and carrying out scaling processing on each meeting place picture in real time according to a third difference value between the picture proportion average value of the object in each meeting place picture and a third preset meeting place picture proportion value so as to dynamically adjust the picture proportion average value of the object in each meeting place picture.
Specifically, when a third difference value between the average value of the picture proportions of the objects in a certain meeting place picture and a third preset meeting place picture proportion value is a positive number, it indicates that the picture proportion of the objects in the meeting place picture is greater than the third preset meeting place picture proportion, and the MCU reduces the meeting place picture and simultaneously enlarges other meeting place pictures;
correspondingly, when a third difference value between the average value of the picture proportion of the object in a certain meeting place picture and the third preset meeting place picture proportion value is a negative number, the picture proportion of the object in the meeting place picture is smaller than the third preset meeting place picture proportion, the MCU reduces the meeting place picture, and simultaneously enlarges other meeting place pictures.
For example, fig. 6 is a comparison graph of the effect of scaling each meeting place picture in real time according to the embodiment of the present invention; as shown in fig. 6(a), the display effect map is shown for each meeting place picture that has not undergone the scaling process, and as shown in fig. 6(b), the display effect map is shown for each meeting place picture that has undergone the scaling process. In this way, the step S303 performs scaling processing on each meeting place picture in real time, so that the picture scale average value of the object in each meeting place picture reaches the third preset meeting place picture scale value.
Example four
Fig. 7 is a fourth schematic flowchart of a method for automatically adjusting a meeting place picture according to an embodiment of the present invention, and as shown in fig. 7, the method for automatically adjusting a meeting place picture according to an embodiment of the present invention includes:
step S101: receiving video picture data of each meeting place;
step S102: decoding the video picture data of each meeting place to obtain a meeting place picture;
step S103: carrying out mode identification processing on each meeting place picture to obtain a picture proportion average value of an object in each meeting place picture;
step S104: and adjusting the focal length of the video acquisition equipment once in real time according to a first difference value between the picture proportion average value of the object in each meeting place picture and a first preset meeting place picture proportion value so as to dynamically adjust the picture proportion average value of the object in each meeting place picture.
Steps S101 to S104 in the fourth embodiment of the present invention may respectively refer to steps S101 to S104 in the first embodiment, and are not described herein again for brevity.
Step S401: coding each adjusted meeting place picture to form new video picture data;
specifically, the MCU may perform encoding processing on each adjusted meeting place picture according to a preset encoding mode, so as to form new video picture data.
Step S402: and displaying the new video picture data through video display equipment.
EXAMPLE five
Fig. 8 is a fifth flowchart illustrating a method for automatically adjusting a meeting place picture according to an embodiment of the present invention, where as shown in fig. 8, the method for automatically adjusting a meeting place picture according to an embodiment of the present invention includes:
step S101: receiving video picture data of each meeting place;
step S102: decoding the video picture data of each meeting place to obtain a meeting place picture;
step S103: carrying out mode identification processing on each meeting place picture to obtain a picture proportion average value of an object in each meeting place picture;
step S104: and adjusting the focal length of the video acquisition equipment once in real time according to a first difference value between the picture proportion average value of the object in each meeting place picture and a first preset meeting place picture proportion value so as to dynamically adjust the picture proportion average value of the object in each meeting place picture.
Steps S101 to S104 in the fifth embodiment of the present invention may respectively refer to steps S101 to S104 in the first embodiment, and are not described herein again for brevity.
Step S501: and when the object in the meeting place picture is detected to move, dynamically adjusting the picture proportion average value of the object in each meeting place picture again.
Specifically, the MCU may detect whether an object in a meeting place picture moves in real time or at regular time, and when it detects that an object in a certain meeting place picture or multiple meeting place pictures moves, the average value of the picture scale of the object in each meeting place picture may be dynamically adjusted again by the methods of the foregoing steps S101 to S104.
EXAMPLE six
Fig. 9 is a schematic diagram of a first structure of an MCU according to an embodiment of the present invention, and as shown in fig. 9, the MCU according to an embodiment of the present invention includes: a receiving module 901, a decoding module 902, a mode identification processing module 903, and a first adjusting module 904; wherein the content of the first and second substances,
the receiving module 901 is configured to receive video picture data of each meeting place;
the decoding module 902 is configured to perform decoding processing on the video picture data of each meeting place respectively to obtain a meeting place picture;
the pattern recognition processing module 903 is configured to perform pattern recognition processing on each meeting place picture to obtain a picture proportion average value of an object in each meeting place picture;
the first adjusting module 904 is configured to perform a first adjustment on the focal length of the video capture device in real time according to a first difference between the average picture scale value of the object in each meeting place picture and a first preset meeting place picture scale value, so as to dynamically adjust the average picture scale value of the object in each meeting place picture.
In this embodiment of the present invention, as shown in fig. 10, the pattern recognition processing module 903 includes a first determining unit 9031, a second determining unit 9032, a first obtaining unit 9033, and a second obtaining unit 9034; wherein the content of the first and second substances,
the first determining unit 9031 is configured to perform mode identification processing on each meeting place picture, and determine picture information of each object in each meeting place picture;
the second determining unit 9032 is configured to determine an area of each object according to picture information of each object in each meeting place picture;
the first obtaining unit 9033 is configured to obtain an average area of the objects in each meeting place picture by calculating an arithmetic average of areas of all the objects in each meeting place picture;
the second obtaining unit 9034 is configured to obtain an average frame ratio of the object in each meeting place frame by calculating a ratio of an average area of the object in each meeting place frame to an area of the whole meeting place frame.
In one embodiment, as shown in fig. 11, the MCU further includes a first comparison module 905, a screening module 906, and a second adjustment module 907; wherein the content of the first and second substances,
the first comparison module 905 is configured to perform a comparison on the average picture scale value of the object in each meeting place picture to obtain a comparison result;
the screening module 906 is configured to screen out a minimum value of the average values of the picture proportions of the objects in each meeting place picture as a second preset meeting place picture proportion value when the primary comparison result indicates that the average values of the picture proportions of the objects in each meeting place picture are inconsistent;
the second adjusting module 907 is configured to perform secondary adjustment on the focal length of the video capture device in real time according to a second difference between the average picture scale value of the object in each meeting place picture and a second preset meeting place picture scale value, so as to dynamically adjust the average picture scale value of the object in each meeting place picture.
In one embodiment, as shown in fig. 12, the MCU further includes a second comparison module 908, a calculation module 909, and a scaling processing module 910; wherein the content of the first and second substances,
the second comparing module 908 is configured to perform secondary comparison on the average picture ratio of the object in each meeting place picture to obtain a secondary comparison result;
the calculating module 909 is configured to calculate and determine an arithmetic average of the picture proportions of the objects in all the meeting place pictures as a third preset meeting place picture proportion value when the secondary comparison result indicates that the average of the picture proportions of the objects in each meeting place picture is inconsistent;
the scaling module 910 is configured to perform scaling processing on each meeting place picture in real time according to a third difference between the average value of the picture scale of the object in each meeting place picture and a third preset meeting place picture scale value, so as to dynamically adjust the average value of the picture scale of the object in each meeting place picture.
In one embodiment, as shown in fig. 13, the MCU further includes a coding module 911 and a display control module 912; wherein the content of the first and second substances,
the decoding module 911 is configured to perform encoding processing on each adjusted meeting place picture to form new video picture data;
the display control module 912 is configured to implement video display on the new video picture data through a video display device.
In an embodiment, as shown in fig. 14, the MCU further includes a detection module 913; wherein the content of the first and second substances,
the detecting module 913 is configured to detect whether an object in the meeting place picture moves; and when the object in the meeting place picture is detected to move, the module is controlled again to dynamically adjust the picture proportion average value of the object in each meeting place picture.
In practical applications, each module provided in the embodiments of the present invention and the unit included in each module may be implemented by a processor in the MCU, or may be implemented by a specific logic circuit.
The technical schemes described in the embodiments of the present invention can be combined arbitrarily without conflict.
In the embodiments provided in the present invention, it should be understood that the disclosed method and apparatus can be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all the functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention.
Claims (10)
1. A method for realizing automatic adjustment of meeting place pictures is characterized by comprising the following steps:
receiving video picture data of each meeting place;
decoding the video picture data of each meeting place to obtain a meeting place picture;
performing mode recognition processing on each meeting place picture to obtain a picture proportion average value of an object in each meeting place picture, wherein the picture proportion average value of the object in each meeting place picture is the ratio of the arithmetic average value of the areas of all the objects in each meeting place picture to the area of the whole meeting place picture;
and according to a first difference value between the picture proportion average value of the object in each meeting place picture and a first preset meeting place picture proportion value, adjusting the focal length of the video acquisition equipment once in real time to minimize the absolute value of the first difference value so as to dynamically adjust the picture proportion average value of the object in each meeting place picture.
2. The method of claim 1, further comprising:
comparing the picture proportion average value of the object in each meeting place picture for one time to obtain a comparison result;
when the primary comparison result is that the picture proportion average values of the objects in the pictures of each meeting place are inconsistent, screening out the minimum value in the picture proportion average values of the objects in the pictures of each meeting place as a second preset picture proportion value of the meeting place;
and according to a second difference value between the picture proportion average value of the object in each meeting place picture and a second preset meeting place picture proportion value, secondarily adjusting the focal length of the video acquisition equipment in real time so as to dynamically adjust the picture proportion average value of the object in each meeting place picture.
3. The method of claim 2, further comprising:
carrying out secondary comparison on the picture proportion average value of the object in each meeting place picture to obtain a secondary comparison result;
when the secondary comparison result shows that the picture proportion average values of the objects in each meeting place picture are inconsistent, calculating and determining the arithmetic average value of the picture proportion average values of the objects in all the meeting place pictures as a third preset meeting place picture proportion value;
and carrying out scaling processing on each meeting place picture in real time according to a third difference value between the picture proportion average value of the object in each meeting place picture and a third preset meeting place picture proportion value so as to dynamically adjust the picture proportion average value of the object in each meeting place picture.
4. The method according to any one of claims 1 to 3, further comprising:
coding each adjusted meeting place picture to form new video picture data;
and displaying the new video picture data through video display equipment.
5. The method according to any one of claims 1 to 3, further comprising: and when the object in the meeting place picture is detected to move, dynamically adjusting the picture proportion average value of the object in each meeting place picture again.
6. The multipoint control unit MCU is characterized by comprising a receiving module, a decoding module, a mode identification processing module and a first adjusting module; wherein the content of the first and second substances,
the receiving module is used for receiving the video picture data of each meeting place;
the decoding module is used for respectively decoding the video picture data of each meeting place to obtain a meeting place picture;
the mode identification processing module is used for carrying out mode identification processing on each meeting place picture to obtain a picture proportion average value of an object in each meeting place picture, wherein the picture proportion average value of the object in each meeting place picture is the ratio of the arithmetic average value of the areas of all the objects in each meeting place picture to the area of the whole meeting place picture;
the first adjusting module is used for adjusting the focal length of the video acquisition equipment once in real time according to a first difference value between the picture proportion average value of the object in each meeting place picture and a first preset meeting place picture proportion value, so that the absolute value of the first difference value is reduced to the minimum, and the picture proportion average value of the object in each meeting place picture is dynamically adjusted.
7. The MCU of claim 6, further comprising a first comparison module, a screening module, and a second adjustment module; wherein the content of the first and second substances,
the first comparison module is used for comparing the picture proportion average value of the object in each meeting place picture for one time to obtain a comparison result;
the screening module is used for screening out the minimum value in the picture proportion average values of the objects in each meeting place picture as a second preset meeting place picture proportion value when the primary comparison result is that the picture proportion average values of the objects in each meeting place picture are inconsistent;
and the second adjusting module is used for carrying out secondary adjustment on the focal length of the video acquisition equipment in real time according to a second difference value between the picture proportion average value of the object in each meeting place picture and a second preset meeting place picture proportion value so as to dynamically adjust the picture proportion average value of the object in each meeting place picture.
8. The MCU of claim 7, further comprising a second comparison module, a calculation module, and a scaling module; wherein the content of the first and second substances,
the second comparison module is used for carrying out secondary comparison on the picture proportion average value of the object in each meeting place picture to obtain a secondary comparison result;
the calculation module is used for calculating and determining the arithmetic mean of the picture proportion mean values of the objects in all the meeting place pictures as a third preset meeting place picture proportion value when the secondary comparison result is that the picture proportion mean values of the objects in each meeting place picture are inconsistent;
and the scaling processing module is used for scaling each meeting place picture in real time according to a third difference value between the picture proportion average value of the object in each meeting place picture and a third preset meeting place picture proportion value so as to dynamically adjust the picture proportion average value of the object in each meeting place picture.
9. The MCU of any one of claims 6 to 8, further comprising a coding module, a display control module; wherein the content of the first and second substances,
the decoding module is used for coding each adjusted meeting place picture to form new video picture data;
and the display control module is used for realizing video display of the new video picture data through video display equipment.
10. The MCU of any one of claims 6 to 8, wherein the MCU further comprises a detection module; wherein the content of the first and second substances,
the detection module is used for detecting whether an object in a meeting place picture moves or not; when the object in the meeting place picture is detected to move, the dynamic adjustment of the picture proportion average value of the object in each meeting place picture is controlled again.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410624142.5A CN105592288B (en) | 2014-11-07 | 2014-11-07 | Method for realizing automatic adjustment of meeting place picture and multipoint control unit |
| PCT/CN2015/078654 WO2016070599A1 (en) | 2014-11-07 | 2015-05-11 | Image adjusting method, multipoint control unit, and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410624142.5A CN105592288B (en) | 2014-11-07 | 2014-11-07 | Method for realizing automatic adjustment of meeting place picture and multipoint control unit |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105592288A CN105592288A (en) | 2016-05-18 |
| CN105592288B true CN105592288B (en) | 2021-01-26 |
Family
ID=55908494
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410624142.5A Active CN105592288B (en) | 2014-11-07 | 2014-11-07 | Method for realizing automatic adjustment of meeting place picture and multipoint control unit |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN105592288B (en) |
| WO (1) | WO2016070599A1 (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6680745B2 (en) * | 2000-11-10 | 2004-01-20 | Perceptive Network Technologies, Inc. | Videoconferencing method with tracking of face and dynamic bandwidth allocation |
| CN101785306A (en) * | 2007-07-13 | 2010-07-21 | 坦德伯格电信公司 | Method and system for automatic camera control |
| CN102300043A (en) * | 2010-06-23 | 2011-12-28 | 中兴通讯股份有限公司 | Method for adjusting meeting place camera of remote presentation meeting system |
| CN102984454A (en) * | 2012-11-15 | 2013-03-20 | 广东欧珀移动通信有限公司 | System and method and mobile phone capable of automatically adjusting focal length of camera |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101404726B (en) * | 2008-10-20 | 2012-05-02 | 华为终端有限公司 | Control method, system and apparatus for far-end camera |
| US8330793B2 (en) * | 2009-10-09 | 2012-12-11 | Hewlett-Packard Development Company, L.P. | Video conference |
| CN101742222A (en) * | 2009-12-30 | 2010-06-16 | 华为终端有限公司 | Operation method for camera position and video conference terminal |
-
2014
- 2014-11-07 CN CN201410624142.5A patent/CN105592288B/en active Active
-
2015
- 2015-05-11 WO PCT/CN2015/078654 patent/WO2016070599A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6680745B2 (en) * | 2000-11-10 | 2004-01-20 | Perceptive Network Technologies, Inc. | Videoconferencing method with tracking of face and dynamic bandwidth allocation |
| CN101785306A (en) * | 2007-07-13 | 2010-07-21 | 坦德伯格电信公司 | Method and system for automatic camera control |
| CN102300043A (en) * | 2010-06-23 | 2011-12-28 | 中兴通讯股份有限公司 | Method for adjusting meeting place camera of remote presentation meeting system |
| CN102984454A (en) * | 2012-11-15 | 2013-03-20 | 广东欧珀移动通信有限公司 | System and method and mobile phone capable of automatically adjusting focal length of camera |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2016070599A1 (en) | 2016-05-12 |
| CN105592288A (en) | 2016-05-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10321093B2 (en) | Automated layouts optimized for multi-screen and multi-camera videoconferencing calls | |
| US5990931A (en) | Automatic display update of still frame images for videoconferencing | |
| US9942513B1 (en) | Automated configuration of behavior of a telepresence system based on spatial detection of telepresence components | |
| US9165535B2 (en) | System and method for determining a zoom factor of content displayed on a display device | |
| US9282285B2 (en) | Providing user video having a virtual curtain to an online conference | |
| US9756285B2 (en) | Method, device, and display device for switching video source | |
| US8957940B2 (en) | Utilizing a smart camera system for immersive telepresence | |
| US9264598B1 (en) | Collaborative image capturing | |
| US6380968B1 (en) | Method and apparatus for controlling a remote video camera in a video conferencing system | |
| CN106878658B (en) | Automatic video layout for multi-stream multi-site telepresence conferencing system | |
| US9898241B2 (en) | Information sharing system, image processing apparatus, and image processing method | |
| CA2866459A1 (en) | Teleconference system and teleconference terminal | |
| CN110262866B (en) | Screen multi-picture layout switching method and device and readable storage medium | |
| WO2017098525A1 (en) | A system and method for controlling miracast content with hand gestures and audio commands | |
| US20140043445A1 (en) | Method and system for capturing a stereoscopic image | |
| CN109040654B (en) | Method and device for identifying external shooting equipment and storage medium | |
| US20140085402A1 (en) | Conference terminal and method for processing videos from other conference terminals | |
| CN109076251B (en) | Teleconferencing transmission | |
| CN105592288B (en) | Method for realizing automatic adjustment of meeting place picture and multipoint control unit | |
| JP2019180080A (en) | Video processing device, communication terminal, video conference system, video processing method, and program | |
| CN112738705A (en) | Sound effect adjusting method and device, electronic equipment and storage medium | |
| US9445052B2 (en) | Defining a layout for displaying images | |
| US20180091733A1 (en) | Capturing images provided by users | |
| CN113259615B (en) | Focal length adjusting method and device, terminal equipment and storage medium | |
| CN112153291A (en) | Photographing method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |