WO2022022200A1

WO2022022200A1 - Volume adjusting method and apparatus for zoomed video, and video photographing device

Info

Publication number: WO2022022200A1
Application number: PCT/CN2021/103102
Authority: WO
Inventors: 孙权; 于宏全; 廖亮
Original assignee: 中兴通讯股份有限公司
Priority date: 2020-07-27
Filing date: 2021-06-29
Publication date: 2022-02-03
Also published as: CN113992836A

Abstract

Provided is a volume adjusting method for a zoomed video. Said method comprises: during the process of a video acquisition apparatus acquiring a video, measuring a first distance for imaging between the video acquisition apparatus and a photographed object (S11); in response to the video acquisition apparatus adjusting a zoom ratio, determining, according to the zoom ratio, a second distance for imaging (S12); and determining and adjusting a recording power of a microphone according to the first distance and the second distance (S13). Further provided are a volume adjusting apparatus and a video photographing device.

Description

Method and device for volume adjustment of zoom video, and video shooting device

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the priority of Chinese patent application No. 202010732248.2 filed on July 27, 2020, the contents of which are incorporated herein by reference in their entirety.

technical field

The present disclosure relates to the technical field of signal processing, and in particular, to a method and device for adjusting the volume of a zoom video, and a video shooting device.

Background technique

With the increasingly powerful shooting functions of mobile smart terminals, using mobile phones, motion cameras and other devices to shoot videos has become the main way for people to record videos. Mobile smart terminals can realize video zooming, but the sound is not zoomed when the image is zoomed. When taking pictures, zooming is used to change the distance between the subject and the camera, which is a visual zoom. When shooting video, the visual zoom is currently achieved through optical zoom or digital zoom technology, but the audio does not change synchronously. In this way, visually the picture is zoomed in and out, but the sound does not change, causing the sound to give people an unreal feeling.

public content

In a first aspect, an embodiment of the present disclosure provides a method for adjusting the volume of a zoom video, including:

In the process of capturing the video by the video capturing device, detecting the first imaging distance between the video capturing device and the shooting object;

Adjusting the zoom factor in response to the video capture device, and determining a second distance for imaging according to the zoom factor; and

The recording power of the microphone is determined and adjusted according to the first distance and the second distance.

In a second aspect, an embodiment of the present disclosure further provides a volume adjustment device, including a detection module, a processing module, and an adjustment module,

The detection module is configured to, in the process of capturing the video by the video capturing device, detect the first imaging distance between the video capturing device and the shooting object;

The processing module is configured to, when the video capture device adjusts the zoom factor, determine the second distance for imaging according to the zoom factor; determine the recording power of the microphone according to the first distance and the second distance; and

The adjustment module is configured to adjust the recording power of the microphone.

In a third aspect, an embodiment of the present disclosure further provides a video shooting device, including a video capture device, a microphone, and the aforementioned volume adjustment device.

Description of drawings

1 is a schematic flowchart of a zoom video volume adjustment provided by an embodiment of the present disclosure;

FIG. 2 is another schematic flowchart of zoom video volume adjustment according to an embodiment of the present disclosure;

FIG. 3 is a schematic flow chart of still another zoom video volume adjustment provided by an embodiment of the present disclosure;

4 is a schematic structural diagram of a volume adjustment device provided by an embodiment of the present disclosure;

FIG. 5 is another schematic structural diagram of a volume adjustment device provided by an embodiment of the present disclosure;

FIG. 6 is a schematic structural diagram of a video shooting device provided by an embodiment of the present disclosure; and

FIG. 7 is a schematic diagram of a working scene of a video shooting device provided by an embodiment of the present disclosure.

detailed description

Example embodiments are described more fully hereinafter with reference to the accompanying drawings, but which may be embodied in different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.

The terminology used herein is used to describe particular embodiments only and is not intended to limit the present disclosure. As used herein, the singular forms "a" and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It will also be understood that when the terms "comprising" and/or "made of" are used in this specification, it is specified that particular features, integers, steps, operations, elements and/or components are present, but not excluding the presence or possibility of Add one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

Embodiments described herein may be described with reference to plan and/or cross-sectional views with the aid of idealized schematic representations of the present disclosure. Accordingly, example illustrations may be modified according to manufacturing techniques and/or tolerances. Therefore, the embodiments are not limited to the embodiments shown in the drawings, but include modifications of configurations formed based on manufacturing processes. Accordingly, the regions illustrated in the figures are of schematic nature and the shapes of the regions illustrated in the figures are illustrative of the specific shapes of the regions of the elements, and are not limiting.

Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art. It will also be understood that terms such as those defined in commonly used dictionaries should be construed as having meanings consistent with their meanings in the context of the related art and this disclosure, and will not be construed as having idealized or over-formal meanings unless This document expressly so limited.

An embodiment of the present disclosure provides a method for adjusting the volume of a zoom video. As shown in FIG. 1 , the method for adjusting the volume of a zoom video includes the following steps S11 to S13.

Step S11 , in the process of capturing the video by the video capturing device, detect the first imaging distance between the video capturing device and the shooting object.

In this step, the distance sensor and the camera imaging system can be used to accurately measure the first imaging distance between the video capture device (ie the camera of the video shooting device) and the shooting object, and the first distance is the actual distance.

Step S12, if the video capture device adjusts the zoom factor, the second distance for imaging is determined according to the zoom factor.

In the embodiment of the present disclosure, a plurality of zoom ratios are preset in the video shooting device. During the process of using the video capture device to capture video, if the user wants to use the camera to zoom in or away from the shooting object, the preset zoom ratio can be used according to the preset zoom ratio. Adjust the camera.

Whether it is digital or optical zoom, the image distance of the subject will change after zooming. When the subject is zoomed in, the imaging distance of the subject becomes smaller, and the distance between the subject displayed on the screen and the camera becomes smaller. When the subject is zoomed out, the imaging distance of the subject becomes larger, and the distance between the subject displayed on the screen and the camera becomes larger. Whether it is an optical zoom or a digital zoom, the zoom factor has a fixed relationship with the imaging distance. According to the fixed relationship between the zoom factor and the imaging distance, the imaging distance (ie, the second distance) of the subject under the current zoom factor can be calculated.

Step S13: Determine and adjust the recording power of the microphone according to the first distance and the second distance.

The recording power of the microphone determines the volume of the sound of the subject recorded in the video. The lower the volume of the subject's voice recorded in . Therefore, by adjusting the recording power of the microphone, the volume of the sound in the video can be adjusted.

In this step, if the second distance is smaller than the first distance, the recording power of the microphone is increased; if the second distance is greater than the first distance, the recording power of the microphone is decreased. That is to say, when the camera zooms in on the subject, the zoom factor increases and the imaging distance decreases (that is, the second distance is smaller than the first distance), and the recording power of the microphone is correspondingly increased to increase the sound volume of the subject in the video. ; When the camera zooms out to the subject, the zoom factor decreases, the imaging distance increases (that is, the second distance is greater than the first distance), and the recording power of the microphone is correspondingly reduced to reduce the sound in the direction of the subject position in the video. volume.

Using the zoom video volume adjustment method provided by the embodiment of the present disclosure, in the process of capturing video by the video capturing device, the first imaging distance between the video capturing device and the shooting object is detected; if the video capturing device adjusts the zoom factor, Then determine the second distance for imaging according to the zoom factor; determine and adjust the recording power of the microphone according to the first distance and the second distance; during the video shooting process, when the distance from the shooting object changes, At this time, the recording and recording power of the microphone also changes, that is, the volume of the recorded sound in the direction of the subject position also changes, so that the video image and sound can be zoomed synchronously. The real scene of eye and human ear work, the video effect is more realistic.

By adjusting the recording power of the microphone, the volume of the sound at the input end of the video can be adjusted to achieve the effect of synchronous zooming of the video image and sound. However, by adjusting the recording power of the microphone, the volume of the sound in the video can only be adjusted within a rough range, and the precise control of the sound volume cannot be achieved.

In order to solve the above problem, in some embodiments, the output volume of the speaker can be further adjusted on the basis of adjusting the recording power of the microphone. Correspondingly, as shown in FIG. 2 , after adjusting the recording power of the microphone (ie, step S13 ), the method for adjusting the volume of the zoom video may further include the following steps S21 and S22 .

Step S21, acquiring the first loudness of the sound in the direction where the position of the shooting object is located.

Loudness, also known as volume, refers to the intensity of sound perceived by the human ear. In this step, the microphone is used to align the shooting object, and the sound in the direction of the shooting object is collected to obtain the first loudness of the sound. The first loudness is the loudness of the sound obtained by the microphone under the adjusted recording power.

Step S22, determining a second loudness according to the first loudness, the first distance and the second distance, so as to adjust the output volume of the speaker according to the second loudness.

The second loudness is proportional to the square of the ratio between the first distance and the second distance, and is related to the first loudness, that is, the second loudness is based on the first loudness and determined according to the first distance and the second distance obtained by adjusting the adjustment amount. There are various implementation manners for determining the second loudness according to the first loudness, the first distance, and the second distance, which are not limited in the embodiments of the present disclosure.

The video shooting device may further include a speaker (ie, a speaker), and the speaker is used to play the sound in the video. Correspondingly, when playing the video, the output volume of the speaker is adjusted to the calculated second loudness, so as to realize the precise adjustment of the sound volume in the direction of the position of the shooting object in the video, because the second loudness considers the actual volume (ie The first loudness), therefore, the obtained output volume is more in line with the actual situation, and the sound volume of the video output end can be adjusted.

In order to improve the quality of the sound in the captured video and reduce the ambient noise, in some embodiments, a microphone with a noise reduction function can be selected as the microphone, and correspondingly, the noise reduction power of the microphone with a noise reduction function can also be adjusted.

In some embodiments, as shown in FIG. 3, after the second imaging distance is determined according to the zoom factor (i.e., step S12), the zoom video volume adjustment method may further include the following steps S31 and S32.

Step S31: Calculate the noise reduction power according to the first distance and the second distance.

It should be noted that the noise reduction power refers to the noise reduction power in other directions except toward the photographed object, that is, the noise reduction power of ambient noise.

Step S32, adjusting the noise reduction power of the microphone according to the noise reduction power.

In some embodiments, if the second distance is smaller than the first distance, the noise reduction power is increased; if the second distance is greater than the first distance, the noise reduction power is decreased. That is to say, when the camera zooms in on the subject, the zoom factor increases and the imaging distance decreases (that is, the second distance is smaller than the first distance), correspondingly, the noise reduction power of the microphone can be increased to increase the removal of ambient noise. ; When the camera zooms out to the subject, the zoom factor decreases and the imaging distance increases (that is, the second distance is greater than the first distance), correspondingly, the noise reduction power of the microphone can be reduced to reduce the strength of removing ambient noise.

Based on the same technical concept, an embodiment of the present disclosure further provides a volume adjustment device. As shown in FIG. 4 , the volume adjustment device includes a detection module 101 , a processing module 102 and an adjustment module 103 . The detection module 101 is configured to, during the process of capturing the video by the video capturing device, detect the first imaging distance between the video capturing device and the shooting object.

The processing module 102 is configured to, when the video capture device zooms, determine the zoom factor, and determine the second imaging distance according to the zoom factor; determine the recording power of the microphone according to the first distance and the second distance .

The adjustment module 103 is configured to adjust the recording power of the microphone.

In some embodiments, as shown in FIG. 5 , the volume adjustment device further includes an acquisition module 104, and the acquisition module 104 is configured to acquire the sound of the shooting object after the adjustment module 103 adjusts the recording power of the microphone the first loudness.

The processing module 102 is further configured to determine a second loudness according to the first loudness, the first distance and the second distance.

The adjustment module 103 is further configured to adjust the output volume of the speaker according to the second loudness.

In some embodiments, the processing module 102 is configured to, when the second distance is less than the first distance, increase the recording power of the microphone; when the second distance is greater than the first distance, reduce Smaller the recording power of the microphone.

In some embodiments, the processing module 102 is further configured to, after determining the second distance for imaging according to the zoom factor, calculate the noise reduction power according to the first distance and the second distance.

The adjustment module 103 is further configured to adjust the noise reduction power of the microphone according to the noise reduction power.

In some embodiments, when the second distance is smaller than the first distance, the noise reduction power is increased; when the second distance is greater than the first distance, the noise reduction power is decreased.

Based on the same technical concept, an embodiment of the present disclosure further provides a video shooting device, as shown in FIG. 6 , including a video capture device 1 , a microphone 2 and a volume adjustment device (not shown in the figure), the volume adjustment device can be It is the volume adjustment device as described above. The video capture device 1 may be a camera, and is configured to capture video; the microphone 2 is configured to acquire audio signals, that is, to capture sound. The video capture device may be a smart mobile device, such as a video camera, a camera, a smart phone, an electronic monitoring device, and the like.

In some embodiments, the number of the microphones 2 is two, so as to achieve dual-mic noise reduction.

In some embodiments, at least one of the two microphones 2 is a unidirectional microphone, and the unidirectional microphone can be used to pick up the sound of the photographed object in a targeted manner, and the sound pickup effect is better.

In some embodiments, the video shooting device may further include a speaker (not shown in the figure), and correspondingly, the volume adjustment device can also acquire the first loudness of the sound of the shooting object, according to the first loudness, The first distance and the second distance determine a second loudness, and the output volume of the speaker is adjusted according to the second loudness, so as to realize the adjustment of the sound volume of the video output end.

In the video shooting device provided by the embodiment of the present disclosure, a distance sensor may be arranged below the camera to facilitate detection of the first imaging distance between the camera and the shooting object; a microphone 2 with a noise reduction function may be placed above and below the camera, and the noise reduction function may be used to utilize the noise reduction function. It can block the surrounding noisy sound, and the microphone 2 can choose a unidirectional microphone to record the sound in the specified direction. This group of microphones can adjust the power of the recorded sound. When other conditions remain unchanged, if the recording power and the noise reduction power in other directions are increased, the loudness of the recorded sound can be increased; Recording power and noise reduction power in other directions can reduce the loudness of the recorded sound. The power of the sound recorded by the microphone is adjusted according to the zoom factor of the camera. When the camera zooms in on the subject, the power of the sound recorded by the microphone increases, increasing the noise reduction power in other directions; when the camera zooms out to the subject, the microphone records the power of the sound. becomes smaller, reducing the noise reduction power in other directions.

In order to clearly illustrate the technical solutions of the embodiments of the present disclosure, the working process of the video shooting device will be described in detail below with reference to FIG. 7 .

As shown in FIG. 7 , when the video capture device 1 (ie the camera) starts to shoot video, the distance sensor (ie the detection module of the volume adjustment device) detects the first distance from the imaging object, and the microphone 2 records the sound directly in front of the camera, and noise reduction processing. When zooming is started, the volume adjusting device will determine and adjust the sound recording power and noise reduction power of the microphone 2 after the image is zoomed according to the zooming situation. In this way, when the subject is zoomed in, the recording power of microphone 2 and the noise reduction power in other directions are increased, and the recorded sound becomes louder; when the subject is zoomed out, the recording power of microphone 2 and the noise reduction power in other directions are reduced. The noise reduction power reduces the loudness of the recorded sound. That is, the recording power of the microphone is physically adjusted dynamically with the zoom factor of the camera, and the sound volume of the audio input is also dynamically adjusted with the zoom factor of the camera, finally realizing the synchronous zooming of the image and the sound.

According to the mathematical relationship between sound loudness and propagation distance, the embodiment of the present disclosure realizes audio zoom while recording visual zoom, and uses a distance sensor and a camera imaging system to measure the actual distance of the object in the image from the shooting position. According to the imaging distance between the shooting object and the shooting position, the power of the sound recorded by the microphone is controlled according to the change of the imaging distance, and the audio zoom is realized.

One of the application scenarios of the embodiments of the present disclosure is: a camera (such as a security camera) on the street captures many people, and when the camera is zoomed in, the image of a certain person is enlarged, and the microphone will increase in the direction of the person's location. The recording power of the person is increased, thereby increasing the sound recorded by the person, and achieving the effect of the person's voice being amplified.

Those of ordinary skill in the art can understand that all or some of the steps in the methods disclosed above, and functional modules/units in the apparatus can be implemented as software, firmware, hardware, and appropriate combinations thereof. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be composed of several physical components Components execute cooperatively. Some or all physical components may be implemented as software executed by a processor such as a central processing unit, digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit circuit. Such software may be distributed on computer-readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). As known to those of ordinary skill in the art, the term computer storage media includes both volatile and nonvolatile implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules or other data flexible, removable and non-removable media. Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cartridges, magnetic tape, magnetic disk storage or other magnetic storage devices, or may Any other medium used to store desired information and which can be accessed by a computer. In addition, communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and can include any information delivery media, as is well known to those of ordinary skill in the art .

Example embodiments have been disclosed herein, and although specific terms are employed, they are used and should only be construed in a general descriptive sense and not for purposes of limitation. In some instances, it will be apparent to those skilled in the art that features, characteristics and/or elements described in connection with a particular embodiment may be used alone or in combination with features, characteristics described in connection with other embodiments unless expressly stated otherwise and/or components used in combination. Accordingly, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the scope of the present disclosure as set forth in the appended claims.

Claims

A zoom video volume adjustment method, comprising:

In the process of capturing the video by the video capturing device, detecting the first imaging distance between the video capturing device and the shooting object;

Adjusting the zoom factor in response to the video capture device, and determining a second distance for imaging according to the zoom factor; and

The recording power of the microphone is determined and adjusted according to the first distance and the second distance.
The method of claim 1, further comprising:

After adjusting the recording power of the microphone, obtain the first loudness of the sound in the direction of the position of the shooting object; and

A second loudness is determined according to the first loudness, the first distance, and the second distance, so as to adjust the output volume of the speaker according to the second loudness.
The method of claim 1, wherein the determining and adjusting the recording power of the microphone according to the first distance and the second distance comprises:

responsive to the second distance being less than the first distance, increasing the recording power of the microphone; and

In response to the second distance being greater than the first distance, the recording power of the microphone is reduced.
The method of any one of claims 1 to 3, further comprising:

After the second imaging distance is determined according to the zoom factor, the noise reduction power is calculated according to the first distance and the second distance; and

The noise reduction power of the microphone is adjusted according to the noise reduction power.
The method of claim 4, wherein noise reduction power is increased in response to the second distance being less than the first distance; and noise reduction power is decreased in response to the second distance being greater than the first distance.
A volume adjustment device, comprising: a detection module, a processing module and an adjustment module, wherein the detection module is configured to detect a first imaging distance between the video capture device and a shooting object during the process of video capture by a video capture device ;

The processing module is configured to adjust the zoom factor in response to the video capture device, and determine a second distance for imaging according to the zoom factor; determine the recording power of the microphone according to the first distance and the second distance; and

The adjustment module is configured to adjust the recording power of the microphone.
The volume adjustment device according to claim 6, further comprising an acquisition module, the acquisition module is configured to acquire the first loudness of the sound in the direction where the position of the shooting object is located after the adjustment module adjusts the recording power of the microphone ;

The processing module is further configured to determine a second loudness based on the first loudness, the first distance and the second distance; and

The adjustment module is further configured to adjust the output volume of the speaker according to the second loudness.
The volume adjustment device of claim 6, wherein in response to the second distance being smaller than the first distance, the recording power of the microphone increases; in response to the second distance being greater than the first distance, The recording power of the microphone is reduced.
The volume adjustment device according to any one of claims 6 to 8, wherein the processing module is further configured to, after determining the second distance for imaging according to the zoom factor, determine the second distance for imaging according to the first distance and the The second distance calculates noise reduction power; and

The adjustment module is further configured to adjust the noise reduction power of the microphone according to the noise reduction power.
10. The volume adjustment device of claim 9, wherein the noise reduction power is increased in response to the second distance being smaller than the first distance; and the noise reduction power is decreased in response to the second distance being greater than the first distance small.
A video shooting device, comprising a video capture device, a microphone and the volume adjustment device according to any one of claims 6 to 10.
The video capture device of claim 11, wherein the microphones are two microphones.
The video capture device of claim 12, wherein at least one of the two microphones is a unidirectional microphone.
The video shooting device according to any one of claims 11 to 13, further comprising a speaker, and the volume adjustment device is the volume adjustment device according to claim 7 .