CN107920263B

CN107920263B - Volume adjusting method and device

Info

Publication number: CN107920263B
Application number: CN201610885863.0A
Authority: CN
Inventors: 苏辉; 栾国良; 金升阳; 蒋海青
Original assignee: Hangzhou Fluorite Network Co ltd
Current assignee: Hangzhou Fluorite Network Co ltd
Priority date: 2016-10-11
Filing date: 2016-10-11
Publication date: 2021-10-29
Anticipated expiration: 2036-10-11
Also published as: CN107920263A; WO2018068689A1

Abstract

The invention relates to a volume adjusting method and device, and belongs to the technical field of audio and video processing. The method comprises the following steps: determining a target distance between a terminal and a target object in the process of playing audio and video by the terminal; determining target volume according to the target distance; and adjusting the volume of the audio and video played by the terminal to the target volume. The invention solves the technical problems of complex operation and low convenience for adjusting the volume. The volume adjusting device has the beneficial effects that the operation process of adjusting the volume is simplified, and the volume adjusting operation is more convenient. The invention is used for playing audio and video.

Description

Volume adjusting method and device

Technical Field

The invention relates to the technical field of audio and video processing, in particular to a volume adjusting method and device.

Background

With the continuous development of audio and video processing technology, terminals capable of playing audio and video are more and more widely applied, wherein a common terminal is a sound box.

In the related art, when the volume of the audio/video played by the terminal needs to be adjusted, on one hand, a user can rotate an adjusting knob arranged on the terminal to adjust the volume, and on the other hand, the user can also control the terminal through a corresponding remote controller to adjust the volume.

However, the existing volume adjusting method requires the user to manually adjust the volume of the terminal, so the operation of adjusting the volume is complex and the convenience is low.

Disclosure of Invention

In order to solve the problems of complex operation and low convenience of volume adjustment, the embodiment of the invention provides a volume adjustment method and a volume adjustment device. The technical scheme is as follows:

according to a first aspect of embodiments of the present invention, there is provided a volume adjustment method, including:

in the process of playing audio and video by a terminal, determining the target distance between the terminal and a target object, wherein the audio and video comprises at least one of audio and video;

determining target volume according to the target distance;

and adjusting the volume of the audio and video played by the terminal to the target volume.

Optionally, the determining the target volume according to the target distance includes:

inquiring a preset distance and volume corresponding relation to obtain a target volume corresponding to the target distance;

or acquiring the position of the target object, and calculating by adopting a preset correlation algorithm according to the position of the target object and the target distance to obtain the target volume.

Optionally, after the volume of the audio and video played by the terminal is adjusted to the target volume, the method further includes:

and adjusting the sound production direction of the terminal to enable the sound production direction of the terminal to face the target object.

Optionally, before the determining the target distance between the terminal and the target object, the method further includes:

detecting whether a moving object exists in a preset range where the terminal is located;

determining the number of the moving objects when the moving objects exist in a preset range where the terminal is located;

determining the moving object as the target object when the number of the moving objects is 1;

selecting one moving object among the at least two moving objects as the target object when the number of the moving objects is at least two.

Optionally, the detecting whether a moving object exists in a preset range where the terminal is located includes:

judging whether a moving object exists in the detectable range of the terminal;

acquiring an image including a moving object when the moving object exists within the terminal detectable range;

and determining whether the moving object is within a preset range of the terminal according to the image comprising the moving object.

Optionally, the determining, according to the image including the moving object, whether the moving object is within a preset range where the terminal is located includes:

detecting whether a similarity correlation value of the moving object and a reference object with a preset size in an image comprising the moving object is smaller than a preset correlation value threshold value or not, wherein the similarity correlation value is inversely correlated with the similarity;

and when the similarity correlation value of the moving object and the reference object is smaller than a preset correlation value threshold value, determining that the moving object is in a preset range where the terminal is located.

Optionally, the determining whether a moving object exists in the detectable range of the terminal includes:

periodically acquiring images in a detectable range of the terminal;

comparing the image acquired in the current period with the image acquired in the previous period;

when an object with a changed position exists in the image acquired in the current period and the image acquired in the previous period, determining that a moving object exists in the detectable range of the terminal, wherein the moving object is the object with the changed position.

Optionally, the determining a target distance between the terminal and a target object includes:

calculating the target distance between the terminal and a target object by using a binocular stereo vision algorithm;

or determining the target distance by adopting an infrared distance measurement mode or a laser distance measurement mode;

or determining the target distance according to a relative position positioning mode.

According to a second aspect of embodiments of the present invention, there is provided a volume adjustment device, the device including:

the terminal comprises a first determining module, a second determining module and a third determining module, wherein the first determining module is used for determining a target distance between the terminal and a target object in the process of playing audio and video by the terminal, and the audio and video comprises at least one of audio and video;

the second determining module is used for determining the target volume according to the target distance;

and the first adjusting module is used for adjusting the volume of the audio and video played by the terminal to the target volume.

Optionally, the second determining module is configured to:

Optionally, the volume adjusting apparatus further includes:

and the second adjusting module is used for adjusting the sound production direction of the terminal, so that the sound production direction of the terminal faces to the target object.

Optionally, the volume adjusting apparatus further includes:

the detection module is used for detecting whether a moving object exists in a preset range where the terminal is located;

the third determining module is used for determining the number of the moving objects when the moving objects exist in the preset range where the terminal is located;

a fourth determination module for determining the moving object as the target object when the number of the moving objects is 1;

a fifth determining module, configured to select one moving object from the at least two moving objects as the target object when the number of the moving objects is at least two.

Optionally, the detection module includes:

the judging submodule is used for judging whether a moving object exists in the detectable range of the terminal;

an acquisition sub-module configured to acquire an image including a moving object when the moving object exists within the terminal detectable range;

and the determining submodule is used for determining whether the moving object is in a preset range in which the terminal is positioned according to the image comprising the moving object.

Optionally, the determining sub-module is configured to:

Optionally, the determining submodule is configured to:

periodically acquiring images in a detectable range of the terminal;

Optionally, the first determining module is configured to:

Optionally, the terminal is a sound box.

According to a third aspect of embodiments of the present invention, there is provided a volume adjustment device, the device including:

the terminal comprises a sensing module, a display module and a control module, wherein the sensing module is used for determining a target distance between the terminal and a target object in the process of playing audio and video by the terminal, and the audio and video comprises at least one of audio and video;

the processor is used for receiving the target distance sent by the sensing module and determining target volume according to the target distance;

and the loudspeaking module is used for playing the audio and video by adopting the target volume according to the instruction of the processor.

Optionally, the processor is further configured to: inquiring a preset distance and volume corresponding relation to obtain a target volume corresponding to the target distance; or acquiring the position of the target object, and calculating by adopting a preset correlation algorithm according to the position of the target object and the target distance to obtain the target volume.

Optionally, the volume adjusting apparatus further includes: and the driving module is used for driving the position and/or direction change of the loudspeaker module so as to adjust the sound production direction of the terminal.

Optionally, the sensing module is further configured to detect whether a moving object exists within a preset range where the terminal is located;

the processor is further configured to determine the number of the moving objects when the sensing module detects that the moving objects exist in a preset range where the terminal is located; determining the moving object as the target object when the number of the moving objects is 1; selecting one moving object among the at least two moving objects as the target object when the number of the moving objects is at least two.

Optionally, the sensing module comprises an image acquisition module,

the processor is further used for judging whether a moving object exists in the detectable range of the terminal;

the image acquisition module is used for acquiring an image comprising a moving object when the processor judges that the moving object exists in the detectable range of the terminal;

the processor is further configured to determine whether the moving object is within a preset range where the terminal is located according to the image including the moving object acquired by the image acquisition module.

Optionally, the processor is further configured to detect whether a similarity correlation value between the moving object and a reference object of a preset size in an image including the moving object is smaller than a preset correlation value threshold, where the similarity correlation value is negatively correlated with similarity; and when the similarity correlation value of the moving object and the reference object is smaller than a preset correlation value threshold value, determining that the moving object is in a preset range where the terminal is located.

Optionally, the image acquisition module is configured to periodically acquire an image within a detectable range of the terminal;

the processor is also used for comparing the image acquired by the image acquisition module in the current period with the image acquired in the previous period; when an object with a changed position exists in the image acquired in the current period and the image acquired in the previous period, determining that a moving object exists in the detectable range of the terminal, wherein the moving object is the object with the changed position.

Optionally, the sensing module includes:

the image acquisition module is used for calculating the target distance between the terminal and a target object by utilizing a binocular stereo vision algorithm;

or, the infrared sensor is used for determining the target distance by adopting an infrared distance measurement mode;

or, the laser generator is used for determining the target distance in a laser ranging mode;

or, the global positioning system GPS is used for determining the target distance according to a relative position positioning mode;

or the wireless fidelity WIFI module is used for determining the target distance according to the relative position positioning mode.

The technical scheme provided by the embodiment of the invention can have the following beneficial effects:

according to the volume adjusting method and device provided by the embodiment of the invention, the target volume is determined according to the target distance between the terminal and the target object, and the volume of the audio and video played by the terminal is adjusted to the target volume, so that the automatic adjustment of the volume of the audio and video of the terminal is realized, a user does not need to manually adjust the volume of the terminal, the operation process of adjusting the volume is simplified, and the volume adjusting operation is more convenient.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.

Drawings

In order to illustrate the embodiments of the present invention more clearly, the drawings that are needed in the description of the embodiments will be briefly described below, it being apparent that the drawings in the following description are only some embodiments of the invention, and that other drawings may be derived from those drawings by a person skilled in the art without inventive effort.

FIG. 1 is a schematic illustration of one implementation environment shown in accordance with the related art;

FIG. 2 is a method flow diagram illustrating a method of volume adjustment according to an exemplary embodiment;

FIG. 3 is a method flow diagram illustrating another method of volume adjustment according to an exemplary embodiment;

FIG. 4 is a method flow diagram illustrating yet another method of volume adjustment according to an exemplary embodiment;

FIG. 5 is a schematic diagram of a moving object in an image, shown in accordance with an exemplary embodiment;

FIG. 6 is a schematic diagram of a moving object in another image shown in accordance with an exemplary embodiment;

FIG. 7-1 is a diagram illustrating a terminal with rotation functionality according to an exemplary embodiment;

FIG. 7-2 is a schematic diagram illustrating another terminal with rotation functionality in accordance with an exemplary embodiment;

FIG. 8 is a block diagram illustrating a volume adjustment device according to an exemplary embodiment;

fig. 9 is a block diagram illustrating another volume adjustment device according to an exemplary embodiment;

fig. 10 is a block diagram illustrating yet another volume adjustment device according to an exemplary embodiment;

FIG. 11 is a block diagram illustrating a detection module in accordance with an exemplary embodiment;

fig. 12 is a block diagram illustrating yet another volume adjustment device according to an exemplary embodiment;

fig. 13 is a block diagram illustrating yet another volume adjustment device according to an exemplary embodiment;

fig. 14 is a block diagram illustrating yet another volume adjustment device according to an exemplary embodiment.

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail with reference to the accompanying drawings, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Referring to fig. 1, a schematic diagram of an implementation environment related to a volume adjustment method provided in some embodiments of the present invention is shown. The environment of implementation may be an indoor environment or an outdoor environment, typically an indoor environment. The implementation environment may include: a terminal 01 and at least one user 02. In the embodiment of the present invention, the audio and video includes at least one of audio and video, and the terminal 01 may be a sound box, a smart phone, a computer, a multimedia player, an electronic reader, a wearable device, and the like. The distance between the terminal 01 and the at least one user 02 may be dynamically changed. For example, the implementation environment may be that a sound box is placed at one end of a living room, a user starts to be located on a sofa at the other end of the living room, the user may control the sound box through a button disposed on the sound box or using a corresponding remote controller to play audio, and meanwhile, during the audio playing process, the position of the user may change, for example, the user may leave the current position to drink water or move during the audio playing process, so that the distance between the user and the sound box changes. For another example, the implementation environment may be that a sound box is placed in the center of a hall of a hotel, people in the hotel disperse around the sound box as users, any user may control the sound box through a button disposed on the sound box or using a corresponding remote controller to play audio, and meanwhile, during the audio playing process, the position of the user may change, for example, a security patrol or a cleaner cleans, so that the distance between the user and the sound box changes.

Fig. 2 is a flow chart illustrating a method of volume adjustment that may be used to control volume adjustment of terminal 01, which may be performed by terminal 01 in the implementation environment shown in fig. 1, according to an exemplary embodiment. Referring to fig. 2, the process flow may include the following steps:

step 201, in the process of playing audio and video by the terminal, determining the target distance between the terminal and a target object.

In an embodiment of the present invention, the audio-video includes at least one of audio and video.

Step 202, determining the target volume according to the target distance.

And step 203, adjusting the volume of the audio and video played by the terminal to a target volume.

In summary, according to the volume adjusting method provided by the embodiment of the present invention, the target volume is determined according to the target distance between the terminal and the target object, and the volume of the audio and video played by the terminal is adjusted to the target volume, so that the automatic adjustment of the volume of the audio and video of the terminal is realized, the volume of the terminal does not need to be manually adjusted by a user, the operation process of adjusting the volume is simplified, and the volume adjusting operation is more convenient.

Fig. 3 is a flowchart illustrating another method for adjusting volume according to an exemplary embodiment, which may be performed by the av playback terminal 01 in the implementation environment shown in fig. 1. Referring to fig. 3, the process flow may include the following steps:

step 301, detecting whether a moving object exists in a preset range where the terminal is located.

In the embodiment of the invention, the volume of the terminal needs to be adjusted according to the distance between the terminal and the user so as to meet the hearing comfort of the user, and under the normal condition, when the terminal is fixed, the change of the distance between the terminal and the user is based on the movement of the user, so that when the terminal meets the preset triggering condition, whether a moving object exists in the preset range where the terminal is located can be detected, and the preset triggering condition can be that the terminal is powered on or that the terminal starts to play audio and video. The terminal may re-determine a target object among the moving objects, which is defaulted as the user. In practical applications, the target object may be a human body, or may also be a movable pet such as a cat or a dog, which is not limited in the embodiment of the present invention.

Optionally, as shown in fig. 4, the step 301 may include:

step 3011, determine whether there is a moving object in the detectable range of the terminal.

For example, the process of determining whether a moving object exists in the detectable range of the terminal may include the steps of:

step 3011a, periodically acquiring an image within a detectable range of the terminal.

For example, an image within a detectable range of the terminal may be obtained through an image obtaining module carried by the terminal or an image obtaining module connected to the terminal, where the image obtaining module may be a camera, and in practical application, the size of the image obtained by the camera is generally: 640 × 480, 1024 × 768, 1600 × 1200, or 2048 × 1536. Specifically, the size of the acquired image is different for different cameras. In the two sets of imaged numbers, the former is the picture width and the latter is the picture height. The aspect ratio of the acquired image is typically 4: 3. the image within the terminal detectable range refers to an image within a range that the terminal can detect, and may be, for example, an image within a photographable range of the image acquisition module. The period for acquiring the image may be a fixed period, for example, 1 second or 0.5 second, or may be a variable period, for example, two adjacent acquisition periods are triggered in different triggering manners, or meet a preset rule, so that the durations of the two adjacent acquisition periods are different.

Step 3011b, compare the image obtained in the current period with the image obtained in the previous period.

Taking the acquisition period as a fixed period and 0.5 second as an example, comparing the image acquired in the current period with the image acquired in the previous period before 0.5 second to determine whether there is an object with a changed position in the two frames of images, executing step 3011c when there is an object with a changed position in the image acquired in the current period and the image acquired in the previous period, and executing step 3011a when there is no object with a changed position in the image acquired in the current period and the image acquired in the previous period.

It should be noted that the images compared by the terminal are usually images acquired from the same angle, and if the terminal can move, the images acquired from different angles are not usually compared by the terminal.

Step 3011c, when there is an object with a changed position in the image obtained in the current period and the image obtained in the previous period, it is determined that there is a moving object in the detectable range of the terminal, and the moving object is the object with a changed position.

For example, when the terminal takes two images at the same angle and an object having the same shape changes its position, the terminal determines that the object is a position-changed object.

It should be noted that the position change in the embodiment of the present invention may be a position change in the horizontal direction, and may also be a position change in the vertical direction.

In practical applications, the number of the moving objects may be multiple, and when the images acquired in the current period are compared with the images acquired in the previous period, all the objects with changed positions may be determined as the moving objects.

In the embodiment of the present invention, it may also be determined whether a moving object exists in the detectable range of the terminal in other manners, for example, whether a moving object exists in the detectable range of the terminal is determined by using ultrasonic waves. The ultrasonic wave is a sound wave with the frequency higher than 20000 Hz, has good directivity and strong penetrating power, is easy to obtain more concentrated sound energy, and is often applied to the aspects of distance measurement, speed measurement and the like. For example, an ultrasonic generator and an ultrasonic receiver are arranged on the terminal, and the terminal periodically transmits ultrasonic signals through the ultrasonic generator, wherein the period for transmitting the ultrasonic signals may be a fixed period, for example, 1 second or 2 seconds, or may also be a variable period, for example, two adjacent transmission periods are triggered in different triggering manners, or a preset rule is met, so that the durations of the two adjacent transmission periods are different; the terminal receives the ultrasonic reflection signal from the return through the ultrasonic receiver; the terminal compares the ultrasonic wave reflected signal received in the current period with the ultrasonic wave reflected signal received in the previous period, and judges whether a moving object exists or not; if the ultrasonic wave reflected signal received in the current period is different from the ultrasonic wave reflected signal received in the previous period, judging that a moving object exists; and if the ultrasonic wave reflected signal received in the current period is the same as the ultrasonic wave reflected signal received in the previous period, judging that no moving object exists.

Taking the period of transmitting the ultrasonic wave signal as a fixed period and 1 second as an example, comparing the ultrasonic wave reflected signal received by the terminal in the current period with the ultrasonic wave reflected signal received before 1 second, and if the waveforms of the two ultrasonic wave reflected signals are changed, judging that a moving object exists. If the waveforms of the two ultrasonic wave reflection signals are not changed, it is judged that no moving object exists.

It should be noted that the ultrasonic signals compared by the terminal are signals transmitted and received from the same angle, and if the terminal can move, the signals transmitted and received from different angles are not usually compared by the terminal.

Step 3012, when there is a moving object in the detectable range of the terminal, acquiring an image including the moving object.

For example, the image including the moving object may be obtained by an image obtaining module provided in the terminal or an image obtaining module connected to the terminal, the image obtaining module may be a camera, the image including the moving object may be an image within a terminal detectable range obtained by the camera, and the image within the terminal detectable range includes the moving object.

Step 3013, determining whether the moving object is within a preset range of the terminal according to the image including the moving object.

Specifically, the method for determining whether the moving object is within the preset range of the terminal according to the image including the moving object may include the following steps:

step 3013a, detecting whether a similarity correlation value between the moving object and a reference object with a preset size in the image including the moving object is smaller than a preset correlation value threshold.

The similarity correlation value is inversely correlated with the similarity, that is, when the similarity correlation value between the moving object and the reference object with the preset size is smaller, the similarity between the moving object and the reference object with the preset size is higher, and the similarity between the moving object and the reference object with the preset size is mainly represented as similarity in size.

The preset correlation value threshold is not specifically limited in the embodiment of the present invention, and the preset correlation value threshold may be set according to an actual situation, and in an actual application, the preset correlation value threshold may be set to 10.

Optionally, the image including the moving object is determined as a target image, before detecting whether a similarity correlation value between the moving object and a reference object with a preset size in the target image is smaller than a preset correlation value threshold, an image coordinate system may be established in the target image, and a similarity correlation value between the moving object and the reference object is calculated in the image coordinate system, for example, assuming that an origin of the image coordinate system is an upper left corner of the target image, in the coordinate system, a positive direction of an x-axis is a direction to the right along a horizontal direction, and a positive direction of a y-axis is a direction to the down along a vertical direction, and accordingly, a similarity correlation value calculation formula between the moving object and the reference object may be:

i∈(0，image_width-N)，j∈(0，image_height-M)；

wherein M is the height of the reference object (unit is 1 pixel), N is the width of the reference object (unit is 1 pixel), and M × N represents the pixel size of the reference objectThe target (i, j) represents the luminance component of the reference at the pixel point with the coordinate (i, j), and the current (ii, jj) represents the overall luminance component of the target image. image _ width represents the width (in units of 1 pixel) of the target image, and image _ height represents the height (in units of 1 pixel) of the target image. Diff_AvgpixelvalRepresenting the correlation value of the degree of similarity of a moving object with the reference, Diff_AvgpixelvalWith negative correlation to the degree of similarity of the moving object to the reference, i.e. Diff_AvgpixelvalThe smaller the value of (d), the higher the similarity of the moving object to the reference. ABS (×) indicates the absolute value of the content in parentheses.

Comparing the similarity correlation value between the moving object and the reference object with a preset correlation value threshold, and if the similarity correlation value between the moving object and the reference object is smaller than the preset correlation value threshold, performing step 3013b, for example, as shown in fig. 5, assuming that the similarity correlation value between the moving object L1 in the image acquired by the terminal in fig. 5 and the reference object is smaller than the preset correlation value threshold, then performing step 3013 b; if the similarity correlation value between the moving object and the reference object is greater than the preset correlation value threshold, the step 301 is returned to continue the detection, for example, as shown in fig. 6, if the similarity correlation value between the moving object L2 in the image acquired by the terminal in fig. 6 and the reference object is greater than the preset correlation value threshold, at this time, the step 301 may be executed.

Step 3013b, when the similarity correlation value between the moving object and the reference object with the preset size is smaller than the preset correlation value threshold, determining that the moving object is within the preset range where the terminal is located.

Step 3013c, when the similarity correlation value between the moving object and the reference object with the preset size is not smaller than the preset correlation value threshold, determining that the moving object is not within the preset range where the terminal is located.

Step 302, determining the number of the moving objects when the moving objects exist in the preset range where the terminal is located.

In practical applications, there may be a plurality of moving objects within the preset range where the terminal is located, and therefore, the number of the moving objects needs to be determined.

And step 303, when the number of the moving objects is 1, determining the moving objects as the target objects.

If there is only one moving object within the range of the terminal, the moving object may be determined as the target object.

Step 304, when the number of the moving objects is at least two, selecting one moving object from the at least two moving objects as the target object.

In the embodiment of the present invention, there may be a plurality of selection manners for selecting the target object from the at least two moving objects, for example, the selection manner may include one or more of the following manners, and when the selection manner includes a plurality of the following manners, a priority may be set for each of the plurality of manners, and the selection process is performed according to the corresponding priority:

a first mode of selecting an object closest to a terminal among the at least two moving objects; a second mode of selecting an object with the sound emission direction of the terminal from the at least two moving objects; in a third way, an object with a front face (for example, a human face) facing the terminal is selected from the at least two moving objects.

Suppose that there are two people, small black and small white, in a room where the terminal is placed. The small black is located at a position 5 m away from the terminal, the small white is located at a position 6 m away from the terminal, the sounding direction of the terminal faces back to the small black and faces towards the small white, the small black face faces towards the terminal, and the small white faces back to the terminal. If the first mode is adopted for selection, selecting small black as a target object; if the second mode is adopted for selection, selecting the small white as a target object; if the selection is made in the third way, then the small black is selected as the target object. Therefore, under the same condition, the selected target objects may not be the same by adopting different selection modes.

The target object may be a human body, or a pet such as a cat or a dog that can move, but in practical applications, the terminal may also recognize some movable machines as the target object, such as a sweeping robot or an unmanned aerial vehicle, but the volume adjustment for such target object loses the original intention of improving the user experience, and therefore, a living body recognition module may be installed on the terminal, and after determining the target object, the living body recognition is performed on the target object, if the target object is a living body, the volume adjustment is performed for the target object, and if the target object is not a living body, the above steps 301 to 304 may be executed again after excluding the target object until the target object of the living body is found.

And 305, determining the target distance between the terminal and a target object in the process of playing the audio and video by the terminal.

The target distance is the distance between the center position of the target object and the terminal. For the method for determining the target distance between the terminal and the target object, the embodiment of the invention can be implemented by the following three ways:

in a first implementation manner, the target distance between the terminal and the target object is calculated by using a binocular stereo video algorithm, and the specific process may include:

and A1, acquiring a binocular stereo video image of the target object.

And step B1, performing disparity estimation based on image segmentation stereo matching on the binocular stereo video image.

And step C1, performing consistency check on the parallax images obtained by image segmentation stereo matching, and reducing mismatching of the depth images by adopting self-adaptive matching to delete unreliable matching.

And D1, converting the parallax image into a depth image according to the relation between the parallax and the depth.

And E1, performing rectification optimization on the depth image by adopting a polygonal filter.

And F1, outputting the depth image to obtain the binocular stereo video depth information.

The target distance D is Depth (x, y), where Depth (x, y) represents Depth information of the target object, and (x, y) is a coordinate value of the center of the target object in a preset coordinate system.

In a second implementation manner, the target distance is determined in an infrared ranging manner or a laser ranging manner, and the specific process may include:

step A2, emitting a target light beam to the target object at the terminal, wherein the target light beam is laser or infrared light.

And step B2, receiving the target light reflected by the target object.

And step C2, obtaining the round trip time of the target ray.

And D2, calculating the distance between the target object and the terminal according to the round trip time.

The distance between the target object and the terminal can be calculated by the formula D ═ ct/2, D represents the target distance, c represents the light speed of the target ray, and t represents the round trip time of the acquired target ray.

In a third implementation, the target distance is determined according to a relative position location mode.

The method of determining the target distance based on the relative position determination method is a method of determining the target distance based on a change in displacement of the object with respect to the reference object. The method may specifically include Global Positioning System (GPS) positioning or Wireless Fidelity (WIFI) positioning. The embodiments of the present invention will not be described in detail herein.

And step 306, determining the target volume according to the target distance.

The target volume in the embodiment of the invention is the volume which makes the target object feel comfortable at the position. For example, when the target object is a human, since the volume at which the human ear feels comfortable is generally between 60 db and 75 db, the target volume may be set such that the human feels a volume between 60 db and 75 db.

For the method of determining the target volume according to the target distance, the embodiment of the present invention can be implemented in the following two ways:

the first way of realization is: and inquiring the corresponding relation between the preset distance and the volume to obtain the target volume corresponding to the target distance.

The preset corresponding relationship between the distance and the volume may be a preset distance, a position and volume association table, and specifically, before the terminal leaves a factory, data of the corresponding distance, position and volume may be acquired through an experiment, wherein an experimental environment for performing the acquisition experiment may be a general standard environment, the acquisition experiment may be performed in a room with an area of 50 square meters, one end of the room in the length direction is provided with a sound box, a person is set as a target object, a target volume is set to be 60 decibels for performing the experiment, the distance and the position between the target object and the sound box are continuously adjusted, and the corresponding volume which enables the target object to feel the volume of 60 decibels under the distance and the position is recorded, for example, when the target object faces the direction of the sound box and is 2 meters away from the sound box, the corresponding target volume is recorded; when the target object faces the sound production direction of the sound box and is 3 meters away from the sound box, recording the corresponding target volume; recording corresponding target volume when the target object is opposite to the sound production direction of the sound box and is 2 meters away from the sound box; recording corresponding target volume when the target object is opposite to the sound production direction of the sound box and is 3 meters away from the sound box; and recording multiple groups of data by adjusting the distance and the position between the target object and the sound box for multiple times. And obtaining a preset association table of the distance, the position and the volume according to the acquired data, and storing the association table in a storage module of the terminal.

After the target distance is obtained, the target volume corresponding to the target distance can be obtained in a table look-up mode.

The second way of realization is: and acquiring the position of the target object, and calculating by adopting a preset correlation algorithm according to the position of the target object and the target distance to obtain the target volume.

Specifically, before the terminal leaves the factory, data of a distance, a position and a volume corresponding to the distance can be acquired through an experiment, wherein the experimental environment for performing the acquisition experiment can be a general standard environment, the acquisition experiment can be performed in a room with an area of 50 square meters, a sound box is arranged at one end of the room in the length direction, a person is arranged as a target object, the target volume is set to be 60 decibels for performing the experiment, the distance and the position between the target object and the sound box are continuously adjusted, and the corresponding volume which can enable the target object to feel the volume to be 60 decibels under the distance and the position is recorded, for example, when the target object faces to the sound production direction of the sound box and is 2 meters away from the sound box, the corresponding target volume is recorded; when the target object faces the sound production direction of the sound box and is 3 meters away from the sound box, recording the corresponding target volume; recording corresponding target volume when the target object is opposite to the sound production direction of the sound box and is 2 meters away from the sound box; recording corresponding target volume when the target object is opposite to the sound production direction of the sound box and is 3 meters away from the sound box; and recording multiple groups of data by adjusting the distance and the position between the target object and the sound box for multiple times. And obtaining a preset association algorithm of the preset distance, position and volume according to the acquired data, and storing the association algorithm in a storage module of the terminal. The preset association algorithm may be: and V is f (D, T), V is the target volume, D is the target distance, and T is the position of the target object.

After the target distance is obtained, the position of the target object and the target distance can be brought into the preset association algorithm, and the target volume corresponding to the target distance is calculated.

It should be noted that, for the preset association algorithm, a preset coordinate system needs to be set for the terminal, and when the algorithm is established, the acquired position is based on the coordinate system, and the position of the terminal at which the target object is acquired is also based on the preset coordinate system, so that the accuracy of calculating the target volume can be ensured.

And 307, adjusting the volume of the audio and video played by the terminal to a target volume.

For the specific adjustment method, the embodiment of the present invention is not limited, and can be implemented by referring to the related art. The target volume in this step is the target volume obtained according to the target distance in step 306.

And 308, adjusting the sound production direction of the terminal to enable the sound production direction of the terminal to face the target object.

For a specific sound emission direction adjustment method, the embodiment of the present invention is not limited, and may be implemented by referring to the related art. For example, as shown in fig. 7-1 and 7-2, assuming that the terminal is a sound box, the sound box includes a sound generating structure 01 and a moving structure 02, and the moving structure 02 can move the sound generating structure 01, so that the sound generating direction thereof can be adjusted. For example, as shown in fig. 7-1, the mobile structure 02 includes a base 021, and a rotating shaft 022 rotatably disposed on the base 021, and the sounding structure 01 is fixedly connected to the rotating shaft 022, and is driven by the rotating shaft 022 to rotate, so that the sounding direction thereof is adjusted. Optionally, the base 021 may have a cavity therein, and the cavity has a driving structure therein, where the driving structure may be a micro motor to drive the rotating shaft to rotate.

As shown in fig. 7-2, magnetic structures (not shown in fig. 7-2) may be installed at the upper end of the moving structure 02 and the lower end of the sounding structure 01, and the sounding structure 01 may be suspended above the moving structure 02 by adjusting the magnetic force therebetween, and the sounding structure 01 may rotate, thereby adjusting the sounding direction.

In the embodiment of the invention, the sound production direction of the terminal is enabled to face the target object by adjusting the sound production direction of the terminal, so that the target object can obtain better audio-visual sound effect.

In practical applications, the embodiment of the present invention may also determine the target distance between the terminal and the target object in other manners, for example, when it is detected that at least one moving object exists within the detectable range of the terminal (the detection method may refer to step 3011 above), determine the distance between the terminal and each moving object, and determine whether there is a distance smaller than a preset distance threshold in the distances between the terminal and each moving object, where the specific preset distance threshold may be set according to an actual situation, for example, the preset distance threshold may be set to 3 meters. And when the distance between the terminal and each moving object is smaller than a preset distance threshold, determining the object of which the corresponding distance is smaller than the preset distance threshold as a target object, and determining the distance between the terminal and the target object as a target distance.

It should be noted that, the order of the steps of the volume adjusting method provided in the embodiment of the present invention may be appropriately adjusted, and the steps may also be increased or decreased according to the circumstances, and any method that can be easily conceived by those skilled in the art within the technical scope of the present invention shall be included in the protection scope of the present invention, and therefore, the detailed description thereof is omitted.

Fig. 8 is a block diagram illustrating a volume adjustment device 40 according to an exemplary embodiment, and referring to fig. 8, the volume adjustment device 40 may include:

the first determining module 401 is configured to determine a target distance between a terminal and a target object in a process of playing audio and video by the terminal, where the terminal may be a sound box.

And a second determining module 402, configured to determine a target volume according to the target distance.

The first adjusting module 403 is configured to adjust the volume of the audio and video played by the terminal to a target volume.

In summary, the volume adjusting device provided in the embodiment of the present invention determines the target volume according to the target distance between the terminal and the target object, and adjusts the volume of the audio/video played by the terminal to the target volume, so as to achieve automatic adjustment of the volume of the audio/video of the terminal, and a user does not need to manually adjust the volume of the terminal, thereby simplifying the operation process of adjusting the volume, and making the volume adjusting operation more convenient.

Optionally, the second determining module 402 is configured to:

inquiring a corresponding relation between a preset distance and the volume to obtain a target volume corresponding to the target distance;

Fig. 9 is a block diagram illustrating still another volume adjustment device 40 according to an exemplary embodiment, and referring to fig. 9, the volume adjustment device 40 may include: a first determination module 401, a second determination module 402, a first adjustment module 403 and a second adjustment module 404.

The first determining module 401 is configured to determine a target distance between the terminal and a target object in a process of playing an audio/video by the terminal.

And a second adjusting module 404, configured to adjust a sound emitting direction of the terminal, so that the sound emitting direction of the terminal faces the target object.

Fig. 10 is a block diagram illustrating still another volume adjustment device 40 according to an exemplary embodiment, and referring to fig. 10, the volume adjustment device 40 may include: a first determination module 401, a second determination module 402, a first adjustment module 403, a detection module 405, a third determination module 406, a fourth determination module 407 and a fifth determination module 408.

The detecting module 405 is configured to detect whether a moving object exists within a preset range where the terminal is located.

The third determining module 406 is configured to determine the number of the moving objects when the moving objects exist within the preset range where the terminal is located.

A fourth determination module 407, configured to determine the moving object as the target object when the number of moving objects is 1.

The fifth determining module 408 is configured to select one moving object from the at least two moving objects as the target object when the number of moving objects is at least two.

Optionally, fig. 11 is a block diagram of the detection module 405 provided in the embodiment shown in fig. 10, and referring to fig. 11, the detection module 405 may include:

the determining sub-module 4051 is configured to determine whether a moving object exists in the detectable range of the terminal.

The obtaining sub-module 4052 is configured to obtain an image including a moving object when the moving object exists in the terminal detectable range.

The determining sub-module 4053 is configured to determine whether the moving object is within a preset range in which the terminal is located, based on the image including the moving object.

Optionally, the determining sub-module 4053 is configured to:

detecting whether a similarity correlation value of a moving object and a reference object with a preset size in an image comprising the moving object is smaller than a preset correlation value threshold value or not, wherein the similarity correlation value is in negative correlation with the similarity;

Optionally, the determining sub-module 4051 is configured to:

the periodic acquisition terminal can detect images within range.

And comparing the image acquired in the current period with the image acquired in the previous period.

When the position change object exists in the images acquired in the current period and the images acquired in the previous period, the mobile object is determined to exist in the detectable range of the terminal, and the mobile object is the position change object.

Optionally, the first determining module 401 is configured to:

or determining the target distance according to the relative position positioning mode.

Fig. 12 is a block diagram illustrating another volume adjusting apparatus 50 according to an exemplary embodiment, for example, the apparatus 50 may be a device with a camera function, and the volume adjusting apparatus 50 may be used to control an av playing terminal, which may be a sound box, a smart phone, a computer, a multimedia player, an e-reader, a wearable device, or the like. Preferably a sound box. The structure of the sound box can refer to the structure shown in fig. 7-1 and 7-2.

Referring to fig. 12, the volume adjusting device 50 may include:

the apparatus 50 may include one or more of the following components: processing component 501, memory 502, power component 503, multimedia component 504, audio component 505, input/output (I/O) interface 506, sensor component 507, and communication component 508.

The processing component 501 generally controls the overall operation of the device 50, such as operations associated with display, data communication, camera operations, and recording operations. The processing component 501 may include one or more processors 510 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 501 may include one or more modules that facilitate interaction between the processing component 501 and other components. For example, the processing component 501 may include a multimedia module to facilitate interaction between the multimedia component 504 and the processing component 501.

The memory 502 is configured to store various types of data to support operations at the apparatus 50. Examples of such data include instructions for any application or method operating on the device 50, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 502 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The power supply component 503 provides power to the various components of the device 50. The power components 503 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 50.

The multimedia component 504 includes a screen that provides an output interface between the device 50 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 504 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 50 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 505 is configured to output and/or input audio signals. For example, audio component 505 includes a Microphone (MIC) configured to receive external audio signals when apparatus 50 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 502 or transmitted via the communication component 508. In some embodiments, audio component 505 further comprises a speaker for outputting audio signals.

The I/O interface 506 provides an interface between the processing component 501 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 507 includes one or more sensors for providing various aspects of condition assessment for the device 50. For example, the sensor assembly 507 may detect an open/closed state of the device 50, the relative positioning of components, such as a display and keypad of the device 50, the sensor assembly 507 may also detect a change in the position of the device 50 or a component of the device 50, the presence or absence of user contact with the device 50, orientation or acceleration/deceleration of the device 50, and a change in the temperature of the device 50. The sensor assembly 507 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 507 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 507 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 508 is configured to facilitate wired or wireless communication between the apparatus 50 and other devices. The device 50 may access a wireless network based on a communication standard, such as WIFI, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 508 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 508 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the apparatus 50 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 502 comprising instructions, executable by the processor 510 of the apparatus 50 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a read only memory (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, and the like.

A non-transitory computer readable storage medium, wherein instructions of the storage medium, when executed by a processor of an apparatus 50, enable the apparatus 50 to perform a volume adjustment method provided by an embodiment of the present invention

Fig. 13 is a block diagram illustrating a volume adjusting device 60 according to another exemplary embodiment, where, as shown in fig. 13, the volume adjusting device 60 may be a sound box, and the volume adjusting device 60 includes:

the sensing module 601 is configured to determine a target distance between the terminal and a target object in a process of playing audio and video by the terminal, where the audio and video includes at least one of audio and video.

And the processor 602 is configured to receive the target distance sent by the sensing module 601, and determine a target volume according to the target distance.

The speaker module 603 is configured to play an audio and a video with a target volume according to an instruction of the processor 602.

The sensing module 601 may have the same or similar functions as the first determining module 401 in the above embodiment.

The sensing module 601 may also have the same or similar functionality as the detection module 405 in the embodiments described above.

The sensing module 601 may also have the same or similar functions as the acquisition sub-module 4052 in the above-described embodiment.

The processor 602 may have the same or similar functions as the second determination module 402 in the above-described embodiment. The processor may be one or more processors. The processor 602 may also have the same or similar functions as the third determining module 406 in the above-described embodiment.

The processor 602 may also have the same or similar functions as the fourth determination module 407 in the above-described embodiment.

The processor 602 may also have the same or similar functions as the fifth determination module 408 in the above-described embodiment.

The processor 602 may also have the same or similar functions as the determination sub-module 4051 in the above-described embodiment.

The processor 602 may also have the same or similar functions as the determination sub-module 4053 in the above-described embodiment.

The speaker module 603 may have the same or similar functions as the first conditioning module 403 in the above-described embodiment.

Optionally, the processor 602 may further be configured to: inquiring a corresponding relation between a preset distance and the volume to obtain a target volume corresponding to the target distance; or acquiring the position of the target object, and calculating by adopting a preset correlation algorithm according to the position of the target object and the target distance to obtain the target volume.

Alternatively, as shown in fig. 14, the volume adjusting device 60 may further include: the driving module 604 is configured to drive the position and/or direction of the speaker module to change, so as to adjust the sound emission direction of the terminal.

By way of example, the driving module may be a direct current motor, a magnetic levitation assembly, or a mechanical rail, etc.

Optionally, the sensing module 601 may be further configured to detect whether a moving object exists within a preset range where the terminal is located.

The processor 602 may further be configured to determine the number of moving objects when the sensing module 601 detects that a moving object exists in the preset range where the terminal is located; determining the moving object as a target object when the number of the moving objects is 1; when the number of the moving objects is at least two, one moving object is selected from the at least two moving objects as the target object.

Optionally, the sensing module 601 may include an image acquisition module.

The processor 602 may also be configured to determine whether a moving object is present within the detectable range of the terminal.

The image acquisition module can be used for acquiring images including moving objects when the processor judges that the moving objects exist in the detectable range of the terminal. For example, the image acquisition module may be a camera.

The processor 602 may be further configured to determine whether the moving object is within a preset range of the terminal according to the image including the moving object acquired by the image acquisition module.

Optionally, the processor 602 may be further configured to detect whether a similarity correlation value between the moving object and a reference object with a preset size in the image including the moving object is smaller than a preset correlation value threshold, where the similarity correlation value is negatively correlated with the similarity; and when the similarity correlation value of the moving object and the reference object is smaller than a preset correlation value threshold value, determining that the moving object is in a preset range where the terminal is located.

Optionally, the image acquisition module may be configured to periodically acquire an image within a detectable range of the terminal.

The processor 602 may also be configured to compare the image acquired by the image acquisition module in the current period with the image acquired in the previous period; when the position change object exists in the images acquired in the current period and the images acquired in the previous period, the mobile object is determined to exist in the detectable range of the terminal, and the mobile object is the position change object.

Optionally, the sensing module 601 may include:

and the image acquisition module is used for calculating the target distance between the terminal and the target object by utilizing a binocular stereo vision algorithm.

Or the infrared sensor is used for determining the target distance in an infrared distance measurement mode.

Or the laser generator is used for determining the target distance in a laser ranging mode.

Or, the GPS is used for determining the target distance according to the relative position positioning mode.

Or the WIFI module is used for determining the target distance according to the relative position positioning mode.

It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and modules may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.

It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

Claims

1. A method of adjusting volume, comprising:

in the process of playing audio and video by the terminal, periodically acquiring images within a detectable range of the terminal; comparing the image acquired in the current period with the image acquired in the previous period; when an object with a position change exists in the image acquired in the current period and the image acquired in the previous period, determining that a moving object exists in the detectable range of the terminal, wherein the moving object is the object with the position change, and the period is a variable period;

when the similarity correlation value of the moving object and the reference object is smaller than a preset correlation value threshold value, determining that the moving object is within a preset range where the terminal is located;

when the number of the moving objects is at least two, selecting the target object according to the following three selection modes and the priority set in each mode: selecting an object closest to the terminal as the target object from among at least two moving objects, selecting a moving object with the sound emission direction of the terminal as the target object from among the at least two moving objects, and selecting an object with the front side facing the terminal as the target object from among the at least two moving objects;

performing living body identification on the target object, and if the target object is a living body, calculating a target distance between the terminal and the target object by using a binocular stereo vision algorithm, wherein the audio and video comprises at least one of audio and video;

determining a position relation between the target object and the sound production direction of the terminal, wherein the position relation comprises the sound production direction of the target object facing the terminal and the sound production direction of the target object opposite to the terminal, and calculating by adopting a preset association algorithm according to the position relation and the target distance to obtain a target volume, wherein the preset association algorithm is obtained according to a plurality of pre-recorded groups of position relations, distances and corresponding volumes, and the perceived volume corresponding to the target volume is between 60 decibels and 75 decibels;

and adjusting the volume of the audio and video played by the terminal to the target volume, and adjusting the sound production direction of the terminal to enable the sound production direction of the terminal to face the target object.

2. A volume adjustment device, comprising:

a detection module comprising: the judging submodule is used for periodically acquiring images in a detectable range of the terminal; comparing the image acquired in the current period with the image acquired in the previous period; when an object with a position change exists in the image acquired in the current period and the image acquired in the previous period, determining that a moving object exists in the detectable range of the terminal, wherein the moving object is the object with the position change, and the period is a variable period; an acquisition sub-module configured to acquire an image including a moving object when the moving object exists within the terminal detectable range; a determining submodule, configured to detect whether a similarity correlation value between the moving object and a reference object of a preset size in an image including the moving object is smaller than a preset correlation value threshold, where the similarity correlation value is inversely correlated with a similarity; when the similarity correlation value of the moving object and the reference object is smaller than a preset correlation value threshold value, determining that the moving object is within a preset range where the terminal is located;

a fifth determining module, configured to select the target object according to the following three selection manners and the priority set in each manner when the number of the moving objects is at least two: selecting an object closest to the terminal as the target object from among at least two moving objects, selecting a moving object with the sound emission direction of the terminal as the target object from among the at least two moving objects, and selecting an object with the front side facing the terminal as the target object from among the at least two moving objects;

the first determining module is used for carrying out living body identification on the target object, if the target object is a living body, the target distance between the terminal and the target object is calculated by using a binocular stereo vision algorithm, and the audio and video comprises at least one of audio and video;

a second determining module, configured to determine a position relationship between the target object and a sound generating direction of the terminal, where the position relationship includes the sound generating direction of the target object facing the terminal and the sound generating direction of the target object facing away from the terminal, and calculate a target volume by using a preset association algorithm according to the position relationship and the target distance, where the preset association algorithm is obtained according to a plurality of pre-recorded sets of position relationships, distances, and corresponding volumes, and a perceived volume corresponding to the target volume is between 60 decibels and 75 decibels;

the first adjusting module is used for adjusting the volume of the audio and video played by the terminal to the target volume;

3. The apparatus of claim 2, wherein the terminal is a speaker.

4. A volume adjustment device, comprising:

the image acquisition module is used for periodically acquiring images in a detectable range of the terminal, wherein the period is a variable period;

the processor is used for comparing the image acquired by the image acquisition module in the current period with the image acquired in the previous period; when an object with a changed position exists in the image acquired in the current period and the image acquired in the previous period, determining that a moving object exists in the detectable range of the terminal, wherein the moving object is the object with the changed position;

the processor is further configured to detect whether a similarity correlation value between the moving object and a reference object of a preset size in an image including the moving object is smaller than a preset correlation value threshold, where the similarity correlation value is negatively correlated with similarity; when the similarity correlation value of the moving object and the reference object is smaller than a preset correlation value threshold value, determining that the moving object is within a preset range where the terminal is located;

the processor is further configured to determine the number of the moving objects when the sensing module detects that the moving objects exist in a preset range where the terminal is located; determining the moving object as the target object when the number of the moving objects is 1; when the number of the moving objects is at least two, selecting the target object according to the following three selection modes and the priority set in each mode: selecting an object closest to the terminal as the target object from among at least two moving objects, selecting a moving object with the sound emission direction of the terminal as the target object from among the at least two moving objects, and selecting an object with the front side facing the terminal as the target object from among the at least two moving objects;

the sensing module is used for carrying out living body identification on the target object, if the target object is a living body, calculating a target distance between the terminal and the target object by using a binocular stereo vision algorithm, wherein the audio and video comprises at least one of audio and video, and the position relation between the target object and the sound production direction of the terminal is determined, wherein the position relation comprises the sound production direction of the target object facing the terminal and the sound production direction of the target object opposite to the terminal;

the processor is configured to receive the target distance sent by the sensing module, calculate a target volume by using a preset association algorithm according to the position relationship and the target distance and according to a plurality of pre-recorded sets of position relationships, distances and corresponding volumes, and obtain a perceived volume corresponding to the target volume between 60 decibels and 75 decibels;

the loudspeaker module is used for playing the audio and video by adopting the target volume according to the instruction of the processor;

and the driving module is used for driving the position and/or direction change of the loudspeaker module so as to adjust the sound production direction of the terminal.