CN111930336A - Volume adjusting method and device of audio device and storage medium - Google Patents
Volume adjusting method and device of audio device and storage medium Download PDFInfo
- Publication number
- CN111930336A CN111930336A CN202010744528.5A CN202010744528A CN111930336A CN 111930336 A CN111930336 A CN 111930336A CN 202010744528 A CN202010744528 A CN 202010744528A CN 111930336 A CN111930336 A CN 111930336A
- Authority
- CN
- China
- Prior art keywords
- volume
- target
- user
- current environment
- model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 56
- 230000006399 behavior Effects 0.000 claims description 65
- 230000005236 sound signal Effects 0.000 claims description 48
- 230000003044 adaptive effect Effects 0.000 claims description 19
- 238000012545 processing Methods 0.000 description 9
- 238000004891 communication Methods 0.000 description 7
- 238000005259 measurement Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000013507 mapping Methods 0.000 description 4
- 238000001514 detection method Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 2
- 230000004807 localization Effects 0.000 description 2
- 238000003062 neural network model Methods 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000000523 sample Substances 0.000 description 2
- 230000003313 weakening effect Effects 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000003708 edge detection Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000003709 image segmentation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Abstract
The invention provides a volume adjusting method, equipment and a storage medium of audio equipment, namely, a current environment image of the current environment of a target user is obtained, and a user behavior parameter and/or a current environment parameter are/is obtained based on the current environment image; and inputting the user behavior parameters and/or the current environment parameters into a first model, determining a first volume corresponding to the current environment of the target user as the target volume, and adjusting the current volume of the target audio equipment to the target volume. According to the method and the device, the behavior parameters and the environment parameters of the target user are determined based on image acquisition, the behavior parameters of the user, the current environment parameters of the user and the volume adjusting model corresponding to the target user, namely the first model are combined, the optimal volume suitable for the target user, namely the target volume, is determined, the volume adjusting precision is improved, the user does not need to wear an electronic tag, and the user experience is improved.
Description
Technical Field
The present invention relates to the field of bluetooth communication technologies, and in particular, to a volume adjustment method and device for an audio device, and a computer-readable storage medium.
Background
With the development of science and technology, smart home devices are becoming more and more popular. The existing volume adjustment method of the intelligent household equipment is volume adjustment based on ultrasonic pulses. The ultra-wideband positioning tag worn by a user is utilized to send out a pulse signal, then the ultrasonic module is arranged in the sound box to receive the pulse signal, so that the distance detection is realized along with the physical characteristic of distance attenuation in the transmission process of the pulse signal, namely, the weaker the pulse signal is detected, the sound of the intelligent household equipment is controlled to be increased, and the automatic adjustment of the volume is realized. However, the current volume adjustment method not only requires a user to wear an electronic tag, which reduces user experience, but also easily causes the weakening of pulse signals when the electric quantity of the electronic tag is insufficient, thereby reducing adjustment accuracy.
Disclosure of Invention
The invention mainly aims to provide a volume adjusting method and device of audio equipment and a computer readable storage medium, and aims to solve the technical problems of low adjusting accuracy and poor user experience of the existing volume adjusting method.
In order to achieve the above object, the present invention provides a volume adjusting method of an audio device, including the steps of:
acquiring a current environment image of a current environment where a target user is located, and acquiring user behavior parameters and/or current environment parameters based on the current environment image;
and inputting the user behavior parameters and/or the current environment parameters into a first model, determining a first volume corresponding to the current environment of the target user as the target volume, and adjusting the current volume of the target audio equipment to the target volume.
Optionally, the step of inputting the user behavior parameter and/or the current environment parameter into a first model, determining a first volume corresponding to the target user in the current environment as the target volume, and adjusting the current volume of the target audio device to the target volume specifically includes:
inputting the user behavior parameters and/or the current environment parameters into a first model, and determining a first volume corresponding to the current environment of the target user;
judging whether a target sound signal of the target user is identified or not;
if the target sound signal is identified, positioning the target user based on a sound source positioning module, determining a target user distance between the target user and the target audio equipment, inputting the target user distance into a second model, and determining a second volume corresponding to the target user;
and according to a preset weight, carrying out weighted average on the first volume and the second volume, determining the target volume, and adjusting the current volume of the target audio equipment to the target volume.
Optionally, after the step of determining whether the target sound signal of the target user is identified, the method further includes:
and if the target sound signal is not identified, taking the first volume as the target volume, and taking the first volume as the target volume.
Optionally, the step of inputting the user behavior parameter and/or the current environment parameter into a first model, determining a first volume corresponding to the target user in the current environment as the target volume, and adjusting the current volume of the target audio device to the target volume specifically includes:
judging whether the target user is a plurality of users;
if the target user is a plurality of users, generating a user behavior parameter set according to user behavior parameters corresponding to the plurality of users;
sequentially acquiring a user behavior parameter in the user behavior parameter set as the target user behavior parameter, respectively inputting the target user behavior parameter to the first model, and determining the adaptive volume of each first user corresponding to the plurality of users;
and according to preset weight, carrying out weighted average on the adaptive volume of each first user, determining the first volume as the target volume, and adjusting the current volume of the target audio equipment to the target volume.
Optionally, if the target sound signal is identified, positioning the target user based on a sound source positioning module, determining a distance between the target user and the target user of the target audio device, inputting the distance between the target user and the second model, and determining a second volume corresponding to the target user specifically includes:
judging whether the target sound signals are sound signals of a plurality of users or not;
if the target sound signal is the sound signals of a plurality of users, positioning the plurality of users based on the sound source positioning module and the sound signals of the plurality of users, determining a plurality of user distances from the plurality of users to the target audio equipment, and generating a user distance set;
sequentially acquiring a user distance in the user distance set as the target user distance, respectively inputting the target user distance to the second model, and determining the adaptive volume of each second user corresponding to the plurality of users;
and carrying out weighted average on the adaptive volumes of the second users according to preset weight to determine the second volume.
Optionally, before the step of inputting the user behavior parameter and/or the current environment parameter into the first model, determining a first volume corresponding to the target user in the current environment as the target volume, and adjusting the current volume of the target audio device to the target volume, the method further includes:
acquiring a target face image of the target user, and judging whether a volume adjusting model corresponding to the target face image exists in a database;
and if a volume adjustment model corresponding to the target face image exists, taking the volume adjustment model as the first model.
Optionally, after the step of obtaining the target face image of the target user and determining whether a volume adjustment model corresponding to the target face image exists in a database, the method further includes:
and if the volume adjustment model corresponding to the target face image does not exist, acquiring a general volume adjustment model, and taking the general volume adjustment model as the first model.
Optionally, the step of obtaining the current environment image of the current environment in which the target user is located specifically includes:
acquiring current environment brightness, and judging whether the current environment brightness reaches a preset brightness threshold value;
if the current environment brightness reaches the brightness threshold, acquiring the current environment image through a visible light camera;
and if the current environment brightness does not reach the brightness threshold value, acquiring the current environment image through an infrared camera.
In addition, to achieve the above object, the present invention further provides a volume adjustment device of an audio device, the volume adjustment device of the audio device includes a processor, a memory, and a volume adjustment program of the audio device stored on the memory and executable by the processor, wherein when the volume adjustment program of the audio device is executed by the processor, the steps of the volume adjustment method of the audio device as described above are implemented.
In addition, to achieve the above object, the present invention also provides a computer readable storage medium having a volume adjustment program of an audio device stored thereon, wherein the volume adjustment program of the audio device, when executed by a processor, implements the steps of the volume adjustment method of the audio device as described above.
The invention provides a volume adjusting method of audio equipment, which comprises the steps of obtaining a current environment image of a current environment where a target user is located, and obtaining user behavior parameters and/or current environment parameters based on the current environment image; and inputting the user behavior parameters and/or the current environment parameters into a first model, determining a first volume corresponding to the current environment of the target user as the target volume, and adjusting the current volume of the target audio equipment to the target volume. Through the mode, the behavior parameters and the environment parameters of the target user are determined based on image acquisition, the behavior parameters of the user, the current environment parameters of the user and the volume adjusting model corresponding to the target user, namely the first model are combined, the optimal volume suitable for the target user, namely the target volume is determined, the volume adjusting precision is improved, the user does not need to wear an electronic tag, the user experience is improved, and the technical problems that the adjusting precision of the existing volume adjusting method is low and the user experience is poor are solved.
Drawings
Fig. 1 is a schematic diagram of a hardware structure of a volume adjustment device of an audio device according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a method for adjusting the volume of an audio device according to a first embodiment of the present invention;
fig. 3 is a functional block diagram of a volume adjustment apparatus of an audio device according to a first embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The volume adjusting method of the audio equipment related to the embodiment of the invention is mainly applied to the volume adjusting equipment of the audio equipment, and the volume adjusting equipment of the audio equipment can be equipment with display and processing functions, such as a PC (personal computer), a portable computer, a mobile terminal and the like.
Referring to fig. 1, fig. 1 is a schematic diagram of a hardware structure of a volume adjustment device of an audio device according to an embodiment of the present invention. In this embodiment of the present invention, the volume adjustment device of the audio device may include a processor 1001 (e.g., a CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. The communication bus 1002 is used for realizing connection communication among the components; the user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard); the network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface); the memory 1005 may be a high-speed RAM memory, or may be a non-volatile memory (e.g., a magnetic disk memory), and optionally, the memory 1005 may be a storage device independent of the processor 1001.
Those skilled in the art will appreciate that the hardware configuration shown in fig. 1 does not constitute a limitation of the volume adjustment device of the audio device, and may include more or fewer components than those shown, or some components in combination, or a different arrangement of components.
With continued reference to fig. 1, a memory 1005 of fig. 1, which is one type of computer-readable storage medium, may include an operating system, a network communication module, and a volume adjustment program of an audio device.
In fig. 1, the network communication module is mainly used for connecting to a server and performing data communication with the server; and the processor 1001 may call a volume adjustment program of the audio device stored in the memory 1005 and perform a volume adjustment method of the audio device provided by the embodiment of the present invention.
The embodiment of the invention provides a volume adjusting method of audio equipment.
Referring to fig. 2, fig. 2 is a flowchart illustrating a method for adjusting the volume of an audio device according to a first embodiment of the present invention.
In this embodiment, the volume adjustment method of the audio device includes the following steps:
step S10, acquiring a current environment image of the current environment where the target user is located, and acquiring user behavior parameters and/or current environment parameters based on the current environment image;
the existing volume adjusting method is that an ultra-wideband positioning label worn by a user is used for sending a pulse signal, then an ultrasonic module is arranged in a sound box for receiving the pulse signal, and therefore distance detection is achieved by using the physical characteristic that the pulse signal attenuates along with the distance in the transmission process, namely the weaker pulse signal is detected, the sound of the intelligent household equipment is controlled to increase, and automatic adjustment of the volume is achieved. However, the volume adjustment method not only requires the user to wear the electronic tag, which reduces the user experience, but also easily causes the weakening of the pulse signal when the electric quantity of the electronic tag is insufficient, which reduces the adjustment accuracy. In order to solve the above problems, in this embodiment, behavior parameters and environment parameters of a target user are determined based on image acquisition, and the behavior parameters of the user, current environment parameters where the user is located, and a volume adjustment model corresponding to the target user, that is, a first model, are combined to determine an optimal volume suitable for the target user, that is, a target volume, so that not only is the volume adjustment precision improved, but also the user does not need to wear an electronic tag, and the user experience is improved. Specifically, a current environment image of a current environment where the target user is located is acquired through an image acquisition module, and the image acquisition module comprises an infrared receiver and/or a visible light camera. The current environment image is a user image and an area environment image where a target user is located, user behavior parameters such as different behavior states of calling, playing games, video chatting and the like are determined according to the user image, and current environment parameters such as multi-scene environment states of bedrooms, dance halls, carriages and the like are determined according to the area environment image.
Step S20, inputting the user behavior parameters and/or the current environment parameters into a first model, determining a first volume corresponding to the target user in the current environment as the target volume, and adjusting the current volume of the target audio device to the target volume.
In this embodiment, the user behavior parameters and/or the current environment parameters are input into a corresponding volume adjustment model, that is, a first model, and the volume output by the first model based on the user behavior parameters and/or the current environment parameters is obtained and used as the current optimal volume matched with the current state of the target user, that is, the target volume. The current volume of the audio device is then adjusted based on the target volume. In a specific embodiment, for convenience of calculation, mapping values corresponding to the user behavior parameters and the current environment parameters are set, for example, the telephone behavior is set to 1, and the game playing behavior is set to 2. When the user behavior parameter and the current environment parameter are selected as the model parameters, the first model can be a preset mapping model; when the user behavior parameters and the current environment parameters are simultaneously selected as model parameters, the first model can be a preset mapping model or a neural network model, and when the first model is a neural network, the model is trained by acquiring the behavior parameters and the related environment data in advance.
The embodiment provides a volume adjustment method of audio equipment, which includes acquiring a current environment image of a current environment where a target user is located, and acquiring a user behavior parameter and/or a current environment parameter based on the current environment image; and inputting the user behavior parameters and/or the current environment parameters into a first model, determining a first volume corresponding to the current environment of the target user as the target volume, and adjusting the current volume of the target audio equipment to the target volume. Through the mode, the behavior parameters and the environment parameters of the target user are determined based on image acquisition, the behavior parameters of the user, the current environment parameters of the user and the volume adjusting model corresponding to the target user, namely the first model are combined, the optimal volume suitable for the target user, namely the target volume is determined, the volume adjusting precision is improved, the user does not need to wear an electronic tag, the user experience is improved, and the technical problems that the adjusting precision of the existing volume adjusting method is low and the user experience is poor are solved.
Referring to fig. 3, fig. 3 is a functional block diagram of a volume adjustment device of an audio device according to a first embodiment of the present invention.
Based on the foregoing embodiment shown in fig. 2, in this embodiment, the step S20 specifically includes:
inputting the user behavior parameters and/or the current environment parameters into a first model, and determining a first volume corresponding to the current environment of the target user;
judging whether a target sound signal of the target user is identified or not;
if the target sound signal is identified, positioning the target user based on a sound source positioning module, determining a target user distance between the target user and the target audio equipment, inputting the target user distance into a second model, and determining a second volume corresponding to the target user;
and according to a preset weight, carrying out weighted average on the first volume and the second volume, determining the target volume, and adjusting the current volume of the target audio equipment to the target volume.
And if the target sound signal is not identified, taking the first volume as the target volume, and taking the first volume as the target volume.
In this embodiment, if the voice of the user is not recognized (i.e., the voice of the user is not recognized or the voice of the user is recognized to be too small), the first volume is used as the target volume to adjust the volume of the audio device; if the voice of the user is recognized, the distance between the user and the audio equipment is obtained through positioning by the sound source, then the distance data is input into the second model to obtain the second volume, then the first volume and the second volume are weighted by the preset weight value to be used as the target volume, and the volume is adjusted. The second model may be a preset mapping model or a neural network model. Specifically, the volume adjusting method of the audio equipment is applied to a volume adjusting device of the audio equipment, and the volume adjusting device comprises a data processing module, a sound source positioning module, an image acquisition module, an environment data processing module and a volume control output module. The sound source positioning module acquires a target sound signal of a target user, wherein the target user is a user within a preset distance from the audio equipment, and the number of the target users can be one, two or more. The sound source positioning module can be a sound intensity probe, a sound wave particle vibration velocity scanning probe, a sound array or a microphone array. In this embodiment, a microphone array will be described as an example. In a specific embodiment, the sound source localization module may also adopt other manners. The microphone array is an array formed by arranging a group of omnidirectional microphones at different spatial positions according to a certain shape rule, is a device for carrying out spatial sampling on spatially propagated sound signals, and can determine spatial position information of the spatially propagated sound signals through the collected sound signals. For example, the microphone array may be a planar array. For example a circular microphone array of 6 microphones. A microphone array of an audio device may be used to acquire a target sound signal of a target user. In a specific embodiment, based on the voice recognition function of the microphone array, the sound source direction of the sound signal can be positioned, and the audio device itself or other internet of things devices can be controlled to execute various commands expected by the user. Specifically, the distance between the target user and the target user of the audio device is calculated based on the Time Difference of Arrival (TDOA), the Arrival distance of the sound source, and the mic signal strength in the sound signal, that is, the position of the sound source is determined by the strength and Time of the sound source reaching different distances mic, so as to achieve the purpose of positioning and ranging. Wherein, the preset sound source positioning detection conditions are as follows: whether there is a shelter or other object between the target user and the audio device that affects the sound signal measurement of the sound source localization module. After determining that no shelter or other objects influencing sound signal measurement of a sound source positioning module exist between the target user and the audio equipment based on the current environment image, calculating the distance between the target user and the audio equipment based on time arrival difference, sound source arrival distance and mic signal strength in sound signals, namely determining the position of the sound source as the current position of the target user by the fact that the sound source arrives at different distances, mic strength and time are different. The image recognition process comprises the following steps: and preprocessing the current environment image, extracting image characteristics corresponding to the preprocessed current environment image, identifying the current environment image according to the image characteristics, and determining the current environment state parameters. The image processing and feature extraction can be realized based on technologies such as fuzzy algorithm, edge detection, image segmentation and convolutional neural network, and after the features are extracted, the features are matched with state scene data stored in a cloud end to identify current environment state parameters in the current environment image. Such as different behavior states of calling, playing games, video chatting and the like, such as multi-scene environment states of bedrooms, dance halls, carriages and the like. In more embodiments, in order to further improve user experience, a volume difference value between the current optimal volume and the current volume is obtained, preset adjusting time is determined, and an average adjusting rate is determined according to the volume difference value and the adjusting time. And adjusting the current volume of the audio equipment to the current optimal volume according to the average adjusting speed within the adjusting time. At present, based on infrared distance measurement and comparing volume comparison tables set by different internal distances, set volume is output, namely a volume adjustment mode of changing the volume once at one level is achieved, and the scheme can solve the problem that misjudgment is caused due to the fact that infrared rays are influenced by environmental factors such as sunlight and the like; the problems that the infrared distance measurement direction is single and the measurement is limited can be solved; still further solved the step tuning and made the audio frequency have obvious pause and frustrate and felt, reduced user experience's problem. Therefore, the image acquisition module is connected with the data processing module, the acquisition module acquires the current environment image and identifies the position and the user state of the user in the environment, the mic array module is connected with the environment data processing module and is responsible for collecting environment sound and the sound of the user, the data are transmitted to the processor, positioning is carried out according to an algorithm, and the environment sound and the sound of different users are identified to assist the image identification user. And the data processing module calculates the position of the user according to the acquisition result, judges the distance according to image identification and judges the states of the user and the environment. The data processing module is connected with the control module, after a series of data acquisition and processing, the system provides a proper phase output volume signal, and the proper volume is output by the power amplification unit through the control module. Therefore, the target volume is determined based on image recognition and voice recognition, the volume adjustment precision is further improved, and the user experience is improved.
Further, the step S20 specifically includes:
judging whether the target user is a plurality of users;
if the target user is a plurality of users, generating a user behavior parameter set according to user behavior parameters corresponding to the plurality of users;
sequentially acquiring a user behavior parameter in the user behavior parameter set as the target user behavior parameter, respectively inputting the target user behavior parameter to the first model, and determining the adaptive volume of each first user corresponding to the plurality of users;
and according to preset weight, carrying out weighted average on the adaptive volume of each first user, determining the first volume as the target volume, and adjusting the current volume of the target audio equipment to the target volume.
In this embodiment, when multiple users exist, that is, multiple user behavior parameters are acquired, user adaptive volumes corresponding to the multiple user behavior parameters may be respectively calculated as first user adaptive volumes, and then, the first user adaptive volumes are weighted by a preset weight or calculated on average to determine the first volume.
Further, if the target sound signal is identified, the step of locating the target user based on a sound source locating module, determining a distance between the target user and the target user of the target audio device, inputting the distance between the target user and the target user into a second model, and determining a second volume corresponding to the target user specifically includes:
judging whether the target sound signals are sound signals of a plurality of users or not;
if the target sound signal is the sound signals of a plurality of users, positioning the plurality of users based on the sound source positioning module and the sound signals of the plurality of users, determining a plurality of user distances from the plurality of users to the target audio equipment, and generating a user distance set;
sequentially acquiring a user distance in the user distance set as the target user distance, respectively inputting the target user distance to the second model, and determining the adaptive volume of each second user corresponding to the plurality of users;
and carrying out weighted average on the adaptive volumes of the second users according to preset weight to determine the second volume.
In this embodiment, if there are multiple users and the sound signals corresponding to the multiple users are identified, in order to solve the problem of volume adjustment of the audio device under the condition of multiple users, multiple user distances corresponding to the multiple users are obtained, and a related user distance set is generated; sequentially acquiring a user distance in the relevant user distance set as a current user distance, and inputting the current user distance and the current environment state parameter into the volume adjustment model to obtain a relevant optimal volume set corresponding to the relevant user distance set; and determining the current optimal volume according to a preset weighting weight, the related user distance set and the related optimal volume set, and adjusting the current volume of the audio equipment based on the current optimal volume. When the target user is detected to be not unique, respectively determining the optimal volume corresponding to each user according to the user distance of each user and the corresponding environment state parameter. And then determining the weighting weight of the optimal volume corresponding to each user according to the distance between the user and the audio equipment, and determining the optimal volume suitable for a plurality of users as the current optimal volume according to each weighting weight and the optimal volume corresponding to each user. Therefore, the volume can be automatically adjusted when multiple users are in use, and the phenomenon that the volume is large or small when one person is very close to or very far away from the other person is avoided.
Further, before the step S20, the method further includes:
acquiring a target face image of the target user, and judging whether a volume adjusting model corresponding to the target face image exists in a database;
and if a volume adjustment model corresponding to the target face image exists, taking the volume adjustment model as the first model.
And if the volume adjustment model corresponding to the target face image does not exist, acquiring a general volume adjustment model, and taking the general volume adjustment model as the first model.
In this embodiment, in order to improve user experience, the current optimal volume suitable for the target user is determined based on a volume adjustment model that records user habit data. And storing the volume adjustment models corresponding to the users in a cloud or other servers, and then determining the corresponding volume adjustment models in a model library based on the face images of the users. And if the model corresponding to the target user does not exist, acquiring the general model from the database of the server as the first model, and adjusting the volume through the general model. In further embodiments, the above method is also applicable to the determination of the second model.
Further, the step of obtaining the current environment image of the current environment in which the target user is located specifically includes:
acquiring current environment brightness, and judging whether the current environment brightness reaches a preset brightness threshold value;
if the current environment brightness reaches the brightness threshold, acquiring the current environment image through a visible light camera;
and if the current environment brightness does not reach the brightness threshold value, acquiring the current environment image through an infrared camera.
In this embodiment, the accuracy of distance judgment is improved by combining the microphone array and the infrared receiver with the camera. Specifically, the current ambient brightness is obtained, and whether the current ambient brightness reaches a preset brightness threshold value is judged. And if the current environment brightness reaches the brightness threshold value, acquiring a current environment image of the target user through a visible light camera. And if the current environment brightness does not reach the brightness threshold value, acquiring the current environment image of the target user through an infrared receiver. Namely, when the light is good, the camera works to obtain the current environment image. When the light is dark, the infrared receiving module works to obtain the current environment image.
In addition, the embodiment of the invention also provides a volume adjusting device of the audio equipment.
In this embodiment, the volume adjusting device of the audio device includes:
the parameter acquisition module is used for acquiring a current environment image of a current environment where a target user is located and acquiring user behavior parameters and/or current environment parameters based on the current environment image;
and the volume adjusting module is used for inputting the user behavior parameters and/or the current environment parameters into a first model, determining a first volume corresponding to the current environment of the target user as the target volume, and adjusting the current volume of the target audio equipment to the target volume.
Further, the volume adjustment module is further configured to:
inputting the user behavior parameters and/or the current environment parameters into a first model, and determining a first volume corresponding to the current environment of the target user;
judging whether a target sound signal of the target user is identified or not;
if the target sound signal is identified, positioning the target user based on a sound source positioning module, determining a target user distance between the target user and the target audio equipment, inputting the target user distance into a second model, and determining a second volume corresponding to the target user;
and according to a preset weight, carrying out weighted average on the first volume and the second volume, determining the target volume, and adjusting the current volume of the target audio equipment to the target volume.
Further, the volume adjustment module is further configured to:
and if the target sound signal is not identified, taking the first volume as the target volume, and taking the first volume as the target volume.
Further, the volume adjustment module is further configured to:
judging whether the target user is a plurality of users;
if the target user is a plurality of users, generating a user behavior parameter set according to user behavior parameters corresponding to the plurality of users;
sequentially acquiring a user behavior parameter in the user behavior parameter set as the target user behavior parameter, respectively inputting the target user behavior parameter to the first model, and determining the adaptive volume of each first user corresponding to the plurality of users;
and according to preset weight, carrying out weighted average on the adaptive volume of each first user, determining the first volume as the target volume, and adjusting the current volume of the target audio equipment to the target volume.
Further, the volume adjustment module is further configured to:
judging whether the target sound signals are sound signals of a plurality of users or not;
if the target sound signal is the sound signals of a plurality of users, positioning the plurality of users based on the sound source positioning module and the sound signals of the plurality of users, determining a plurality of user distances from the plurality of users to the target audio equipment, and generating a user distance set;
sequentially acquiring a user distance in the user distance set as the target user distance, respectively inputting the target user distance to the second model, and determining the adaptive volume of each second user corresponding to the plurality of users;
and carrying out weighted average on the adaptive volumes of the second users according to preset weight to determine the second volume.
Further, the volume adjusting apparatus of the audio device further includes a model determining module, and the model determining module is further configured to:
acquiring a target face image of the target user, and judging whether a volume adjusting model corresponding to the target face image exists in a database;
and if a volume adjustment model corresponding to the target face image exists, taking the volume adjustment model as the first model.
And if the volume adjustment model corresponding to the target face image does not exist, acquiring a general volume adjustment model, and taking the general volume adjustment model as the first model.
Further, the parameter acquisition module is further configured to:
acquiring current environment brightness, and judging whether the current environment brightness reaches a preset brightness threshold value;
if the current environment brightness reaches the brightness threshold, acquiring the current environment image through a visible light camera;
and if the current environment brightness does not reach the brightness threshold value, acquiring the current environment image through an infrared camera.
Each module in the volume adjusting device of the audio device corresponds to each step in the volume adjusting method embodiment of the audio device, and the functions and implementation processes thereof are not described in detail herein.
In addition, the embodiment of the invention also provides a computer readable storage medium.
The computer readable storage medium of the present invention stores a volume adjustment program of an audio device, wherein the volume adjustment program of the audio device, when executed by a processor, implements the steps of the volume adjustment method of the audio device as described above.
The method for implementing the volume adjustment program of the audio device when executed may refer to the embodiments of the volume adjustment method of the audio device of the present invention, and will not be described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A volume adjusting method of an audio device is characterized by comprising the following steps:
acquiring a current environment image of a current environment where a target user is located, and acquiring user behavior parameters and/or current environment parameters based on the current environment image;
and inputting the user behavior parameters and/or the current environment parameters into a first model, determining a first volume corresponding to the current environment of the target user as the target volume, and adjusting the current volume of the target audio equipment to the target volume.
2. The method for adjusting the volume of an audio device according to claim 1, wherein the step of inputting the user behavior parameters and/or the current environment parameters into a first model, determining a first volume corresponding to the target user in the current environment as the target volume, and adjusting the current volume of the target audio device to the target volume specifically comprises:
inputting the user behavior parameters and/or the current environment parameters into a first model, and determining a first volume corresponding to the current environment of the target user;
judging whether a target sound signal of the target user is identified or not;
if the target sound signal is identified, positioning the target user based on a sound source positioning module, determining a target user distance between the target user and the target audio equipment, inputting the target user distance into a second model, and determining a second volume corresponding to the target user;
and according to a preset weight, carrying out weighted average on the first volume and the second volume, determining the target volume, and adjusting the current volume of the target audio equipment to the target volume.
3. The method for adjusting the volume of an audio device according to claim 1, wherein the step of determining whether the target sound signal of the target user is recognized further comprises:
and if the target sound signal is not identified, taking the first volume as the target volume, and taking the first volume as the target volume.
4. The method for adjusting the volume of an audio device according to claim 2, wherein the step of inputting the user behavior parameters and/or the current environment parameters into a first model, determining a first volume corresponding to the target user in the current environment as the target volume, and adjusting the current volume of the target audio device to the target volume specifically comprises:
judging whether the target user is a plurality of users;
if the target user is a plurality of users, generating a user behavior parameter set according to user behavior parameters corresponding to the plurality of users;
sequentially acquiring a user behavior parameter in the user behavior parameter set as the target user behavior parameter, respectively inputting the target user behavior parameter to the first model, and determining the adaptive volume of each first user corresponding to the plurality of users;
and according to preset weight, carrying out weighted average on the adaptive volume of each first user, determining the first volume as the target volume, and adjusting the current volume of the target audio equipment to the target volume.
5. The method for adjusting the volume of an audio device according to claim 4, wherein if the target sound signal is identified, the step of locating the target user based on a sound source location module, determining a distance between the target user and the target user of the target audio device, inputting the distance between the target user and the target user into a second model, and determining a second volume corresponding to the target user specifically comprises:
judging whether the target sound signals are sound signals of a plurality of users or not;
if the target sound signal is the sound signals of a plurality of users, positioning the plurality of users based on the sound source positioning module and the sound signals of the plurality of users, determining a plurality of user distances from the plurality of users to the target audio equipment, and generating a user distance set;
sequentially acquiring a user distance in the user distance set as the target user distance, respectively inputting the target user distance to the second model, and determining the adaptive volume of each second user corresponding to the plurality of users;
and carrying out weighted average on the adaptive volumes of the second users according to preset weight to determine the second volume.
6. The method for adjusting the volume of an audio device according to claim 1, wherein the step of inputting the user behavior parameters and/or the current environment parameters into the first model, determining the first volume corresponding to the target user in the current environment as the target volume, and adjusting the current volume of the target audio device to the target volume further comprises:
acquiring a target face image of the target user, and judging whether a volume adjusting model corresponding to the target face image exists in a database;
and if a volume adjustment model corresponding to the target face image exists, taking the volume adjustment model as the first model.
7. The method for adjusting the volume of an audio device according to claim 6, wherein after the step of obtaining the target face image of the target user and determining whether the volume adjustment model corresponding to the target face image exists in the database, the method further comprises:
and if the volume adjustment model corresponding to the target face image does not exist, acquiring a general volume adjustment model, and taking the general volume adjustment model as the first model.
8. The method for adjusting the volume of an audio device according to any one of claims 1 to 7, wherein the step of obtaining the current environment image of the current environment where the target user is located specifically includes:
acquiring current environment brightness, and judging whether the current environment brightness reaches a preset brightness threshold value;
if the current environment brightness reaches the brightness threshold, acquiring the current environment image through a visible light camera;
and if the current environment brightness does not reach the brightness threshold value, acquiring the current environment image through an infrared camera.
9. A volume adjustment device of an audio device, characterized in that the volume adjustment device of the audio device comprises a processor, a memory, and a volume adjustment program of the audio device stored on the memory and executable by the processor, wherein the volume adjustment program of the audio device, when executed by the processor, implements the steps of the volume adjustment method of the audio device according to any one of claims 1 to 8.
10. A computer-readable storage medium, having stored thereon a volume adjustment program for an audio device, wherein the volume adjustment program for an audio device, when executed by a processor, implements the steps of the volume adjustment method for an audio device according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010744528.5A CN111930336A (en) | 2020-07-29 | 2020-07-29 | Volume adjusting method and device of audio device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010744528.5A CN111930336A (en) | 2020-07-29 | 2020-07-29 | Volume adjusting method and device of audio device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111930336A true CN111930336A (en) | 2020-11-13 |
Family
ID=73314824
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010744528.5A Pending CN111930336A (en) | 2020-07-29 | 2020-07-29 | Volume adjusting method and device of audio device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111930336A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112631542A (en) * | 2020-12-21 | 2021-04-09 | 深圳酷派技术有限公司 | Audio adjusting method and device, storage medium and electronic equipment |
| CN112732218A (en) * | 2021-01-31 | 2021-04-30 | 云知声智能科技股份有限公司 | Automatic device volume adjusting method and device and electronic device |
| CN113179439A (en) * | 2021-04-19 | 2021-07-27 | 广州欢网科技有限责任公司 | Smart television volume control method and system |
| CN114738960A (en) * | 2022-04-20 | 2022-07-12 | 安徽奥克斯智能电气有限公司 | Sound control method and device and air conditioner |
| CN116208700A (en) * | 2023-04-25 | 2023-06-02 | 深圳市华卓智能科技有限公司 | Control method and system for communication between mobile phone and audio equipment |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140112498A1 (en) * | 2012-10-23 | 2014-04-24 | Huawei Device Co., Ltd. | Method and implementation apparatus for intelligently controlling volume of electronic device |
| CN105872770A (en) * | 2016-04-29 | 2016-08-17 | 钱涵翀 | Sound volume adjusting method and system |
| CN106375590A (en) * | 2016-09-28 | 2017-02-01 | 珠海格力电器股份有限公司 | Volume adjustment method and device for smart terminal |
| CN107329729A (en) * | 2017-06-26 | 2017-11-07 | 深圳市泰衡诺科技有限公司 | Volume adjusting method, volume adjustment device and terminal |
| CN107562403A (en) * | 2017-08-09 | 2018-01-09 | 深圳市汉普电子技术开发有限公司 | A kind of volume adjusting method, smart machine and storage medium |
| CN107613383A (en) * | 2017-09-11 | 2018-01-19 | 广东欧珀移动通信有限公司 | Video volume adjusting method, device and electronic installation |
| CN108391162A (en) * | 2018-01-31 | 2018-08-10 | 科大讯飞股份有限公司 | Method for regulation of sound volume and device, storage medium, electronic equipment |
| CN108628572A (en) * | 2018-04-10 | 2018-10-09 | 平安科技（深圳）有限公司 | Robot adjusts method, apparatus, computer equipment and the storage medium of volume |
| CN109471608A (en) * | 2018-10-31 | 2019-03-15 | 北京羽扇智信息科技有限公司 | A kind of method of adjustment and device of volume |
| CN109495649A (en) * | 2018-12-14 | 2019-03-19 | 深圳市沃特沃德股份有限公司 | Volume adjusting method, system and storage medium |
| CN110392298A (en) * | 2018-04-23 | 2019-10-29 | 腾讯科技（深圳）有限公司 | A kind of volume adjusting method, device, equipment and medium |
| CN110413239A (en) * | 2018-04-28 | 2019-11-05 | 腾讯科技（深圳）有限公司 | Parameter adjusting method, device and storage medium is arranged in terminal |
| CN111260864A (en) * | 2018-11-30 | 2020-06-09 | 珠海格力电器股份有限公司 | Voice broadcast control method and device and air conditioner |
-
2020
- 2020-07-29 CN CN202010744528.5A patent/CN111930336A/en active Pending
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140112498A1 (en) * | 2012-10-23 | 2014-04-24 | Huawei Device Co., Ltd. | Method and implementation apparatus for intelligently controlling volume of electronic device |
| CN105872770A (en) * | 2016-04-29 | 2016-08-17 | 钱涵翀 | Sound volume adjusting method and system |
| WO2018058899A1 (en) * | 2016-09-28 | 2018-04-05 | 珠海格力电器股份有限公司 | Sound volume adjusting method and apparatus of intelligent terminal |
| CN106375590A (en) * | 2016-09-28 | 2017-02-01 | 珠海格力电器股份有限公司 | Volume adjustment method and device for smart terminal |
| CN107329729A (en) * | 2017-06-26 | 2017-11-07 | 深圳市泰衡诺科技有限公司 | Volume adjusting method, volume adjustment device and terminal |
| CN107562403A (en) * | 2017-08-09 | 2018-01-09 | 深圳市汉普电子技术开发有限公司 | A kind of volume adjusting method, smart machine and storage medium |
| CN107613383A (en) * | 2017-09-11 | 2018-01-19 | 广东欧珀移动通信有限公司 | Video volume adjusting method, device and electronic installation |
| CN108391162A (en) * | 2018-01-31 | 2018-08-10 | 科大讯飞股份有限公司 | Method for regulation of sound volume and device, storage medium, electronic equipment |
| CN108628572A (en) * | 2018-04-10 | 2018-10-09 | 平安科技（深圳）有限公司 | Robot adjusts method, apparatus, computer equipment and the storage medium of volume |
| WO2019196312A1 (en) * | 2018-04-10 | 2019-10-17 | 平安科技（深圳）有限公司 | Method and apparatus for adjusting sound volume by robot, computer device and storage medium |
| CN110392298A (en) * | 2018-04-23 | 2019-10-29 | 腾讯科技（深圳）有限公司 | A kind of volume adjusting method, device, equipment and medium |
| CN110413239A (en) * | 2018-04-28 | 2019-11-05 | 腾讯科技（深圳）有限公司 | Parameter adjusting method, device and storage medium is arranged in terminal |
| CN109471608A (en) * | 2018-10-31 | 2019-03-15 | 北京羽扇智信息科技有限公司 | A kind of method of adjustment and device of volume |
| CN111260864A (en) * | 2018-11-30 | 2020-06-09 | 珠海格力电器股份有限公司 | Voice broadcast control method and device and air conditioner |
| CN109495649A (en) * | 2018-12-14 | 2019-03-19 | 深圳市沃特沃德股份有限公司 | Volume adjusting method, system and storage medium |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112631542A (en) * | 2020-12-21 | 2021-04-09 | 深圳酷派技术有限公司 | Audio adjusting method and device, storage medium and electronic equipment |
| CN112732218A (en) * | 2021-01-31 | 2021-04-30 | 云知声智能科技股份有限公司 | Automatic device volume adjusting method and device and electronic device |
| CN113179439A (en) * | 2021-04-19 | 2021-07-27 | 广州欢网科技有限责任公司 | Smart television volume control method and system |
| CN113179439B (en) * | 2021-04-19 | 2022-07-08 | 广州欢网科技有限责任公司 | Smart television volume control method and system |
| CN114738960A (en) * | 2022-04-20 | 2022-07-12 | 安徽奥克斯智能电气有限公司 | Sound control method and device and air conditioner |
| CN114738960B (en) * | 2022-04-20 | 2023-08-11 | 安徽奥克斯智能电气有限公司 | Sound control method and device and air conditioner |
| CN116208700A (en) * | 2023-04-25 | 2023-06-02 | 深圳市华卓智能科技有限公司 | Control method and system for communication between mobile phone and audio equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111930336A (en) | Volume adjusting method and device of audio device and storage medium | |
| CN109558512B (en) | Audio-based personalized recommendation method and device and mobile terminal | |
| CN110515085B (en) | Ultrasonic processing method, ultrasonic processing device, electronic device, and computer-readable medium | |
| CN109871896A (en) | Data classification method, device, electronic equipment and storage medium | |
| CN109040641B (en) | Video data synthesis method and device | |
| CN109284081B (en) | Audio output method and device and audio equipment | |
| CN111368811B (en) | Living body detection method, living body detection device, living body detection equipment and storage medium | |
| CN109495616B (en) | Photographing method and terminal equipment | |
| CN108683850B (en) | Shooting prompting method and mobile terminal | |
| CN110837758B (en) | Keyword input method and device and electronic equipment | |
| CN108881544B (en) | Photographing method and mobile terminal | |
| CN107784298B (en) | Identification method and device | |
| CN107450882B (en) | Method and device for adjusting sound loudness and storage medium | |
| CN110188179B (en) | Voice directional recognition interaction method, device, equipment and medium | |
| CN109472825B (en) | Object searching method and terminal equipment | |
| CN112735388B (en) | Network model training method, voice recognition processing method and related equipment | |
| CN110572600A (en) | video processing method and electronic equipment | |
| CN110728993A (en) | Voice change identification method and electronic equipment | |
| CN114299546A (en) | Method and device for identifying pet identity, storage medium and electronic equipment | |
| CN110517702A (en) | The method of signal generation, audio recognition method and device based on artificial intelligence | |
| CN111766303B (en) | Voice acquisition method, device, equipment and medium based on acoustic environment evaluation | |
| CN113709629A (en) | Frequency response parameter adjusting method, device, equipment and storage medium | |
| CN114022896A (en) | Target detection method and device, electronic equipment and readable storage medium | |
| CN110827834B (en) | Voiceprint registration method, system and computer readable storage medium | |
| CN115048951A (en) | Millimeter wave radar-based gesture recognition method and device and terminal equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |