CN112712817B - Sound filtering method, mobile device and computer readable storage medium - Google Patents
Sound filtering method, mobile device and computer readable storage medium Download PDFInfo
- Publication number
- CN112712817B CN112712817B CN202011546935.1A CN202011546935A CN112712817B CN 112712817 B CN112712817 B CN 112712817B CN 202011546935 A CN202011546935 A CN 202011546935A CN 112712817 B CN112712817 B CN 112712817B
- Authority
- CN
- China
- Prior art keywords
- sound
- camera
- visual range
- filtering
- outside
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000001914 filtration Methods 0.000 title claims abstract description 103
- 238000000034 method Methods 0.000 title claims abstract description 53
- 230000000007 visual effect Effects 0.000 claims abstract description 225
- 230000008569 process Effects 0.000 description 3
- 210000005069 ears Anatomy 0.000 description 2
- 230000030279 gene silencing Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000004590 computer program Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Quality & Reliability (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Computational Linguistics (AREA)
- Studio Devices (AREA)
- Telephone Function (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The invention discloses a sound filtering method, mobile equipment and a computer readable storage medium, wherein the method comprises the following steps: the method comprises the steps that mobile equipment receives a selection instruction of a user and determines a sound collection mode currently selected by a camera of the mobile equipment; when the sound collection mode is a sound filtering mode outside the visual range of the camera, collecting sound in the visual range of the camera; and when the sound collection mode is a sound filtering mode in the visual range of the camera, collecting the sound outside the visual range of the camera. According to the invention, according to the actual demands of users, only the sound in the visual range of the camera or the sound outside the visual range of the camera can be acquired, so that the noise which is not required to be acquired is effectively removed, the quality of video recording is improved, and more choices and convenience are brought to the users.
Description
Technical Field
The present invention relates to the field of sound processing technologies, and in particular, to a sound filtering method, a mobile device, and a computer readable storage medium.
Background
With the continuous improvement of the hardware functions and performances of mobile devices, it is very simple and common to take pictures and record videos by using mobile devices at present, and even some mobile phone manufacturers play out image-level pictures, i.e. the videos shot by the mobile phones can meet the requirement of a movie level.
However, when the existing mobile device records video, the noise processing cannot perform special processing according to different scenes, such as filtering processing of sound outside the visual range of the camera, or conversely filtering sound within the visual range of the camera, that is, the unwanted sound cannot be filtered, and noise is not required by the user in some scenes.
Accordingly, the prior art is still in need of improvement and development.
Disclosure of Invention
The invention mainly aims to provide a sound filtering method, mobile equipment and a computer readable storage medium, and aims to solve the problem that noise in a specific range or noise outside the specific range cannot be removed according to different scenes in the prior art.
In order to achieve the above object, the present invention provides a sound filtering method comprising the steps of:
the method comprises the steps that mobile equipment receives a selection instruction of a user and determines a sound collection mode currently selected by a camera of the mobile equipment;
when the sound collection mode is a sound filtering mode outside the visual range of the camera, collecting sound in the visual range of the camera;
and when the sound collection mode is a sound filtering mode in the visual range of the camera, collecting the sound outside the visual range of the camera.
Optionally, the sound filtering method, wherein the sound collection mode includes: a camera visual range outside sound filtering mode, a camera visual range inside sound filtering mode and a normal mode without filtering at all;
the sound filtering mode outside the visual range of the camera is to only collect the sound in the visual range of the camera;
the sound filtering mode in the visual range of the camera is to only collect the sound outside the visual range of the camera;
the normal mode without filtering is to collect all the sounds in the environment normally without any sound filtering.
Optionally, in the sound filtering method, when the sound collection mode is a sound filtering mode outside the visual range of the camera, collecting sound in the visual range of the camera specifically includes:
when the mobile equipment starts a camera to record video, when detecting that the currently selected sound collection mode of the mobile equipment is a sound filtering mode outside the visual range of the camera, determining the direction of sound outside the visual range of the camera, and determining the position of the sound according to the time when the sound is transmitted to a microphone of the mobile equipment;
the mobile equipment acquires visual range data according to the visual range of the camera;
when the camera of the mobile device collects sound, the sound in the visual range of the camera is collected according to the visual range data, the sound outside the visual range of the camera is judged to be noise, and the noise is not collected or filtered.
Optionally, in the method for filtering sound, when the sound collection mode is a sound filtering mode within a visual range of a camera, collecting sound outside the visual range of the camera specifically includes:
when the mobile equipment starts a camera to record video, when detecting that the currently selected sound collection mode of the mobile equipment is a sound filtering mode in the visual range of the camera, determining the direction of sound outside the visual range of the camera, and determining the position of the sound according to the time when the sound is transmitted to a microphone of the mobile equipment;
the mobile equipment acquires visual range data according to the visual range of the camera;
when the camera of the mobile device collects sound, the sound outside the visual range of the camera is collected according to the visual range data, the sound in the visual range of the camera is judged to be noise, and the noise is not collected or filtered.
Optionally, the method for filtering sound, wherein the capturing sound in the visual range of the camera according to the visual range data includes:
and the mobile equipment compares the collected sound with the visual range data, judges whether the collected sound falls in the visual range data, and if so, the collected sound is the sound in the visual range of the camera.
Optionally, the method for filtering sound, wherein the capturing sound outside the visual range of the camera according to the visual range data includes:
and the mobile equipment compares the collected sound with the visual range data, judges whether the collected sound falls outside the visual range data, and if so, the collected sound is outside the visual range of the camera.
Optionally, the filtering the noise specifically includes:
and after the mobile equipment collects the noise, generating a reverse sound wave according to the sound wave characteristics of the noise, and superposing the reverse sound wave and the noise to eliminate the noise.
Optionally, the sound filtering method, wherein the sound filtering method further comprises:
before the mobile equipment starts the camera to record, when only the sound of a specific user needs to be recorded, receiving the sound input of the specific user and storing the sound characteristics of the specific user;
when the camera is started to record, only the sound of the specific user is collected according to the sound characteristics of the specific user, all other sounds are judged to be noise, and the noise is not collected or filtered.
In addition, to achieve the above object, the present invention also provides a mobile device, wherein the mobile device includes: the system comprises a memory, a processor and a sound filter program stored on the memory and capable of running on the processor, wherein the sound filter program realizes the steps of the sound filtering method when being executed by the processor.
In addition, in order to achieve the above object, the present invention also provides a computer-readable storage medium storing a sound filtering program which, when executed by a processor, implements the steps of the sound filtering method described above.
According to the invention, a selection instruction of a user is received through mobile equipment, and a sound acquisition mode currently selected by a camera of the mobile equipment is determined; when the sound collection mode is a sound filtering mode outside the visual range of the camera, collecting sound in the visual range of the camera; and when the sound collection mode is a sound filtering mode in the visual range of the camera, collecting the sound outside the visual range of the camera. According to the invention, according to the actual demands of users, only the sound in the visual range of the camera or the sound outside the visual range of the camera can be acquired, so that the noise which is not required to be acquired is effectively removed, the quality of video recording is improved, and more choices and convenience are brought to the users.
Drawings
FIG. 1 is a flow chart of a preferred embodiment of the sound filtering method of the present invention;
FIG. 2 is a flowchart of step S20 in a preferred embodiment of the sound filtering method of the present invention;
FIG. 3 is a flowchart of step S30 in a preferred embodiment of the sound filtering method of the present invention;
FIG. 4 is a schematic diagram of an operating environment of a mobile device according to a preferred embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more clear and clear, the present invention will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
As shown in fig. 1, the sound filtering method according to the preferred embodiment of the present invention includes the following steps:
step S10, the mobile equipment receives a selection instruction of a user and determines a sound collection mode currently selected by a camera of the mobile equipment.
Specifically, the sound filtering method of the invention is applied to mobile equipment, and the mobile equipment can be mobile electronic equipment such as smart phones and tablet computers.
Wherein, the sound collection mode includes: a camera visual range outside sound filtering mode, a camera visual range inside sound filtering mode and a normal mode without filtering at all; the sound filtering mode outside the visual range of the camera is to only collect the sound in the visual range of the camera, namely the sound collected by the mobile equipment is only the sound emitted in the scope of the camera; the sound filtering mode in the visual range of the camera is to only collect the sound outside the visual range of the camera, namely the sound collected by the mobile equipment is only the sound emitted outside the lens range of the camera; the normal mode without filtering is to collect all the sounds in the environment normally without any sound filtering.
Specifically, before the mobile device starts the camera to record video, the mobile device may prompt the user to select a sound collection mode through a popup window, then the user selects on a screen of the mobile device according to the prompt, and the mobile device determines, according to a selection instruction of the user, a sound collection mode (any one of the three collection modes) currently selected by the camera of the mobile device. Or the user directly sets the sound collection mode in the setting menu of the mobile device, and displays the currently selected sound collection mode through a screen before starting the camera.
And S20, when the sound collection mode is a sound filtering mode outside the visual range of the camera, collecting the sound in the visual range of the camera.
Fig. 2 is a flowchart of step S20 in the sound filtering method according to the present invention.
As shown in fig. 2, the step S20 includes:
s21, when the mobile equipment starts a camera to record video, and when the current selected sound collection mode of the mobile equipment is detected to be a sound filtering mode outside the visual range of the camera, determining the direction of sound outside the visual range of the camera, and determining the position of the sound according to the time when the sound is transmitted to a microphone of the mobile equipment;
s22, the mobile equipment acquires visual range data according to the visual range of the camera;
s23, when the camera of the mobile device collects sound, the sound in the visual range of the camera is collected according to the visual range data, the sound outside the visual range of the camera is judged to be noise, and the noise is not collected or filtered.
Specifically, when the currently selected sound collection mode of the mobile device is a sound filtering mode outside the visual range of the camera (the purpose is to collect sound in the visual range of the camera), determining the sound direction and the approximate position, and calculating the approximate data of the direction and the position of the sound source according to the position of the mobile device (determining the position of the sound source, possibly requiring the mobile device to support microphones on the left and right sides, simulating human ears, and determining the approximate position according to the time, phase and intensity difference of the sound transmitted to the two microphones); then, synchronously calculating the visual range data of the camera by taking the position of the mobile equipment as a reference point, wherein the visual range data of the camera is camera visual range data, namely the camera is fixed on the mobile equipment, when the mobile equipment does not move in the direction, the camera can only see the front thing, the visual range data is two side boundary data which can be identified by the camera, such as the range of two sides which can be seen at most when the eyes of a person see one direction, and the range is the visual data range in the range; this data may take the mobile device as the origin of coordinates and then derive the camera up, down, left, right, and visible range boundary data, and thus the sound source location, i.e., its location relative to the mobile device (origin of coordinates).
And then comparing the sound source data with the camera vision range data to see whether the sound source data falls in the camera vision data interval range, if the camera vision range data contains the sound source data, the sound source is indicated to be in the camera vision range, and the sound in the range is normally collected and maintained by the mobile equipment, so that the purpose of video recording in the camera vision range is achieved. The mobile equipment compares the collected sound with the visual range data, judges whether the collected sound falls in the visual range data, and if so, the collected sound is the sound in the visual range of the camera.
For example, the visual range data of the camera is obtained, for example, the mobile device is taken as the origin of coordinates, the left visual range is taken as the X axis, the left visual range data is represented by negative numbers, the right visual range data is represented by positive numbers, the upper visual range and the lower visual range are taken as the Y axis, the lower visual range data are negative numbers, the upper visual range data are positive numbers, if the left visual range and the right visual range are [ 3,3 ] and the upper visual range and the lower visual range are [ 3,3 ], the sound source position only needs to be determined at the moment, whether the sound source position falls in the visual range of the camera or not is judged, for example, whether the sound source position is smaller than-3 or larger than 3 is judged when the left visual range and the right visual range are judged, any condition is met, the camera cannot see the matters of the sound source position, and the upper visual range and the lower visual range are the same.
When sounds outside the visual range of the camera are transmitted to the mobile device, the sounds are judged not to belong to the sounds needing to be collected currently according to the setting of the mobile device, so that the mobile device judges the sounds outside the visual range of the camera as noise, directly does not collect the sounds, or analyzes the sound wave characteristics (namely the sound wave characteristics) of the noise, such as wavelength, frequency and the like, then the mobile device calculates the reverse sound wave (namely offset data) of the noise, and carries out data superposition on the noise and the reverse sound wave to achieve a balanced soundless or silencing state, namely, the noise is eliminated (namely, after the mobile device collects the noise, the reverse sound wave is generated according to the sound wave characteristics of the noise, and the reverse sound wave is superposed with the noise to eliminate the noise).
And S30, when the sound collection mode is a sound filtering mode in the visual range of the camera, collecting the sound outside the visual range of the camera.
Fig. 3 is a flowchart of step S30 in the sound filtering method according to the present invention.
As shown in fig. 3, the step S30 includes:
s31, when the mobile equipment starts a camera to record video, and when the current sound collection mode selected by the mobile equipment is detected to be a sound filtering mode in the visual range of the camera, determining the direction of sound outside the visual range of the camera, and determining the position of the sound according to the time when the sound is transmitted to a microphone of the mobile equipment;
s32, the mobile equipment acquires visual range data according to the visual range of the camera;
s33, when the camera of the mobile device collects sound, collecting the sound outside the visual range of the camera according to the visual range data, judging the sound in the visual range of the camera as noise, and not collecting the noise or filtering out the noise.
Specifically, when the currently selected sound collection mode of the mobile device is a sound filtering mode within the visual range of the camera (the purpose is to collect sound outside the visual range of the camera), determining the sound direction and the approximate position, and calculating the approximate data of the direction and the position of the sound source according to the position of the mobile device (determining the position of the sound source, possibly requiring the mobile device to support microphones on the left and right sides, simulating human ears, and determining the approximate position according to the time, phase and intensity difference of the sound transmitted to the two microphones); then, synchronously calculating the visual range data of the camera by taking the position of the mobile equipment as a reference point, wherein the visual range data of the camera is camera visual range data, namely the camera is fixed on the mobile equipment, when the mobile equipment does not move in the direction, the camera can only see the front thing, the visual range data is two side boundary data which can be identified by the camera, such as the range of two sides which can be seen at most when the eyes of a person see one direction, and the range is the visual data range in the range; this data may take the mobile device as the origin of coordinates and then derive the camera up, down, left, right, and visible range boundary data, and thus the sound source location, i.e., its location relative to the mobile device (origin of coordinates).
And then comparing the sound source data with the camera visual range data to see whether the sound source data falls outside the camera visual data interval range, if the camera visual range data does not contain the sound source data, indicating that the sound source is outside the camera visual range, and normally collecting and maintaining the sound outside the range by the mobile equipment, namely achieving the purpose of video recording outside the camera visual range. The mobile equipment compares the collected sound with the visual range data, judges whether the collected sound falls outside the visual range data, and if so, the collected sound is outside the visual range of the camera.
For example, the visual range data of the camera is obtained, for example, the mobile device is taken as the origin of coordinates, the left visual range is taken as the X axis, the left visual range data is represented by negative numbers, the right visual range data is represented by positive numbers, the upper visual range and the lower visual range are taken as the Y axis, the lower visual range data are negative numbers, the upper visual range data are positive numbers, if the left visual range and the right visual range are [ 3,3 ] and the upper visual range and the lower visual range are [ 3,3 ], the sound source position only needs to be determined at the moment, whether the sound source position falls in the visual range of the camera or not is judged, for example, whether the sound source position is smaller than-3 or larger than 3 is judged when the left visual range and the right visual range are judged, any condition is met, the camera cannot see the matters of the sound source position, and the upper visual range and the lower visual range are the same.
When sounds within the visual range of the camera are transmitted to the mobile device, the sounds are judged not to belong to the sounds needing to be collected currently according to the mobile device setting, so that the mobile device judges the sounds within the range of the camera as noise, directly does not collect the sounds, or analyzes sound wave characteristics (namely sound wave characteristics) of the noise, such as wavelength, frequency and the like, then the mobile device calculates reverse sound waves (namely offset data) of the noise, and carries out data superposition on the noise and the reverse sound waves to achieve a balanced soundless or silencing state (namely, after the mobile device collects the noise, the reverse sound waves are generated according to the sound wave characteristics of the noise, and the reverse sound waves are superposed with the noise to eliminate the noise).
If the mobile equipment is in a completely unfiltered mode, namely when the currently selected sound collection mode of the mobile equipment is in a completely unfiltered normal mode, the mobile equipment keeps consistent with the current use mode, and all received sounds are collected.
Further, before the mobile device starts the camera to record, when only the sound of a specific user (i.e. only the sound of a specific person needs to be recorded in the video to be recorded currently) needs to be recorded, the mobile device receives the sound input of the specific user and stores the sound characteristics of the specific user; when the camera is started to record, only the sound of the specific user is collected according to the sound characteristics of the specific user, and all other sounds are judged to be noise, so that the noise is not collected or filtered (the filtering principle is the same as the above, and the details are not repeated here).
Furthermore, when the mobile device records video, the camera observation range and the sound source to be collected and maintained are dynamically calculated by the mobile device according to the actual situation when the user uses the mobile device, namely if the mobile device is reversely changed, for example, the user holds the mobile device to move, the visible range of the camera can be changed at this time, the mobile device can be moved everywhere, the requirement of sound filtration is met, and the mobile device can not be fixed at a certain position to collect and filter the sound.
According to the invention, when the mobile device records the video according to the actual needs of the user, the sound collection is locked in the range which can be observed by the camera or outside the range, namely, the sound in the visual range of the camera can be recorded or the sound outside the visual range of the camera can be recorded, so that the noise outside the sound collection range or in the range is effectively removed, the video recording effect is optimal, and more choices and convenience are brought to the user.
Further, as shown in fig. 4, based on the above-mentioned sound filtering method, the present invention further provides a mobile device, which includes a processor 10, a memory 20 and a display 30. Fig. 4 shows only some of the components of the mobile device, but it should be understood that not all of the illustrated components are required to be implemented and that more or fewer components may be implemented instead.
The memory 20 may in some embodiments be an internal storage unit of the mobile device, such as a hard disk or a memory of the mobile device. The memory 20 may in other embodiments also be an external storage device of the mobile device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) or the like, which are provided on the mobile device. Further, the memory 20 may also include both internal storage units and external storage devices of the mobile device. The memory 20 is used for storing application software installed on the mobile device and various data, such as program codes for installing the mobile device. The memory 20 may also be used to temporarily store data that has been output or is to be output. In one embodiment, the memory 20 stores a sound filtering program 40, and the sound filtering program 40 is executable by the processor 10 to implement the sound filtering method in the present application.
The processor 10 may in some embodiments be a central processing unit (Central Processing Unit, CPU), microprocessor or other data processing chip for executing program code or processing data stored in the memory 20, for example performing the sound filtering method or the like.
The display 30 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch, or the like in some embodiments. The display 30 is used for displaying information on the mobile device and for displaying a visual user interface. The components 10-30 of the mobile device communicate with each other via a system bus.
In one embodiment, the following steps are implemented when the processor 10 executes the sound filter program 40 in the memory 20:
the method comprises the steps that mobile equipment receives a selection instruction of a user and determines a sound collection mode currently selected by a camera of the mobile equipment;
when the sound collection mode is a sound filtering mode outside the visual range of the camera, collecting sound in the visual range of the camera;
and when the sound collection mode is a sound filtering mode in the visual range of the camera, collecting the sound outside the visual range of the camera.
Wherein, the sound collection mode includes: a camera visual range outside sound filtering mode, a camera visual range inside sound filtering mode and a normal mode without filtering at all;
the sound filtering mode outside the visual range of the camera is to only collect the sound in the visual range of the camera;
the sound filtering mode in the visual range of the camera is to only collect the sound outside the visual range of the camera;
the normal mode without filtering is to collect all the sounds in the environment normally without any sound filtering.
When the sound collection mode is a sound filtering mode outside the visual range of the camera, collecting the sound in the visual range of the camera specifically comprises the following steps:
when the mobile equipment starts a camera to record video, when detecting that the currently selected sound collection mode of the mobile equipment is a sound filtering mode outside the visual range of the camera, determining the direction of sound outside the visual range of the camera, and determining the position of the sound according to the time when the sound is transmitted to a microphone of the mobile equipment;
the mobile equipment acquires visual range data according to the visual range of the camera;
when the camera of the mobile device collects sound, the sound in the visual range of the camera is collected according to the visual range data, the sound outside the visual range of the camera is judged to be noise, and the noise is not collected or filtered.
When the sound collection mode is a sound filtering mode in the visual range of the camera, collecting the sound outside the visual range of the camera specifically comprises the following steps:
when the mobile equipment starts a camera to record video, when detecting that the currently selected sound collection mode of the mobile equipment is a sound filtering mode in the visual range of the camera, determining the direction of sound outside the visual range of the camera, and determining the position of the sound according to the time when the sound is transmitted to a microphone of the mobile equipment;
the mobile equipment acquires visual range data according to the visual range of the camera;
when the camera of the mobile device collects sound, the sound outside the visual range of the camera is collected according to the visual range data, the sound in the visual range of the camera is judged to be noise, and the noise is not collected or filtered.
The capturing, according to the visual range data, sound in the visual range of the camera includes:
and the mobile equipment compares the collected sound with the visual range data, judges whether the collected sound falls in the visual range data, and if so, the collected sound is the sound in the visual range of the camera.
The capturing, according to the visual range data, sound outside the visual range of the camera includes:
and the mobile equipment compares the collected sound with the visual range data, judges whether the collected sound falls outside the visual range data, and if so, the collected sound is outside the visual range of the camera.
The filtering out the noise specifically includes:
and after the mobile equipment collects the noise, generating a reverse sound wave according to the sound wave characteristics of the noise, and superposing the reverse sound wave and the noise to eliminate the noise.
Wherein, the sound filtering method further comprises:
before the mobile equipment starts the camera to record, when only the sound of a specific user needs to be recorded, receiving the sound input of the specific user and storing the sound characteristics of the specific user;
when the camera is started to record, only the sound of the specific user is collected according to the sound characteristics of the specific user, all other sounds are judged to be noise, and the noise is not collected or filtered.
The present invention also provides a computer-readable storage medium storing a sound filtering program which, when executed by a processor, implements the steps of the sound filtering method as described above.
In summary, the present invention provides a sound filtering method, a mobile device and a computer readable storage medium, wherein the method includes: the method comprises the steps that mobile equipment receives a selection instruction of a user and determines a sound collection mode currently selected by a camera of the mobile equipment; when the sound collection mode is a sound filtering mode outside the visual range of the camera, collecting sound in the visual range of the camera; and when the sound collection mode is a sound filtering mode in the visual range of the camera, collecting the sound outside the visual range of the camera. According to the invention, according to the actual demands of users, only the sound in the visual range of the camera or the sound outside the visual range of the camera can be acquired, so that the noise which is not required to be acquired is effectively removed, the quality of video recording is improved, and more choices and convenience are brought to the users.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Of course, those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by a computer program for instructing relevant hardware (e.g., processor, controller, etc.), the program may be stored on a computer readable storage medium, and the program may include the above described methods when executed. The computer readable storage medium may be a memory, a magnetic disk, an optical disk, etc.
It is to be understood that the invention is not limited in its application to the examples described above, but is capable of modification and variation in light of the above teachings by those skilled in the art, and that all such modifications and variations are intended to be included within the scope of the appended claims.
Claims (8)
1. A sound filtering method, the sound filtering method comprising:
the method comprises the steps that mobile equipment receives a selection instruction of a user and determines a sound collection mode currently selected by a camera of the mobile equipment;
when the sound collection mode is a sound filtering mode outside the visual range of the camera, collecting sound in the visual range of the camera;
when the sound collection mode is a sound filtering mode outside the visual range of the camera, collecting the sound in the visual range of the camera specifically comprises the following steps:
when the mobile equipment starts a camera to record video, when detecting that the currently selected sound collection mode of the mobile equipment is a sound filtering mode outside the visual range of the camera, determining the direction of sound outside the visual range of the camera, and determining the position of the sound according to the time when the sound is transmitted to a microphone of the mobile equipment;
the mobile equipment acquires visual range data according to the visual range of the camera;
when the camera of the mobile equipment collects sound, collecting sound in the visual range of the camera according to the visual range data, judging sound outside the visual range of the camera as noise, and not collecting the noise or filtering out the noise;
when the sound collection mode is a sound filtering mode in the visual range of the camera, collecting sound outside the visual range of the camera;
when the sound collection mode is a sound filtering mode in the visual range of the camera, collecting the sound outside the visual range of the camera specifically comprises the following steps:
when the mobile equipment starts a camera to record video, when detecting that the currently selected sound collection mode of the mobile equipment is a sound filtering mode in the visual range of the camera, determining the direction of sound outside the visual range of the camera, and determining the position of the sound according to the time when the sound is transmitted to a microphone of the mobile equipment;
the mobile equipment acquires visual range data according to the visual range of the camera;
when the camera of the mobile device collects sound, collecting sound outside the visual range of the camera according to the visual range data, judging the sound in the visual range of the camera as noise, and not collecting the noise or filtering out the noise;
when video is recorded on the mobile device according to the actual needs of a user, the sound collection is locked in the range which can be observed by the camera or out of the range, the sound in the visual range of the camera is recorded or the sound out of the visual range of the camera is recorded, and the noise out of the sound collection range or in the range is effectively removed.
2. The sound filtering method according to claim 1, wherein the sound collection mode includes: a camera visual range outside sound filtering mode, a camera visual range inside sound filtering mode and a normal mode without filtering at all;
the sound filtering mode outside the visual range of the camera is to only collect the sound in the visual range of the camera;
the sound filtering mode in the visual range of the camera is to only collect the sound outside the visual range of the camera;
the normal mode without filtering is to collect all the sounds in the environment normally without any sound filtering.
3. The method of claim 1, wherein the capturing the sound within the visual range of the camera from the visual range data comprises:
and the mobile equipment compares the collected sound with the visual range data, judges whether the collected sound falls in the visual range data, and if so, the collected sound is the sound in the visual range of the camera.
4. The method of claim 1, wherein the capturing the sound outside the visual range of the camera based on the visual range data comprises:
and the mobile equipment compares the collected sound with the visual range data, judges whether the collected sound falls outside the visual range data, and if so, the collected sound is outside the visual range of the camera.
5. The method of claim 1, wherein filtering out the noise specifically comprises:
and after the mobile equipment collects the noise, generating a reverse sound wave according to the sound wave characteristics of the noise, and superposing the reverse sound wave and the noise to eliminate the noise.
6. The sound filtering method according to claim 1, characterized in that the sound filtering method further comprises:
before the mobile equipment starts the camera to record, when only the sound of a specific user needs to be recorded, receiving the sound input of the specific user and storing the sound characteristics of the specific user;
when the camera is started to record, only the sound of the specific user is collected according to the sound characteristics of the specific user, all other sounds are judged to be noise, and the noise is not collected or filtered.
7. A mobile device, the mobile device comprising: memory, a processor and a sound filter program stored on the memory and executable on the processor, which sound filter program when executed by the processor implements the steps of the sound filtering method according to any one of claims 1-6.
8. A computer readable storage medium, characterized in that the computer readable storage medium stores a sound filtering program, which when executed by a processor, implements the steps of the sound filtering method according to any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011546935.1A CN112712817B (en) | 2020-12-24 | 2020-12-24 | Sound filtering method, mobile device and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011546935.1A CN112712817B (en) | 2020-12-24 | 2020-12-24 | Sound filtering method, mobile device and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112712817A CN112712817A (en) | 2021-04-27 |
| CN112712817B true CN112712817B (en) | 2024-04-09 |
Family
ID=75544113
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011546935.1A Active CN112712817B (en) | 2020-12-24 | 2020-12-24 | Sound filtering method, mobile device and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112712817B (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101211615A (en) * | 2006-12-31 | 2008-07-02 | 于柏泉 | Method, system and apparatus for automatic recording for specific human voice |
| CN103607537A (en) * | 2013-10-31 | 2014-02-26 | 北京智谷睿拓技术服务有限公司 | Control method of camera and the camera |
| EP2871824A1 (en) * | 2013-10-22 | 2015-05-13 | Nokia Corporation | Audio capture with multiple microphones |
| CN106303187A (en) * | 2015-05-11 | 2017-01-04 | 小米科技有限责任公司 | The acquisition method of voice messaging, device and terminal |
| CN107197187A (en) * | 2017-05-27 | 2017-09-22 | 维沃移动通信有限公司 | The image pickup method and mobile terminal of a kind of video |
| CN107277260A (en) * | 2017-07-07 | 2017-10-20 | 珠海格力电器股份有限公司 | Contextual model adjusting method and device and mobile terminal |
| CN108594988A (en) * | 2018-03-22 | 2018-09-28 | 美律电子(深圳)有限公司 | Wearable electronic device and its operating method for audio imaging |
| CN108702458A (en) * | 2017-11-30 | 2018-10-23 | 深圳市大疆创新科技有限公司 | Image pickup method and device |
| CN109036448A (en) * | 2017-06-12 | 2018-12-18 | 华为技术有限公司 | A kind of sound processing method and device |
| CN109147813A (en) * | 2018-09-21 | 2019-01-04 | 神思电子技术股份有限公司 | A kind of service robot noise-reduction method based on audio-visual location technology |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1443498B1 (en) * | 2003-01-24 | 2008-03-19 | Sony Ericsson Mobile Communications AB | Noise reduction and audio-visual speech activity detection |
| US8548048B2 (en) * | 2005-10-27 | 2013-10-01 | Qualcomm Incorporated | Video source rate control for video telephony |
| JP2010249939A (en) * | 2009-04-13 | 2010-11-04 | Sony Corp | Noise reducing device and noise determination method |
| US20120050570A1 (en) * | 2010-08-26 | 2012-03-01 | Jasinski David W | Audio processing based on scene type |
| CN105898649B (en) * | 2016-04-26 | 2019-01-18 | 宁波桑德纳电子科技有限公司 | A kind of sound collector suitable under remote high-noise environment |
| CN108124180A (en) * | 2017-12-27 | 2018-06-05 | 深圳Tcl新技术有限公司 | TV control method, mobile terminal and computer readable storage medium |
-
2020
- 2020-12-24 CN CN202011546935.1A patent/CN112712817B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101211615A (en) * | 2006-12-31 | 2008-07-02 | 于柏泉 | Method, system and apparatus for automatic recording for specific human voice |
| EP2871824A1 (en) * | 2013-10-22 | 2015-05-13 | Nokia Corporation | Audio capture with multiple microphones |
| CN103607537A (en) * | 2013-10-31 | 2014-02-26 | 北京智谷睿拓技术服务有限公司 | Control method of camera and the camera |
| CN106303187A (en) * | 2015-05-11 | 2017-01-04 | 小米科技有限责任公司 | The acquisition method of voice messaging, device and terminal |
| CN107197187A (en) * | 2017-05-27 | 2017-09-22 | 维沃移动通信有限公司 | The image pickup method and mobile terminal of a kind of video |
| CN109036448A (en) * | 2017-06-12 | 2018-12-18 | 华为技术有限公司 | A kind of sound processing method and device |
| CN107277260A (en) * | 2017-07-07 | 2017-10-20 | 珠海格力电器股份有限公司 | Contextual model adjusting method and device and mobile terminal |
| CN108702458A (en) * | 2017-11-30 | 2018-10-23 | 深圳市大疆创新科技有限公司 | Image pickup method and device |
| CN108594988A (en) * | 2018-03-22 | 2018-09-28 | 美律电子(深圳)有限公司 | Wearable electronic device and its operating method for audio imaging |
| CN109147813A (en) * | 2018-09-21 | 2019-01-04 | 神思电子技术股份有限公司 | A kind of service robot noise-reduction method based on audio-visual location technology |
Non-Patent Citations (4)
| Title |
|---|
| Interference Reduction in Reverberant Speech Separation With Visual Voice Activity Detection;Qingju Liu , et al.;《IEEE Transactions on Multimedia》;20140509;第16卷(第6期);全文 * |
| Jacek Stachurski,et al.Sound source localization for video surveillance camera.《2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance》.2013,全文. * |
| 一种噪音环境下的基于特征口形的音频视频混合连续语音识别系统;谢磊等;《计算机工程与应用》(第16期);全文 * |
| 联合音视频信息的目标定位技术研究;曾宪燎;《中国优秀硕士学位论文全文库（信息科技辑）》;20150815;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112712817A (en) | 2021-04-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102349428B1 (en) | Method for processing image and electronic device supporting the same | |
| EP2953133B1 (en) | Method and device of playing multimedia | |
| US20150296317A1 (en) | Electronic device and recording method thereof | |
| CN112214294B (en) | Method for calling hardware interface and electronic equipment | |
| EP3104304B1 (en) | Electronic apparatus and method of extracting still images | |
| CN104780316A (en) | Camera starting detection method and camera starting detection device | |
| CN110059211B (en) | Method and related device for recording emotion of user | |
| KR20140145401A (en) | Method and apparatus for cancelling noise in an electronic device | |
| CN110471606A (en) | Input method and electronic equipment | |
| EP3525446A1 (en) | Photographing method and terminal | |
| JP6828174B2 (en) | Step counting method and treadmill equipment | |
| CN108364660B (en) | Stress recognition method and device and computer readable storage medium | |
| CN113873165A (en) | Photographing method and device and electronic equipment | |
| CN103688529A (en) | Visual media on a circular buffer | |
| CN115661912A (en) | Image processing method, model training method, electronic device and readable storage medium | |
| CN109144363B (en) | Information processing method and electronic equipment | |
| CN112712817B (en) | Sound filtering method, mobile device and computer readable storage medium | |
| US20180348867A1 (en) | Method to sense force exertion on handheld device for behavior setting and input for quick response | |
| CN105791558A (en) | Mobile terminal and method thereof for controlling terminal device | |
| CN113095163A (en) | Video processing method and device, electronic equipment and storage medium | |
| KR20130107844A (en) | Apparatus and method for controlling auto focus function in electronic device | |
| EP2712174A1 (en) | Methods and devices for controlling camera image capture | |
| WO2019011182A1 (en) | Mobile terminal and adjusting method thereof, and computer readable storage medium | |
| CN114648315A (en) | Virtual interview method, device, equipment and storage medium | |
| CN103514228A (en) | File processing method and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |