WO2017020507A1 - 监控画面声音采集方法及装置 - Google Patents

监控画面声音采集方法及装置 Download PDF

Info

Publication number
WO2017020507A1
WO2017020507A1 PCT/CN2015/098720 CN2015098720W WO2017020507A1 WO 2017020507 A1 WO2017020507 A1 WO 2017020507A1 CN 2015098720 W CN2015098720 W CN 2015098720W WO 2017020507 A1 WO2017020507 A1 WO 2017020507A1
Authority
WO
WIPO (PCT)
Prior art keywords
sound
monitoring
monitored object
emits
acquiring device
Prior art date
Application number
PCT/CN2015/098720
Other languages
English (en)
French (fr)
Inventor
唐明勇
刘华一君
陈涛
Original Assignee
小米科技有限责任公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 小米科技有限责任公司 filed Critical 小米科技有限责任公司
Priority to MX2016004997A priority Critical patent/MX362891B/es
Priority to JP2017531954A priority patent/JP6386187B2/ja
Priority to KR1020167004628A priority patent/KR101770930B1/ko
Priority to RU2016115037A priority patent/RU2638763C2/ru
Publication of WO2017020507A1 publication Critical patent/WO2017020507A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/10—Terrestrial scenes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H04N5/92—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N5/9201—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving the multiplexing of an additional signal and the video signal
    • H04N5/9202—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving the multiplexing of an additional signal and the video signal the additional signal being a sound signal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/78—Detection of presence or absence of voice signals
    • G10L2025/783—Detection of presence or absence of voice signals based on threshold decision
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/78—Detection of presence or absence of voice signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/144—Movement detection

Definitions

  • the present disclosure relates to the field of computer technologies, and in particular, to a method and an apparatus for collecting sound of a monitoring picture.
  • the camera monitoring function is applied more and more widely, such as traffic monitoring, supermarket monitoring, and community monitoring.
  • the monitoring device When using the camera on the monitoring device for monitoring, if the monitored object is relatively far away, the monitoring device usually cannot clearly obtain the sound emitted by the monitored object, and thus the monitoring information may be incomplete.
  • the present disclosure provides a method and device for collecting sound of the monitoring screen.
  • the technical solution is as follows:
  • a monitoring picture sound collection method comprising:
  • the camera of the monitoring device collects the monitoring screen, detecting whether there is a monitored object that emits sound in the monitoring screen;
  • the predetermined condition is that the sound signal intensity of the monitored object collected by the sound acquiring device is greater than The sound signal strength of the monitored object collected by the monitoring device
  • the detecting, in the monitoring screen, whether there is a monitored object that emits a sound includes:
  • Detecting whether a specified type object in the monitoring screen emits a sound the specified type object including at least one of a door, a window, and a home appliance; or
  • the designating The indicators are switch status, air quality parameters, temperature, heat source change parameters or physiological characteristic parameters.
  • the determining the sound acquiring device that meets the predetermined condition comprises:
  • the determining the sound acquiring device that meets the predetermined condition comprises:
  • At least one mobile device bound to the monitoring device is determined to be a sound acquiring device that meets the predetermined condition.
  • the obtaining, by the sound acquiring device, the sound acquiring device that is the closest to the monitored object that emits the sound includes:
  • the position of the monitored object that emits the sound is determined by the image recognition technology, and the sound acquiring device for monitoring the sounded object is determined according to the range of the monitoring area corresponding to the sound acquiring device.
  • controlling the sound acquiring device to collect the sound emitted by the monitored object includes:
  • the sound acquiring device that meets the predetermined condition is the sound acquiring device closest to the monitored object that emits the sound, controlling the sound acquiring device to collect the sound;
  • the sound acquiring device that meets the predetermined condition is the sound acquiring device that collects the strongest sound signal, controlling the sound acquiring device to continue collecting sound;
  • the sound acquiring device that meets the predetermined condition is a mobile device bound to the monitoring device, controlling the mobile device to move to a position of the monitored object that emits sound in the monitoring screen, and controlling the movement
  • the device collects the sound at the location of the monitored object.
  • a monitoring picture sound collection device comprising:
  • the detecting module is configured to detect whether there is a monitored object that emits sound in the monitoring screen when the monitoring device captures the monitoring screen;
  • a determining module configured to: when the detecting module detects that the monitored object that emits sound exists in the monitoring screen, determine a sound acquiring device that meets a predetermined condition, where the predetermined condition is collected by the sound acquiring device The sound signal strength of the monitored object is greater than the sound signal strength of the monitored object collected by the monitoring device;
  • the control module is configured to control the sound acquiring device determined by the determining module to collect the sound emitted by the monitored object.
  • the detecting module includes:
  • a first detecting submodule configured to detect whether there is an image change element that emits sound in the monitoring screen, where the image change element includes a monitored object that changes into a monitored object or a mouth shape that enters the monitoring screen;
  • a second detecting submodule configured to detect whether a specified type object in the monitoring screen emits a sound, the specified type object including at least one of a door, a window, and a home appliance;
  • the third detection sub-module is configured to detect, according to the specified indicator reported by the other monitoring device, whether there is a monitored object that emits a sound in the monitoring screen, where the monitoring device is bound to the monitoring device for monitoring
  • the device for specifying an indicator is a switch state, an air quality parameter, a temperature, a heat source change parameter, or a physiological feature parameter.
  • the determining module includes:
  • a fourth detection sub-module configured to detect whether a sound corresponding to the monitoring screen collected by the monitoring device is less than a predetermined sound threshold
  • a first determining submodule configured to determine, when the fourth detecting submodule detects that the sound corresponding to the monitoring screen collected by the monitoring device is smaller than the predetermined sound threshold, determining that the predetermined condition is met Sound acquisition device.
  • the determining submodule includes:
  • a first acquisition sub-module configured to acquire, from all sound acquisition devices bound to the monitoring device, a sound acquisition device that is closest to the sounded object to be monitored, and determine the acquired sound acquisition device as a sound acquiring device that meets the predetermined condition;
  • a second obtaining submodule configured to control, by all the sound acquiring devices bound to the monitoring device, the sound emitted by the monitored object that emits a sound, and determine the sound acquiring device that collects the strongest sound signal as conforming The sound acquiring device of the predetermined condition;
  • a second determining submodule configured to determine at least one mobile device bound to the monitoring device as a sound acquiring device that meets the predetermined condition.
  • the first acquiring submodule includes:
  • a third determining submodule configured to determine, by using an indoor positioning technology, a sound acquiring device that is closest to the monitored object that emits sound from all sound acquiring devices that are bound to the monitoring device;
  • a fourth determining submodule configured to determine, by using an image recognition technology, a location of the monitored object that emits a sound, and determine, according to a range of the corresponding listening region of the sound acquiring device, the sound for monitoring the sound emitted The sound acquisition device of the monitored object.
  • control module includes:
  • a first control submodule configured to control the sound acquiring device to collect sound when the sound acquiring device that meets the predetermined condition is the sound acquiring device that is closest to the monitored object that emits sound;
  • a second control submodule configured to: when the sound acquiring device meeting the predetermined condition is the strongest sound collected Controlling the sound acquiring device to continue collecting sound when the sound of the sound signal acquires the device;
  • a third control submodule configured to control, when the sound acquiring device that meets the predetermined condition is a mobile device bound to the monitoring device, to move the monitored device to a monitored object that emits a sound in the monitoring screen And control the mobile device to collect the sound at the location of the monitored object.
  • a monitoring picture sound collecting apparatus wherein the apparatus comprises:
  • a memory for storing the processor executable instructions
  • processor is configured to:
  • the camera of the monitoring device collects the monitoring screen, detecting whether there is a monitored object that emits sound in the monitoring screen;
  • the predetermined condition is that the sound signal intensity of the monitored object collected by the sound acquiring device is greater than The sound signal strength of the monitored object collected by the monitoring device
  • the sound acquiring device that controls the collected sound of the monitored object to be greater than the sound signal intensity of the monitored object collected by the monitoring device collects the sound emitted by the monitored object by determining the monitored object that emits the sound in the monitoring screen; The problem that the monitoring device cannot clearly obtain the sound emitted by the monitored object far from the monitoring device is solved; the monitoring device controls the sound acquiring device to collect the sound emitted by the monitored object, so that the monitored information has a comprehensive effect.
  • FIG. 1 is a flowchart of a method for collecting sound of a monitoring picture according to an exemplary embodiment
  • FIG. 2A is a flowchart of detecting whether there is a monitored object that emits a sound in a monitoring screen according to an exemplary embodiment
  • 2B is a flowchart illustrating a method of detecting whether a monitored object that emits a sound exists in a monitoring screen, according to an exemplary embodiment
  • 2C is a schematic diagram of walking into a monitored object in a monitoring screen according to an exemplary embodiment
  • 2D is a schematic diagram of a monitored object in a monitoring screen in which a change in a port type is shown, according to an exemplary embodiment
  • 2E is a schematic diagram showing sounds of a specified type of object in a monitoring screen according to an exemplary embodiment
  • 2F is a schematic diagram of detecting, according to a specified indicator reported by another monitoring device, whether there is a monitored object that emits a sound in a monitoring screen according to an exemplary embodiment
  • 2G is a flowchart showing a method of determining a sound acquiring device that meets a predetermined condition, according to an exemplary embodiment
  • 2H is a schematic diagram of a sound acquiring device that determines a sound acquiring device that has acquired the strongest sound signal as meeting a predetermined condition, according to an exemplary embodiment
  • 2I is a flowchart of a method for acquiring a sound acquiring device closest to a monitored object that emits a sound in a monitoring screen from all sound acquiring devices bound to a monitoring device, according to an exemplary embodiment
  • 2J is a schematic diagram showing a sound acquiring device for a monitoring device to determine a monitored object for sounding, according to an exemplary embodiment
  • 2K is a flowchart illustrating a method for controlling a sound acquiring device to collect sounds emitted by a monitored object, according to an exemplary embodiment
  • 2L is a schematic diagram showing a monitoring device controlling a mobile device to move to a position of a monitored object that emits a sound in a monitoring screen, according to an exemplary embodiment
  • FIG. 3 is a block diagram of a monitoring picture sound collecting apparatus according to an exemplary embodiment
  • FIG. 4 is a block diagram of a monitoring picture sound collection device according to another exemplary embodiment
  • FIG. 5 is a block diagram for collecting sound of a monitoring picture, according to an exemplary embodiment.
  • FIG. 1 is a flowchart of a method for collecting sound of a monitoring picture according to an exemplary embodiment. As shown in FIG. 1 , the method for collecting sound of a monitoring picture includes the following steps.
  • step 101 when the monitoring screen of the monitoring device collects the monitoring screen, it is detected whether there is a monitored object that emits sound in the monitoring screen.
  • the monitoring device can collect not only the monitoring screen but also the sound of the monitored object in the monitoring screen.
  • step 102 if there is a monitored object that emits a sound in the monitoring screen, the sound acquiring device that meets the predetermined condition is determined, and the predetermined condition is that the sound signal intensity of the monitored object collected by the sound acquiring device is greater than that collected by the monitoring device.
  • the sound signal strength of the monitored object is determined, and the predetermined condition is that the sound signal intensity of the monitored object collected by the sound acquiring device is greater than that collected by the monitoring device. The sound signal strength of the monitored object.
  • the monitoring device can clearly collect the monitoring picture, the collection effect of the monitored object sound in the monitoring picture is slightly poor, for example, the sound of the monitored object in the monitoring picture is very weak or the monitored object in the monitoring picture. Far from the monitoring device, the sound of the monitored object may not be monitored by the device It is clearly collected and even automatically filtered by the monitoring device. At this time, a sound acquiring device that additionally sets a predetermined condition is required to collect the sound of the monitored object.
  • the predetermined condition may be that the sound signal intensity of the monitored object collected by the sound acquiring device is greater than the sound signal strength of the monitored object collected by the monitoring device, and when the predetermined condition is satisfied, the sound acquiring device is turned on to be monitored. The collection of object sounds.
  • the sound acquiring device mentioned here may be a device having a sound collecting device such as a mobile phone, an audio, a Bluetooth earphone or the like.
  • step 103 the sound acquisition device is controlled to collect the sound emitted by the monitored object.
  • the monitoring device When the monitored device detects that the monitored object in the monitoring screen emits a sound, but the sound emitted by the monitored object is too weak or the monitored object is far away from the monitoring device, the monitoring device cannot clearly collect the sound emitted by the monitored object, and then monitors The device can control the sound acquiring device that meets the predetermined condition to collect the sound emitted by the monitored object.
  • the method for collecting sound of the monitoring picture controls the collected object to be monitored to determine the sound signal intensity of the collected object is greater than the collected by the monitoring device.
  • the sound acquiring device that monitors the sound signal strength of the object collects the sound emitted by the monitored object; solves the problem that the monitoring device cannot clearly obtain the sound of the monitored object that is far away from the monitoring device; and the monitoring device controls the sound acquiring device to collect The sound emitted by the monitored object makes the monitored information comprehensive.
  • step 102 in FIG. 1 may be further replaced with steps 102a through 102b.
  • FIG. 2A it is a flowchart of detecting whether there is a monitored object that emits sound in a monitoring screen according to an exemplary embodiment. As shown in FIG. 2A, the monitoring device detects whether a sound is generated in the monitoring screen. When the object is being monitored, the following steps are included.
  • step 102a it is detected whether the sound corresponding to the monitoring screen collected by the monitoring device is less than a predetermined sound threshold.
  • the predetermined sound threshold is said to be a critical value of whether the monitoring device can clearly collect the sound corresponding to the monitoring screen.
  • the sound corresponding to the monitoring screen collected by the monitoring device is less than the predetermined sound threshold, it indicates that the monitoring device is temporarily unable to collect the sound corresponding to the monitoring screen.
  • step 102b if the sound corresponding to the monitoring screen collected by the monitoring device is less than the predetermined sound threshold, the sound acquiring device meeting the predetermined condition is determined.
  • the sound corresponding to the monitoring screen collected by the monitoring device is less than the predetermined sound threshold, it indicates that the monitoring device cannot temporarily collect the sound corresponding to the monitoring screen. Therefore, it is necessary to determine the sound acquiring device that meets the predetermined condition instead of the monitoring device. The sound corresponding to the monitoring screen is collected.
  • the method for collecting sound of the monitoring picture controls the collected object to be monitored to determine the sound signal intensity of the collected object is greater than the collected by the monitoring device.
  • the sound acquiring device that monitors the sound signal intensity of the object collects the sound emitted by the monitored object; the monitoring device is solved The sound problem emitted by the monitored object far from the monitoring device cannot be clearly obtained; the monitoring device controls the sound acquiring device to collect the sound emitted by the monitored object, so that the monitored information has a comprehensive effect.
  • the sound acquiring device that meets the predetermined condition may be sent an acquisition instruction, and the sound acquiring device is instructed to collect the monitored object, wherein the predetermined condition may be the distance being The monitored object is the closest, or the sound signal collected is the strongest, or the mobile device bound to the monitoring device.
  • FIG. 2B is a flowchart of detecting a method for detecting a sounded object in a monitoring screen according to an exemplary embodiment.
  • step 101 may be performed. It includes the following three methods:
  • the image change element includes a monitored object that has entered the monitor screen or a monitored object whose mouth shape has changed.
  • the image change element mentioned here may be a person or an object moved to the monitor screen, or may be a mouth shape change of a person or an animal's mouth.
  • FIG. 2C is a schematic diagram of walking into a monitored object in a monitoring screen according to an exemplary embodiment.
  • the monitoring device 10 monitors a screen, people 11, cats 12 and dogs are entered. 13, then the monitoring device 10 can treat the person 11, the cat 12 and the dog 13 as monitored objects; see FIG. 2D, which is a monitored object in the monitoring screen in which there is a change in the mouth shape according to an exemplary embodiment.
  • FIG. 2D when the person 11a and the person 11b are talking in the screen monitored by the monitoring device 10, when the monitoring device 10 detects that the mouth pattern of the person 11a and the person 11b changes, the person 11a and the person can be 11b is considered to be monitored.
  • the second mode 101b it is detected whether a specified type object in the monitoring screen emits a sound, and the specified type object includes at least one of a door, a window, and a home appliance.
  • the specified type of object refers to The camera does not move, and the camera needs to determine the object that needs to acquire the sound through the collected sound.
  • FIG. 2E is a schematic diagram showing sounds of a specified type of object in a monitoring screen according to an exemplary embodiment.
  • the television 15 is turned on and powered.
  • the monitoring device 10 can still regard the door 14, the television 15 and the electric fan 16 according to the sound of the knocking door, the sound of the television program, and the sound of the blade turning. The object being monitored.
  • the third mode 101c detects whether there is a monitored object that emits a sound in the monitoring screen according to the specified indicator reported by the other monitoring device.
  • the monitoring device is a device for monitoring the specified indicator bound to the monitoring device, and the designated indicator is a switch state. , air quality parameters, temperature, heat source change parameters or physiological characteristics parameters.
  • the monitoring device can determine which monitored objects in the picture emit sound by means of the monitoring device, where the monitoring device is installed around the monitored object or the monitored object.
  • a monitoring device for monitoring the state of the monitored object is necessary to determine which monitored objects in the picture emit sound by means of the monitoring device, where the monitoring device is installed around the monitored object or the monitored object.
  • the monitoring device is installed on the switch of the electric appliance, and when the electrical appliance is turned on, the monitoring device will be turned on. According to the feedback to the monitoring device, after receiving the data, the monitoring device determines that the electrical appliance is the monitored object, sends an acquisition instruction to the qualified sound acquiring device, and commands the sound acquiring device that meets the condition to collect the sound emitted by the electrical appliance. For example, when the monitoring device is installed near a window or a door, when the window or the door is opened, when the monitoring device senses that the ambient air temperature changes, the temperature change data is fed back to the monitoring device, and the monitoring device determines the window after receiving the data.
  • the OR gate is the monitored object, sends an acquisition instruction to the qualified sound acquisition device, and commands the sound acquisition device that meets the condition to collect the sound emitted by the electrical appliance.
  • FIG. 2F is a schematic diagram of detecting whether there is a sounded monitored object in a monitoring screen according to a specified indicator reported by another monitoring device according to an exemplary embodiment, as shown in FIG. 2F, in the monitoring screen.
  • the sensor 17 mounted above the door 18 feeds back the temperature change data to the monitoring device 10 when the ambient air temperature is sensed, and the monitoring device 10 can receive the feedback data to the qualified sound acquiring device.
  • the acquisition instruction is sent, and the sound acquisition device that meets the condition is commanded to collect the sound emitted by the door 18.
  • FIG. 2G is a flowchart of a method for determining a sound acquiring device that meets a predetermined condition, as shown in FIG. 2G, and determines that a predetermined condition is met, according to an exemplary embodiment.
  • the step 102b may include the following three methods:
  • the sound acquiring device closest to the monitored object that emits the sound is acquired from all the sound acquiring devices that are bound to the monitoring device, and the obtained sound acquiring device is determined as the sound acquiring device that meets the predetermined condition.
  • the monitoring device may determine the sound acquiring device that is closest to the monitored object that emits the sound through the monitoring screen, and determine the sound acquiring device as the sound acquiring device that meets the predetermined condition.
  • all the sound acquiring devices that are bound to the monitoring device collect the sound emitted by the monitored object that emits the sound, and determine the sound acquiring device that has collected the strongest sound signal as the sound acquiring device that meets the predetermined condition.
  • the monitoring device may send an acquisition instruction to all the sound acquisition devices, the acquisition instruction is used to command the sound collection of the monitored object in the monitoring screen to all the sound acquiring devices, and all the sounds are acquired.
  • the device After receiving the acquisition instruction, the device starts to collect sound from the monitored object, and sends the collected sound to the monitoring device for summary testing. After the monitoring device receives and tests the sound collected by all the sound acquiring devices, the device determines the collected sound signal.
  • the strongest sound acquisition device determines the sound acquisition device as a sound acquisition device that meets predetermined conditions.
  • FIG. 2H is a schematic diagram of a sound acquiring device that determines a sound acquiring device that collects the strongest sound signal to meet a predetermined condition, as shown in FIG. 2H, when there is an audio in the monitoring screen, according to an exemplary embodiment. 19.
  • the three sound acquisition devices respectively collect the sounds emitted by the human 11 and send the collected sounds to the monitoring device 10, and the monitoring device 10 collects the sounds collected by the three sound acquisition devices. Sound test, determine The Bluetooth earphone 20 having the strongest sound signal is collected, and the Bluetooth earphone 20 is determined as a sound acquiring device that satisfies a predetermined condition.
  • the at least one mobile device bound to the monitoring device is determined as a sound acquiring device that meets a predetermined condition.
  • the monitoring device can be bound to a mobile device that is convenient to move indoors, such as a mobile terminal, a cleaning robot, a remote control aircraft, etc., and when the monitored object is far away from the monitoring device, the mobile device is determined to be a sound acquiring device that meets a predetermined condition.
  • FIG. 2I is shown, according to an exemplary embodiment, acquiring, from all sound acquiring devices bound to the monitoring device, the sound closest to the monitored object that emits sound in the monitoring screen.
  • a flowchart of the device method is as shown in FIG. 2I.
  • the first mode 102b1 in step 102b may include the following two methods:
  • the sound acquiring device closest to the monitored object that emits the sound is determined from all the sound acquiring devices bound to the monitoring device by the indoor positioning technology.
  • the monitoring device can be installed in multiple rooms, and all monitoring devices are connected to each other through a wireless or wired network, and an indoor positioning system can be formed to realize monitoring of indoor space of objects such as people, animals, and electrical appliances.
  • an indoor positioning system can be formed to realize monitoring of indoor space of objects such as people, animals, and electrical appliances.
  • a sound acquiring device closest to the monitored object may be determined from all the sound acquiring devices bound to the monitoring device, and sent to the sound acquiring device.
  • the acquisition instruction commands the sound acquisition device to collect the sound emitted by the monitored object.
  • the position of the monitored object that emits the sound is determined by the image recognition technology, and the sound acquiring device for monitoring the monitored object that emits the sound is determined according to the range of the monitoring area corresponding to the sound acquiring device.
  • Each sound acquisition device has its own corresponding range of the monitoring area, and the monitoring range data of all the sound acquiring devices is recorded into the monitoring device. Then, the monitoring device can determine which sound acquiring device is monitored by the monitored object that emits the sound through the monitoring screen. Within the area, the sound acquisition device for monitoring the monitored object is determined.
  • FIG. 2J is a schematic diagram showing a sound acquiring device for monitoring a monitored object for sounding according to an exemplary embodiment
  • the monitoring device 10a and the monitoring device 10b are respectively installed at the corners, and the monitoring device 10a and the monitoring device 10b are connected to each other through a wireless or wired network to form an indoor positioning system.
  • the monitoring device 10a determines through the monitoring screen that only one sound acquiring device is in the monitored screen, but the television 15 is not in the listening area range 19a of the sound 19.
  • the monitoring device 10a sends an inquiry command to the monitoring device 10b for inquiring the monitoring device 10b whether there is a mobile device bound to all the monitoring devices in the screen monitored by the monitoring device 10b.
  • the monitoring device 10b determines the cleaning robot 23 bound to all the monitoring devices in the corresponding monitoring screen, and sends a movement instruction to the cleaning robot 23, instructing the cleaning robot 23 to move to the monitoring screen of the monitoring device 10a.
  • the movement instruction and the acquisition instruction wherein the movement instruction can be used to control the cleaning robot 23 to move to a position near the position where the television 15 is located, so that the television 15 is in the monitoring area range 23a of the cleaning robot 23, and the acquisition instruction is used to control the control of the cleaning robot 23
  • the sound from the television set 15 is collected.
  • the monitoring device 10b determines through the monitoring screen that there are two sound acquiring devices, the mobile phone 21 and the cleaning robot 23, in which the dog 13 is in the mobile phone.
  • the monitoring device 10b can send an acquisition instruction to the mobile phone 21 to instruct the mobile phone 21 to collect the sound emitted by the dog 13;
  • the monitoring device 10b can also send a movement command and an acquisition command to the cleaning robot 23, wherein the movement command can be used to control the movement of the cleaning robot 23 to the vicinity of the position where the dog 13 is located, so that the dog 13 is in the cleaning robot 23
  • the acquisition command is used to control the collection of the sound emitted by the dog 13 by the cleaning robot 23.
  • step 103 may include The following three ways:
  • the sound acquiring device that meets the predetermined condition is the sound acquiring device closest to the monitored object that emits the sound
  • the sound acquiring device is controlled to collect the sound.
  • an acquisition command may be sent to the sound acquiring device closest to the monitored object that emits the sound, and the collecting instruction is used to command the sound.
  • the acquisition device collects the sound emitted by the monitored object.
  • the sound receiving device is controlled to continue collecting sound.
  • the acquiring command may be sent to the sound acquiring device with the strongest sound signal, and the collecting command is used to command the sound signal to be the strongest.
  • the sound acquisition device collects the sound emitted by the monitored object.
  • a third mode 103c when the sound acquiring device that meets the predetermined condition is a mobile device that is bound to the monitoring device, the mobile device is controlled to move to the position of the monitored object that emits sound in the monitoring screen, and the mobile device is controlled to be monitored. The sound at the location of the object.
  • the monitoring device may issue a move instruction and a capture instruction to the mobile device, where the move instruction may be used to control the mobile device to move to In the vicinity of the position of the monitored object that emits sound in the monitoring screen, the acquisition command is used to control the mobile device to collect the sound emitted by the monitored object.
  • FIG. 2L is a schematic diagram of a monitoring device controlling a mobile device to move to a position of a monitored object that emits a sound in a monitoring screen according to an exemplary embodiment, as shown in FIG. 2L, when the monitoring device 10 cannot detect The sound of the cat 12, and determines that the sound acquiring device is in compliance with the predetermined condition, and the remote control is bound to the monitoring device 10
  • the monitoring device 10 can issue a movement command and an acquisition command to the remote control helicopter 22 or the cleaning robot 23, wherein the movement command can be used to control the remote control helicopter 22 or the cleaning robot 23 to move to a position near the cat 12.
  • the acquisition command is used to control the remote control helicopter 22 or the cleaning robot 23 to collect the sound emitted by the cat 12.
  • FIG. 3 is a block diagram of a monitoring picture sound collecting apparatus according to an exemplary embodiment.
  • the monitoring picture sound collecting apparatus includes, but is not limited to, a detecting module 201, a determining module 202, and a control module 203.
  • the detecting module 201 is configured to detect, when the monitoring camera captures the monitoring screen, whether there is a monitored object that emits a sound in the monitoring screen;
  • the determining module 202 is configured to: when the detecting module 201 detects that there is a monitored object that emits sound in the monitoring screen, determine a sound acquiring device that meets a predetermined condition, and the predetermined condition is a sound of the monitored object collected by the sound acquiring device.
  • the signal strength is greater than the sound signal strength of the monitored object collected by the monitoring device;
  • the control module 203 is configured to control the sound acquiring device determined by the determining module 203 to collect the sound emitted by the monitored object.
  • FIG. 4 is a block diagram of a monitoring picture sound collecting apparatus according to another exemplary embodiment.
  • the detecting module 201 includes: The detection submodule 201a, the second detection submodule 201b, and the third detection submodule 201c.
  • the first detecting sub-module 201a is configured to detect whether there is an image change element that emits a sound in the monitoring screen, and the image change element includes the monitored object that has entered the monitoring screen or the monitored object whose mouth shape changes; or
  • the second detecting submodule 201b is configured to detect whether a specified type object in the monitoring screen emits a sound, and the specified type object includes at least one of a door, a window, and a home appliance; or
  • the third detecting sub-module 201c is configured to detect, according to the specified indicator reported by the other monitoring device, whether there is a monitored object that emits a sound in the monitoring screen, and the monitoring device is a device for monitoring the specified indicator bound to the monitoring device, and the designated device
  • the indicators are switch status, air quality parameters, temperature, heat source change parameters or physiological characteristic parameters.
  • the determining module 202 includes: a fourth detecting submodule 202a and a first determining submodule 202b.
  • the fourth detecting sub-module 202a is configured to detect whether the sound corresponding to the monitoring screen collected by the monitoring device is less than a predetermined sound threshold
  • the first determining sub-module 202b is configured to determine, when the fourth detecting sub-module 202a detects that the sound corresponding to the monitoring screen collected by the monitoring device is less than a predetermined sound threshold, determine the sound acquiring device that meets the predetermined condition.
  • the first determining submodule 202b includes: a first obtaining submodule 202b1, a second obtaining submodule 202b2, and a second determining submodule 202b3.
  • the first obtaining submodule 202b1 is configured to acquire and send from all the sound acquiring devices bound to the monitoring device. a sound acquiring device that is the closest to the monitored object of the sound, and determines the obtained sound acquiring device as a sound acquiring device that meets a predetermined condition; or
  • the second obtaining sub-module 202b2 is configured to control all the sound acquiring devices bound to the monitoring device to collect the sound emitted by the monitored object that emits the sound, and determine the sound acquiring device that collects the strongest sound signal to meet the predetermined condition. Sound acquisition device; or,
  • the second determining submodule 202b3 is configured to determine at least one mobile device bound to the monitoring device as a sound acquiring device that meets a predetermined condition.
  • the first obtaining submodule 202b1 includes: a third determining submodule 202b1a and a fourth determining submodule 202b1b.
  • the third determining submodule 202b1a is configured to determine, by using an indoor positioning technology, a sound acquiring device that is closest to the monitored object that emits sound from all the sound acquiring devices that are bound to the monitoring device; or
  • the fourth determining sub-module 202b1b is configured to determine, by using an image recognition technology, a location of the monitored object that emits the sound, and determine a sound of the monitored object for monitoring the sound according to the range of the monitoring area corresponding to the sound acquiring device. Get the device.
  • control module 203 includes: a first control submodule 203a, a second control submodule 203b, and a third control submodule 203c.
  • the first control sub-module 203a is configured to control the sound acquiring device to collect sound when the sound acquiring device meeting the predetermined condition is the sound acquiring device closest to the monitored object that emits the sound;
  • the second control sub-module 203b is configured to control the sound acquiring device to continue collecting sound when the sound acquiring device meeting the predetermined condition is the sound acquiring device that collects the strongest sound signal;
  • the third control sub-module 203c is configured to, when the sound acquiring device meeting the predetermined condition is a mobile device bound to the monitoring device, control the mobile device to move to a position of the monitored object that emits sound in the monitoring screen, and control the movement The device collects the sound at the location of the monitored object.
  • the monitoring picture sound collecting device determines the monitored object that emits a sound in the monitoring screen, and controls the collected sound signal intensity of the monitored object to be greater than the monitored information collected by the monitoring device.
  • the sound acquiring device of the sound signal intensity of the object collects the sound emitted by the monitored object; solves the problem that the monitoring device cannot clearly obtain the sound emitted by the monitored object far away from the monitoring device; and the monitoring device controls the sound acquiring device to be collected. Monitor the sound emitted by the object to make the monitored information comprehensive.
  • the sound acquiring device that meets the predetermined condition may be sent an acquisition instruction, and the sound acquiring device is instructed to collect the monitored object, wherein the predetermined condition may be the distance being The monitored object is the closest, or the sound signal collected is the strongest, or the mobile device bound to the monitoring device.
  • An exemplary embodiment of the present disclosure provides a monitoring picture sound collection device, which can implement the monitoring picture sound collection method provided by the present disclosure.
  • the monitoring picture sound collection device includes: a processor, a memory for storing processor executable instructions;
  • processor is configured to:
  • the monitoring screen of the monitoring device collects the monitoring screen, it is detected whether there is a monitored object that emits sound in the monitoring screen;
  • the sound acquiring device that meets the predetermined condition is determined, and the predetermined condition is that the sound signal intensity of the monitored object collected by the sound acquiring device is greater than the sound of the monitored object collected by the monitoring device.
  • the sound acquisition device is controlled to collect the sound emitted by the monitored object.
  • FIG. 5 is a block diagram for collecting sound of a monitoring picture, according to an exemplary embodiment.
  • device 400 can be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a gaming console, a tablet device, a medical device, a fitness device, a personal digital assistant, and the like.
  • apparatus 400 can include one or more of the following components: processing component 402, memory 404, power component 406, multimedia component 408, audio component 410, input/output (I/O) interface 412, sensor component 414, and Communication component 416.
  • Processing component 402 typically controls the overall operation of device 400, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations.
  • Processing component 402 can include one or more processors 418 to execute instructions to perform all or part of the steps described above.
  • processing component 402 can include one or more modules to facilitate interaction between component 402 and other components.
  • processing component 402 can include a multimedia module to facilitate interaction between multimedia component 408 and processing component 402.
  • Memory 404 is configured to store various types of data to support operation at device 400. Examples of such data include instructions for any application or method operating on device 400, contact data, phone book data, messages, pictures, videos, and the like. Memory 404 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable. Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Disk or Optical Disk.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read only memory
  • EPROM Programmable Read Only Memory
  • PROM Programmable Read Only Memory
  • ROM Read Only Memory
  • Magnetic Memory Flash Memory
  • Disk Disk or Optical Disk.
  • Power component 406 provides power to various components of device 400.
  • Power component 406 can include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for device 400.
  • the multimedia component 408 includes a screen between the device 400 and the user that provides an output interface.
  • the screen can include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user.
  • the touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor can sense not only the boundaries of the touch or sliding action, but also the duration and pressure associated with the touch or slide operation.
  • the multimedia component The 408 includes a front camera and/or a rear camera. When the device 400 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.
  • the audio component 410 is configured to output and/or input an audio signal.
  • audio component 410 includes a microphone (MIC) that is configured to receive an external audio signal when device 400 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode.
  • the received audio signal may be further stored in memory 404 or transmitted via communication component 416.
  • audio component 410 also includes a speaker for outputting an audio signal.
  • the I/O interface 412 provides an interface between the processing component 402 and the peripheral interface module, which may be a keyboard, a click wheel, a button, or the like. These buttons may include, but are not limited to, a home button, a volume button, a start button, and a lock button.
  • Sensor assembly 414 includes one or more sensors for providing status assessment of various aspects to device 400.
  • sensor assembly 414 can detect an open/closed state of device 400, a relative positioning of components, such as a display and a keypad of device 400, and sensor component 414 can also detect a change in position of one component of device 400 or device 400, user The presence or absence of contact with device 400, device 400 orientation or acceleration/deceleration and temperature variation of device 400.
  • Sensor assembly 414 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact.
  • Sensor assembly 414 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications.
  • the sensor assembly 414 can also include an acceleration sensor, a gyro sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
  • Communication component 416 is configured to facilitate wired or wireless communication between device 400 and other devices.
  • the device 400 can access a wireless network based on a communication standard, such as Wi-Fi, 2G or 3G, or a combination thereof.
  • communication component 416 receives broadcast signals or broadcast associated information from an external broadcast management system via a broadcast channel.
  • communication component 416 also includes a near field communication (NFC) module to facilitate short range communication.
  • NFC near field communication
  • the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra-wideband
  • Bluetooth Bluetooth
  • device 400 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A gate array (FPGA), controller, microcontroller, microprocessor or other electronic component is implemented for performing the above-described monitoring picture sound collection method.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGA field programmable A gate array
  • controller microcontroller, microprocessor or other electronic component is implemented for performing the above-described monitoring picture sound collection method.
  • a non-transitory computer readable storage medium comprising instructions, such as a memory 404 comprising instructions executable by processor 418 of apparatus 400 to perform the above-described monitoring picture sound collection method.
  • the non-transitory computer readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device.

Abstract

本公开揭示了一种监控画面声音采集方法及装置，属于计算机技术领域。所述监控画面声音采集方法包括：在监控设备的摄像头采集到监控画面时，检测所述监控画面中是否存在发出声音的被监控对象；若所述监控画面中存在所述发出声音的被监控对象，则确定出符合预定条件的声音获取设备，所述预定条件为所述声音获取设备采集到的所述被监控对象的声音信号强度大于所述监控设备采集到的所述被监控对象的声音信号强度；控制所述声音获取设备采集所述被监控对象发出的声音。因此解决了监控设备无法清楚的获取距离监控设备较远的被监控对象所发出的声音的问题；达到了监控设备控制声音获取设备采集被监控对象发出的声音，使监控的信息全面的效果。

Description

监控画面声音采集方法及装置
本申请基于申请号为CN 201510462792.9、申请日为2015年7月31日的中国专利申请提出，并要求该中国专利申请的优先权，该中国专利申请的全部内容在此引入本申请作为参考。
技术领域
本公开涉及计算机技术领域，特别涉及一种监控画面声音采集方法及装置。
背景技术
由于摄像头可以真实的监控到各种事件发生的过程，因此摄像头的监控功能被应用地越来越广泛，比如交通监控、超市监控、小区监控等。
在利用监控设备上的摄像头进行监控时，如果拍摄的被监控对象比较远，该监控设备通常无法清楚的获取被监控对象所发出的声音，因此会导致监控的信息不全。
发明内容
为了解决监控设备无法清楚的获取距离监控设备较远的被监控对象所发出的声音的问题，本公开提供一种监控画面声音采集方法及装置。所述技术方案如下：
根据本公开实施例的第一方面，提供一种监控画面声音采集方法，所述方法包括：
在监控设备的摄像头采集到监控画面时，检测所述监控画面中是否存在发出声音的被监控对象；
若所述监控画面中存在所述发出声音的被监控对象，则确定出符合预定条件的声音获取设备，所述预定条件为所述声音获取设备采集到的所述被监控对象的声音信号强度大于所述监控设备采集到的所述被监控对象的声音信号强度；
控制所述声音获取设备采集所述被监控对象发出的声音。
可选的，所述检测所述监控画面中是否存在发出声音的被监控对象，包括：
检测所述监控画面中是否存在发出声音的图像变化元素，所述图像变化元素包括走入所述监控画面的被监控对象或口型发生变化的被监控对象；或，
检测所述监控画面中的指定类型对象是否发出声音，所述指定类型对象包括门、窗和家用电器中的至少一种；或，
根据其他监测设备上报的指定指标，检测所述监控画面中是否存在发出声音的被监控对象，所述监测设备是与所述监控设备绑定的用于监测所述指定指标的设备，所述指定指标为开关状态、空气质量参数、温度、热源变化参数或生理特征参数。
可选的，所述确定出符合预定条件的声音获取设备，包括：
检测所述监控设备采集到的所述监控画面所对应的声音是否小于预定声音阈值；
若所述监控设备采集到的所述监控画面所对应的声音小于所述预定声音阈值，则确定出符合所述预定条件的声音获取设备。
可选的，所述确定出符合预定条件的声音获取设备，包括：
从与所述监控设备绑定的所有声音获取设备中获取与所述发出声音的被监控对象最近的声音获取设备，将获取到的所述声音获取设备确定为符合所述预定条件的声音获取设备；或，
控制与所述监控设备绑定的所有声音获取设备采集发出声音的所述被监控对象所发出的声音，将采集到最强声音信号的声音获取设备确定为符合所述预定条件的声音获取设备；或，
将与所述监控设备绑定的至少一个移动设备确定为符合所述预定条件的声音获取设备。
可选的，所述从与所述监控设备绑定的所有声音获取设备中获取与所述发出声音的被监控对象最近的声音获取设备，包括：
通过室内定位技术从与所述监控设备绑定的所有声音获取设备中确定出与所述发出声音的被监控对象最近的声音获取设备；或，
通过图像识别技术确定出发出声音的所述被监控对象所在的位置，根据所述声音获取设备各自对应的监听区域范围，确定出用于监听发出声音的所述被监控对象的声音获取设备。
可选的，所述控制所述声音获取设备采集所述被监控对象发出的声音，包括：
当符合所述预定条件的声音获取设备为与发出声音的被监控对象最近的所述声音获取设备时，控制所述声音获取设备采集声音；
当符合所述预定条件的声音获取设备为所述采集到最强声音信号的声音获取设备时，控制所述声音获取设备继续采集声音；
当符合所述预定条件的声音获取设备为与所述监控设备绑定的移动设备时，控制所述移动设备移动至所述监控画面中发出声音的被监控对象的位置处，并控制所述移动设备采集所述被监控对象所在位置处的声音。
根据本公开实施例的第二方面，提供一种监控画面声音采集装置，所述装置包括：
检测模块，被配置为在监控设备的摄像头采集到监控画面时，检测所述监控画面中是否存在发出声音的被监控对象；
确定模块，被配置为在所述检测模块检测到所述监控画面中存在所述发出声音的被监控对象时，确定出符合预定条件的声音获取设备，所述预定条件为所述声音获取设备采集到的所述被监控对象的声音信号强度大于所述监控设备采集到的所述被监控对象的声音信号强度；
控制模块，被配置为控制所述确定模块确定出的所述声音获取设备采集所述被监控对象发出的声音。
可选的，所述检测模块，包括：
第一检测子模块，被配置为检测所述监控画面中是否存在发出声音的图像变化元素，所述图像变化元素包括走入所述监控画面的被监控对象或口型发生变化的被监控对象；或，
第二检测子模块，被配置为检测所述监控画面中的指定类型对象是否发出声音，所述指定类型对象包括门、窗和家用电器中的至少一种；或，
第三检测子模块，被配置为根据其他监测设备上报的指定指标，检测所述监控画面中是否存在发出声音的被监控对象，所述监测设备是与所述监控设备绑定的用于监测所述指定指标的设备，所述指定指标为开关状态、空气质量参数、温度、热源变化参数或生理特征参数。
可选的，所述确定模块，包括：
第四检测子模块，被配置为检测所述监控设备采集到的所述监控画面所对应的声音是否小于预定声音阈值；
第一确定子模块，被配置为当所述第四检测子模块检测到所述监控设备采集到的所述监控画面所对应的声音小于所述预定声音阈值时，确定出符合所述预定条件的声音获取设备。
可选的，所述确定子模块，包括：
第一获取子模块，被配置为从与所述监控设备绑定的所有声音获取设备中获取与所述发出声音的被监控对象最近的声音获取设备，将获取到的所述声音获取设备确定为符合所述预定条件的声音获取设备；或，
第二获取子模块，被配置为控制与所述监控设备绑定的所有声音获取设备采集发出声音的所述被监控对象所发出的声音，将采集到最强声音信号的声音获取设备确定为符合所述预定条件的声音获取设备；或，
第二确定子模块，被配置为将与所述监控设备绑定的至少一个移动设备确定为符合所述预定条件的声音获取设备。
可选的，所述第一获取子模块，包括：
第三确定子模块，被配置为通过室内定位技术从与所述监控设备绑定的所有声音获取设备中确定出与所述发出声音的被监控对象最近的声音获取设备；或，
第四确定子模块，被配置为通过图像识别技术确定出发出声音的所述被监控对象所在的位置，根据所述声音获取设备各自对应的监听区域范围，确定出用于监听发出声音的所述被监控对象的声音获取设备。
可选的，所述控制模块，包括：
第一控制子模块，被配置为当符合所述预定条件的声音获取设备为与发出声音的被监控对象最近的所述声音获取设备时，控制所述声音获取设备采集声音；
第二控制子模块，被配置为当符合所述预定条件的声音获取设备为所述采集到最强声 音信号的声音获取设备时，控制所述声音获取设备继续采集声音；
第三控制子模块，被配置为当符合所述预定条件的声音获取设备为与所述监控设备绑定的移动设备时，控制所述移动设备移动至所述监控画面中发出声音的被监控对象的位置处，并控制所述移动设备采集所述被监控对象所在位置处的声音。
根据本公开实施例的第三方面，提供一种监控画面声音采集装置，其特征在于，所述装置包括：
处理器；
用于存储所述处理器可执行指令的存储器；
其中，所述处理器被配置为：
在监控设备的摄像头采集到监控画面时，检测所述监控画面中是否存在发出声音的被监控对象；
若所述监控画面中存在所述发出声音的被监控对象，则确定出符合预定条件的声音获取设备，所述预定条件为所述声音获取设备采集到的所述被监控对象的声音信号强度大于所述监控设备采集到的所述被监控对象的声音信号强度；
控制所述声音获取设备采集所述被监控对象发出的声音。
本公开的实施例提供的技术方案可以包括以下有益效果：
通过在监控画面中确定出发出声音的被监控对象，控制采集到的被监控对象的声音信号强度大于监控设备采集到的被监控对象的声音信号强度的声音获取设备采集被监控对象发出的声音；解决了监控设备无法清楚的获取距离监控设备较远的被监控对象所发出的声音问题；达到了监控设备控制声音获取设备采集被监控对象发出的声音，使监控的信息全面的效果。
应当理解的是，以上的一般描述和后文的细节描述仅是示例性的，并不能限制本公开。
附图说明
此处的附图被并入说明书中并构成本说明书的一部分，示出了符合本公开的实施例，并于说明书一起用于解释本公开的原理。
图1是根据一示例性实施例示出的一种监控画面声音采集方法的流程图；
图2A是根据一示例性实施例示出的一种检测监控画面中是否存在发出声音的被监控对象的流程图；
图2B是根据一示例性实施例示出的检测监控画面中是否存在发出声音的被监控对象方法的流程图；
图2C是根据一示例性实施例示出的监控画面中走入被监控对象的示意图；
图2D是根据一示例性实施例示出的监控画面中存在口型发生变化的被监控对象的示意图；
图2E是根据一示例性实施例示出的监控画面中的指定类型对象发出声音的示意图；
图2F是根据一示例性实施例示出的根据其他监测设备上报的指定指标，检测监控画面中是否存在发出声音的被监控对象的示意图；
图2G是根据一示例性实施例示出的确定出符合预定条件的声音获取设备方法的流程图；
图2H是根据一示例性实施例示出的将采集到最强声音信号的声音获取设备确定为符合预定条件的声音获取设备的示意图；
图2I是根据一示例性实施例示出的从与监控设备绑定的所有声音获取设备中获取与监控画面中发出声音的被监控对象最近的声音获取设备方法的流程图；
图2J是根据一示例性实施例示出监控设备确定出用于监听发出声音的被监控对象的声音获取设备的示意图；
图2K是根据一示例性实施例示出的控制声音获取设备采集被监控对象发出的声音方法的流程图；
图2L是根据一示例性实施例示出的监控设备控制移动设备移动至监控画面中发出声音的被监控对象的位置处的示意图；
图3是根据一示例性实施例示出的一种监控画面声音采集装置的框图；
图4是根据另一示例性实施例示出的一种监控画面声音采集装置的框图；
图5是根据一示例性实施例示出的一种用于采集监控画面声音的框图。
具体实施方式
这里将详细地对示例性实施例进行说明，其示例表示在附图中。下面的描述涉及附图时，除非另有表示，不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本公开相一致的所有实施方式。相反，它们仅是与如所附权利要求书中所详述的、本公开的一些方面相一致的装置和方法的例子。
图1是根据一示例性实施例示出的一种监控画面声音采集方法的流程图，如图1所示，该监控画面声音采集方法包括以下步骤。
在步骤101中，在监控设备的摄像头采集到监控画面时，检测监控画面中是否存在发出声音的被监控对象。
通常监控设备不仅可以采集监控画面还可以采集监控画面中被监控对象发出的声音。
在步骤102中，若监控画面中存在发出声音的被监控对象，则确定出符合预定条件的声音获取设备，预定条件为声音获取设备采集到的被监控对象的声音信号强度大于监控设备采集到的被监控对象的声音信号强度。
目前，监控设备虽然可以清晰地采集监控画面，但对于监控画面中的被监控对象声音的采集效果略为不佳，比如监控画面中的被监控对象发出的声音非常微弱或者监控画面中的被监控对象距离监控设备较远，那么，该被监控对象的发出的声音可能无法被监控设备 清楚地采集到，甚至会被监控设备的自动过滤掉，此时，需要另外设置预定条件的声音获取设备来采集该被监控对象的声音。
这里所说的预定条件可以为声音获取设备采集到的被监控对象的声音信号强度大于监控设备采集到的被监控对象的声音信号强度，当预定条件满足时则开启该声音获取设备对该被监控对象声音的采集。
这里所说的声音获取设备可以为手机、音响、蓝牙耳机等具有声音采集器件的设备。
在步骤103中，控制声音获取设备采集被监控对象发出的声音。
当监控设备检测监控画面中的被监控对象发出声音，但被监控对象发出的声音太微弱或被监控对象距离监控设备较远，监控设备无法清楚地采集到被监控对象发出的声音，这时监控设备可以控制符合预定条件的声音获取设备对被监控对象发出的声音进行采集。
综上所述，本公开实施例中提供的监控画面声音采集方法，通过在监控画面中确定出发出声音的被监控对象，控制采集到的被监控对象的声音信号强度大于监控设备采集到的被监控对象的声音信号强度的声音获取设备采集被监控对象发出的声音；解决了监控设备无法清楚的获取距离监控设备较远的被监控对象所发出的声音问题；达到了监控设备控制声音获取设备采集被监控对象发出的声音，使监控的信息全面的效果。
在一种可能的实现方式中，可以将图1中的步骤102进一步替换为步骤102a至步骤102b。请参见图2A，其是根据一示例性实施例示出的一种检测监控画面中是否存在发出声音的被监控对象的流程图，如图2A所示，监控设备在检测监控画面中是否存在发出声音的被监控对象时，包括如下步骤。
在步骤102a中，检测监控设备采集到的监控画面所对应的声音是否小于预定声音阈值。
当监控画面中的被监控对象发出的声音非常微弱或者监控画面中的被监控对象距离监控设备较远，那么，该被监控对象的发出的声音可能无法被监控设备清楚地采集到，因此这里所说的预定声音阈值是监控设备是否能够清楚地采集到监控画面所对应的声音的临界值。当监控设备采集到的监控画面所对应的声音小于预定声音阈值时，则表明监控设备暂时无法采集到该监控画面所对应的声音。
在步骤102b中，若监控设备采集到的监控画面所对应的声音小于预定声音阈值，则确定出符合预定条件的声音获取设备。
当监控设备采集到的监控画面所对应的声音小于预定声音阈值时，说明监控设备暂时无法采集到该监控画面所对应的声音，因此需要确定出符合预定条件的声音获取设备，来代替监控设备对该监控画面所对应的声音进行采集。
综上所述，本公开实施例中提供的监控画面声音采集方法，通过在监控画面中确定出发出声音的被监控对象，控制采集到的被监控对象的声音信号强度大于监控设备采集到的被监控对象的声音信号强度的声音获取设备采集被监控对象发出的声音；解决了监控设备 无法清楚的获取距离监控设备较远的被监控对象所发出的声音问题；达到了监控设备控制声音获取设备采集被监控对象发出的声音，使监控的信息全面的效果。
另外，当监控设备无法清楚地采集到被监控对象发出声音时，可以向符合预定条件的声音获取设备发送采集指令，命令该声音获取设备对被监控对象进行采集，其中该预定条件可以为距离被监控对象最近，或采集的声音信号最强，或是与监控设备绑定的移动设备。
在一种可能的实现方式中，请参见图2B，其是根据一示例性实施例示出的检测监控画面中是否存在发出声音的被监控对象方法的流程图，如图2B所示，步骤101可以包括如下三种方式：
第一种方式101a，检测监控画面中是否存在发出声音的图像变化元素，图像变化元素包括走入监控画面的被监控对象或口型发生变化的被监控对象。
这里所说的图像变化元素可以是移动至监控画面中的人或物，也可以是人或动物嘴部的口型变化。
请参见图2C，其是根据一示例性实施例示出的监控画面中走入被监控对象的示意图，如图2C所示，当监控设备10所监控的画面中走入人11、猫12和狗13，那么监控设备10便可以将人11、猫12和狗13视为被监控对象；请参见图2D，其是根据一示例性实施例示出的监控画面中存在口型发生变化的被监控对象的示意图，如图2D所示，当监控设备10所监控的画面中人11a和人11b正在对话，那么监控设备10检测到人11a和人11b口型发生变化时，便可以将人11a和人11b视为被监控对象。
第二种方式101b，检测监控画面中的指定类型对象是否发出声音，指定类型对象包括门、窗和家用电器中的至少一种。
有时，当监控画面中门、窗和家用电器发出声音了，但监控画面并不会产生太大变化，比如有人敲门、电视开启、电风扇转动等，因此这里所说的指定类型对象是指自身不会移动，需要摄像头通过采集到的声音来判断需要获取声音的对象。
请参见图2E，其是根据一示例性实施例示出的监控画面中的指定类型对象发出声音的示意图，如图2E所示，当监控画面中的门14被敲响、电视机15开启和电风扇16转动时，虽然整个监控画面不会产生太大变化，但监控设备10仍可以根据敲门的声音、电视节目的声音、叶片转动的声音，将门14、电视机15、电风扇16视为被监控对象。
第三种方式101c，根据其他监测设备上报的指定指标，检测监控画面中是否存在发出声音的被监控对象，监测设备是与监控设备绑定的用于监测指定指标的设备，指定指标为开关状态、空气质量参数、温度、热源变化参数或生理特征参数。
当监控画面中的被监控对象发出的声音过于微弱时，监控设备可以借助监测设备来判断画面中的哪些被监控对象发出声音，这里所说的监测设备是安装在被监控对象周围或被监控对象上用于监控被监控对象状态的监测设备。
比如将监测设备安装在电器的开关上，当电器的开启时，监测设备就会将开启状态数 据反馈给监控设备，监控设备接收到数据后确定该电器为被监控对象，发送采集指令给符合条件的声音获取设备，命令符合条件的声音获取设备对该电器发出的声音进行采集。还比如将监测设备安装在窗户或门附近，当窗户或门被打开时，当监测设备感应到周围空气温度发生变化时，会将温度变化数据反馈给监控设备，监控设备接收到数据后确定窗户或门为被监控对象，发送采集指令给符合条件的声音获取设备，命令符合条件的声音获取设备对该电器发出的声音进行采集。
请参见图2F，其是根据一示例性实施例示出的根据其他监测设备上报的指定指标，检测监控画面中是否存在发出声音的被监控对象的示意图，如图2F所示，当监控画面中的门18被打开后，安装在门18上方的传感器17在感应到周围空气温度发生变化时，将温度变化数据反馈给监视设备10，监视设备10收到反馈数据后可以对符合条件的声音获取设备发送采集指令，命令符合条件的声音获取设备对门18发出的声音进行采集。
在一种可能的实现方式中，请参见图2G，其是根据一示例性实施例示出的确定出符合预定条件的声音获取设备方法的流程图，如图2G所示，确定出符合预定条件的声音获取设备，实际实现时，步骤102b可以包括如下三种方式：
第一种方式102b1，从与监控设备绑定的所有声音获取设备中获取与发出声音的被监控对象最近的声音获取设备，将获取到的声音获取设备确定为符合预定条件的声音获取设备。
当预定条件为最近距离时，监控设备可以通过监控画面确定出距离发出声音的被监控对象最近的声音获取设备，并将该声音获取设备确定为符合预定条件的声音获取设备。
第二种方式102b2，控制与监控设备绑定的所有声音获取设备采集发出声音的被监控对象所发出的声音，将采集到最强声音信号的声音获取设备确定为符合预定条件的声音获取设备。
当预定条件为最强声音信号时，监控设备可以通过向所有声音获取设备发送采集指令，该采集指令用于命令向所有声音获取设备对该监控画面中的被监控对象进行声音采集，所有声音获取设备接收到该采集指令后开始向该被监控对象进行声音采集，并将采集得到的声音发送给监控设备进行汇总测试，监控设备接收并测试所有声音获取设备采集的声音后，确定出采集声音信号最强的声音获取设备，并将该声音获取设备确定为符合预定条件的声音获取设备。
请参见图2H，其是根据一示例性实施例示出的将采集到最强声音信号的声音获取设备确定为符合预定条件的声音获取设备的示意图，如图2H所示，当监控画面中有音响19、蓝牙耳机20和手机21三个声音获取设备，当该监控画面中走入人11时，监控设备10将人11确定为被监控对象后，可以向音响19、蓝牙耳机20和手机21发送采集指令，这三个声音获取设备接收到该采集指令后，分别对人11发出的声音进行采集，并将采集到的声音发送给监控设备10，监控设备10对这三个声音获取设备采集的声音进行测试，确定 出采集声音信号最强的蓝牙耳机20，并将蓝牙耳机20确定为符合预定条件的声音获取设备。
第三种方式102b3，将与监控设备绑定的至少一个移动设备确定为符合预定条件的声音获取设备。
监控设备可以与移动终端、扫地机器人、遥控飞机等便于在室内移动的移动设备进行绑定，当被监控对象距离监控设备较远时，将这些移动设备确定为符合预定条件的声音获取设备。
在一种可能的实现方式中，请参见图2I，其是根据一示例性实施例示出的从与监控设备绑定的所有声音获取设备中获取与监控画面中发出声音的被监控对象最近的声音获取设备方法的流程图，如图2I所示，步骤102b中的第一种方式102b1可以包括如下两种方式：
第一种方式102b1a，通过室内定位技术从与监控设备绑定的所有声音获取设备中确定出与发出声音的被监控对象最近的声音获取设备。
监控设备可以安装在多个房间，将所有监控设备通过无线或有线网络相互连接，可以形成室内定位系统，实现对人员、动物、电器等物体在室内空间的监控。当某个监控设备的监控画面出现发出声音的监控对象时，可以将与监控设备绑定的所有声音获取设备中确定出一个距离该被监控对象最近的声音获取设备，并向该声音获取设备发送采集指令，命令该声音获取设备对该被监控对象发出的声音进行采集。
第二种方式102b1b，通过图像识别技术确定出发出声音的被监控对象所在的位置，根据声音获取设备各自对应的监听区域范围，确定出用于监听发出声音的被监控对象的声音获取设备。
每一个声音获取设备都有各自对应的监听区域范围，将所有声音获取设备的监听范围数据录入监控设备，那么，监控设备可以通过监控画面，确定发出声音的被监控对象处于哪个声音获取设备的监听区域范围内，以此确定用于监听该被监控对象的声音获取设备。
请参见图2J，其是根据一示例性实施例示出监控设备确定出用于监听发出声音的被监控对象的声音获取设备的示意图，如图2J所示，当前画面中有两处角落，这两处角落分别装有监控设备10a和监控设备10b，监控设备10a和监控设备10b通过无线或有线网络相互连接，形成室内定位系统。当处于监控设备10a所监控的画面中的电视机15被开启后，监控设备10a通过监控画面确定出所监控的画面中只有音响19一个声音获取设备，但电视机15不在音响19的监听区域范围19a内，此时监控设备10a向监控设备10b发送询问指令，该询问指令用于向监控设备10b询问在监控设备10b所监控的画面中是否存在与所有监控设备绑定的移动设备。监控设备10b接收到询问指令后，在对应的监控画面中确定出与所有监控设备绑定的扫地机器人23，并向扫地机器人23发送移动指令，命令扫地机器人23移动到监控设备10a的监控画面中，由监控设备10a向扫地机器人23发送移 动指令和采集指令，其中移动指令可以用于控制扫地机器人23移动至电视机15所在的位置附近，使电视机15处于扫地机器人23监听区域范围23a内，采集指令用于控制控制扫地机器人23对电视机15发出的声音进行采集。
仍参见图2J，当监控设备10b所监控的画面中走进狗13时，监控设备10b通过监控画面确定出所监控的画面中有手机21和扫地机器人23两个声音获取设备，其中狗13在手机21的的监听区域范围21a内，但不在扫地机器人23的监听区域范围23a内，此时监控设备10b可以向手机21发送采集指令，命令手机21对狗13所发出的声音进行采集；另外，为了获取更好的声音采集效果，监控设备10b也可以向扫地机器人23发送移动指令和采集指令，其中移动指令可以用于控制扫地机器人23移动至狗13所在的位置附近，使狗13处于扫地机器人23监听区域范围23a内，采集指令用于控制控制扫地机器人23对狗13所发出的声音进行采集。
在一种可能的实现方式中，请参见图2K，其是根据一示例性实施例示出的控制声音获取设备采集被监控对象发出的声音方法的流程图，如图2K所示，步骤103可以包括如下三种方式：
第一种方式103a，当符合预定条件的声音获取设备为与发出声音的被监控对象最近的声音获取设备时，控制声音获取设备采集声音。
当监控设备暂时无法采集到该监控画面中发出声音的被监控对象所对应的声音时，可以向距离发出声音的被监控对象最近的声音获取设备发出一条采集指令，该采集指令用于命令该声音获取设备对被监控对象发出的声音进行采集。
第二种方式103b，当符合预定条件的声音获取设备为采集到最强声音信号的声音获取设备时，控制声音获取设备继续采集声音。
当监控设备暂时无法采集到该监控画面中发出声音的被监控对象所对应的声音时，可以向采集声音信号最强的声音获取设备发送采集指令，该采集指令用于命令该采集声音信号最强的声音获取设备对被监控对象发出的声音进行采集。
第三种方式103c，当符合预定条件的声音获取设备为与监控设备绑定的移动设备时，控制移动设备移动至监控画面中发出声音的被监控对象的位置处，并控制移动设备采集被监控对象所在位置处的声音。
当监控设备确定出的符合预定条件的声音获取设备为与监控设备绑定的移动设备时，监控设备可以向该移动设备发出移动指令和采集指令，其中移动指令可以用于控制该移动设备移动至监控画面中发出声音的被监控对象的位置附近，采集指令用于控制移动设备对被监控对象发出的声音进行采集。
请参见图2L，其是根据一示例性实施例示出的监控设备控制移动设备移动至监控画面中发出声音的被监控对象的位置处的示意图，如图2L所示，当监控设备10无法检测到猫12发出的声音，并确定出符合预定条件声音获取设备为与该监控设备10绑定的遥控直 升机22和扫地机器人23时，监控设备10可以向遥控直升机22或扫地机器人23发出移动指令和采集指令，其中移动指令可以用于控制遥控直升机22或扫地机器人23移动到猫12所在的位置附近，采集指令用于控制遥控直升机22或扫地机器人23对猫12发出的声音进行采集。
下述为本公开装置实施例，可以用于执行本公开方法实施例。对于本公开装置实施例中未披露的细节，请参照本公开方法实施例。
图3是根据一示例性实施例示出的一种监控画面声音采集装置的框图，如图3所示，该监控画面声音采集装置包括但不限于：检测模块201、确定模块202和控制模块203。
检测模块201，被配置为在监控设备的摄像头采集到监控画面时，检测监控画面中是否存在发出声音的被监控对象；
确定模块202，被配置为在该检测模块201检测到监控画面中存在发出声音的被监控对象时，确定出符合预定条件的声音获取设备，预定条件为声音获取设备采集到的被监控对象的声音信号强度大于监控设备采集到的被监控对象的声音信号强度；
控制模块203，被配置为控制该确定模块203确定出的声音获取设备采集被监控对象发出的声音。
在一种可能的实现方式中，请参见图4，其是根据另一示例性实施例示出的一种监控画面声音采集装置的框图，如图4所示，该检测模块201，包括：第一检测子模块201a、第二检测子模块201b和第三检测子模块201c。
第一检测子模块201a，被配置为检测监控画面中是否存在发出声音的图像变化元素，图像变化元素包括走入监控画面的被监控对象或口型发生变化的被监控对象；或，
第二检测子模块201b，被配置为检测监控画面中的指定类型对象是否发出声音，指定类型对象包括门、窗和家用电器中的至少一种；或，
第三检测子模块201c，被配置为根据其他监测设备上报的指定指标，检测监控画面中是否存在发出声音的被监控对象，监测设备是与监控设备绑定的用于监测指定指标的设备，指定指标为开关状态、空气质量参数、温度、热源变化参数或生理特征参数。
在一种可能的实现方式中，仍旧参见图4所示，该确定模块202，包括：第四检测子模块202a和第一确定子模块202b。
第四检测子模块202a，被配置为检测监控设备采集到的监控画面所对应的声音是否小于预定声音阈值；
第一确定子模块202b，被配置为当该第四检测子模块202a检测到监控设备采集到的监控画面所对应的声音小于预定声音阈值时，确定出符合预定条件的声音获取设备。
在一种可能的实现方式中，仍旧参见图4所示，该第一确定子模块202b，包括：第一获取子模块202b1、第二获取子模块202b2和第二确定子模块202b3。
第一获取子模块202b1，被配置为从与监控设备绑定的所有声音获取设备中获取与发 出声音的被监控对象最近的声音获取设备，将获取到的声音获取设备确定为符合预定条件的声音获取设备；或，
第二获取子模块202b2，被配置为控制与监控设备绑定的所有声音获取设备采集发出声音的被监控对象所发出的声音，将采集到最强声音信号的声音获取设备确定为符合预定条件的声音获取设备；或，
第二确定子模块202b3，被配置为将与监控设备绑定的至少一个移动设备确定为符合预定条件的声音获取设备。
在一种可能的实现方式中，仍旧参见图4所示，该第一获取子模块202b1，包括：第三确定子模块202b1a和第四确定子模块202b1b。
第三确定子模块202b1a，被配置为通过室内定位技术从与监控设备绑定的所有声音获取设备中确定出与发出声音的被监控对象最近的声音获取设备；或，
第四确定子模块202b1b，被配置为通过图像识别技术确定出发出声音的被监控对象所在的位置，根据声音获取设备各自对应的监听区域范围，确定出用于监听发出声音的被监控对象的声音获取设备。
在一种可能的实现方式中，仍旧参见图4所示，该控制模块203，包括：第一控制子模块203a、第二控制子模块203b和第三控制子模块203c。
第一控制子模块203a，被配置为当符合预定条件的声音获取设备为与发出声音的被监控对象最近的声音获取设备时，控制声音获取设备采集声音；
第二控制子模块203b，被配置为当符合预定条件的声音获取设备为采集到最强声音信号的声音获取设备时，控制声音获取设备继续采集声音；
第三控制子模块203c，被配置为当符合预定条件的声音获取设备为与监控设备绑定的移动设备时，控制移动设备移动至监控画面中发出声音的被监控对象的位置处，并控制移动设备采集被监控对象所在位置处的声音。
综上所述，本公开实施例中提供的监控画面声音采集装置，在监控画面中确定出发出声音的被监控对象，控制采集到的被监控对象的声音信号强度大于监控设备采集到的被监控对象的声音信号强度的声音获取设备采集被监控对象发出的声音；解决了监控设备无法清楚的获取距离监控设备较远的被监控对象所发出的声音问题；达到了监控设备控制声音获取设备采集被监控对象发出的声音，使监控的信息全面的效果。
另外，当监控设备无法清楚地采集到被监控对象发出声音时，可以向符合预定条件的声音获取设备发送采集指令，命令该声音获取设备对被监控对象进行采集，其中该预定条件可以为距离被监控对象最近，或采集的声音信号最强，或是与监控设备绑定的移动设备。
关于上述实施例中的装置，其中各个模块执行操作的具体方式已经在有关该方法的实施例中进行了详细描述，此处将不做详细阐述说明。
本公开一示例性实施例提供了一种监控画面声音采集装置，能够实现本公开提供的监控画面声音采集方法，监控画面声音采集装置包括：处理器、用于存储处理器可执行指令的存储器；
其中，处理器被配置为：
在监控设备的摄像头采集到监控画面时，检测监控画面中是否存在发出声音的被监控对象；
若监控画面中存在发出声音的被监控对象，则确定出符合预定条件的声音获取设备，预定条件为声音获取设备采集到的被监控对象的声音信号强度大于监控设备采集到的被监控对象的声音信号强度；
控制声音获取设备采集被监控对象发出的声音。
图5是根据一示例性实施例示出的一种用于采集监控画面声音的框图。例如，装置400可以是移动电话，计算机，数字广播终端，消息收发设备，游戏控制台，平板设备，医疗设备，健身设备，个人数字助理等。
参照图5，装置400可以包括以下一个或多个组件：处理组件402，存储器404，电源组件406，多媒体组件408，音频组件410，输入/输出(I/O)接口412，传感器组件414，以及通信组件416。
处理组件402通常控制装置400的整体操作，诸如与显示，电话呼叫，数据通信，相机操作和记录操作相关联的操作。处理组件402可以包括一个或多个处理器418来执行指令，以完成上述的方法的全部或部分步骤。此外，处理组件402可以包括一个或多个模块，便于处理组件402和其他组件之间的交互。例如，处理组件402可以包括多媒体模块，以方便多媒体组件408和处理组件402之间的交互。
存储器404被配置为存储各种类型的数据以支持在装置400的操作。这些数据的示例包括用于在装置400上操作的任何应用程序或方法的指令，联系人数据，电话簿数据，消息，图片，视频等。存储器404可以由任何类型的易失性或非易失性存储设备或者它们的组合实现，如静态随机存取存储器(SRAM)，电可擦除可编程只读存储器(EEPROM)，可擦除可编程只读存储器(EPROM)，可编程只读存储器(PROM)，只读存储器(ROM)，磁存储器，快闪存储器，磁盘或光盘。
电源组件406为装置400的各种组件提供电力。电源组件406可以包括电源管理系统，一个或多个电源，及其他与为装置400生成、管理和分配电力相关联的组件。
多媒体组件408包括在装置400和用户之间的提供一个输出接口的屏幕。在一些实施例中，屏幕可以包括液晶显示器(LCD)和触摸面板(TP)。如果屏幕包括触摸面板，屏幕可以被实现为触摸屏，以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。触摸传感器可以不仅感测触摸或滑动动作的边界，而且还检测与触摸或滑动操作相关的持续时间和压力。在一些实施例中，多媒体组件 408包括一个前置摄像头和/或后置摄像头。当装置400处于操作模式，如拍摄模式或视频模式时，前置摄像头和/或后置摄像头可以接收外部的多媒体数据。每个前置摄像头和后置摄像头可以是一个固定的光学透镜系统或具有焦距和光学变焦能力。
音频组件410被配置为输出和/或输入音频信号。例如，音频组件410包括一个麦克风(MIC)，当装置400处于操作模式，如呼叫模式、记录模式和语音识别模式时，麦克风被配置为接收外部音频信号。所接收的音频信号可以被进一步存储在存储器404或经由通信组件416发送。在一些实施例中，音频组件410还包括一个扬声器，用于输出音频信号。
I/O接口412为处理组件402和外围接口模块之间提供接口，上述外围接口模块可以是键盘，点击轮，按钮等。这些按钮可包括但不限于：主页按钮、音量按钮、启动按钮和锁定按钮。
传感器组件414包括一个或多个传感器，用于为装置400提供各个方面的状态评估。例如，传感器组件414可以检测到装置400的打开/关闭状态，组件的相对定位，例如组件为装置400的显示器和小键盘，传感器组件414还可以检测装置400或装置400一个组件的位置改变，用户与装置400接触的存在或不存在，装置400方位或加速/减速和装置400的温度变化。传感器组件414可以包括接近传感器，被配置用来在没有任何的物理接触时检测附近物体的存在。传感器组件414还可以包括光传感器，如CMOS或CCD图像传感器，用于在成像应用中使用。在一些实施例中，该传感器组件414还可以包括加速度传感器，陀螺仪传感器，磁传感器，压力传感器或温度传感器。
通信组件416被配置为便于装置400和其他设备之间有线或无线方式的通信。装置400可以接入基于通信标准的无线网络，如Wi-Fi，2G或3G，或它们的组合。在一个示例性实施例中，通信组件416经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。在一个示例性实施例中，通信组件416还包括近场通信(NFC)模块，以促进短程通信。例如，在NFC模块可基于射频识别(RFID)技术，红外数据协会(IrDA)技术，超宽带(UWB)技术，蓝牙(BT)技术和其他技术来实现。
在示例性实施例中，装置400可以被一个或多个应用专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其他电子元件实现，用于执行上述监控画面声音采集方法。
在示例性实施例中，还提供了一种包括指令的非临时性计算机可读存储介质，例如包括指令的存储器404，上述指令可由装置400的处理器418执行以完成上述监控画面声音采集方法。例如，非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。
本领域技术人员在考虑说明书及实践这里公开的发明后，将容易想到本公开的其它实 施方案。本申请旨在涵盖本公开的任何变型、用途或者适应性变化，这些变型、用途或者适应性变化遵循本公开的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的，本公开的真正范围和精神由下面的权利要求指出。
应当理解的是，本公开并不局限于上面已经描述并在附图中示出的精确结构，并且可以在不脱离其范围进行各种修改和改变。本公开的范围仅由所附的权利要求来限制。

Claims (13)

  1. 一种监控画面声音采集方法，其特征在于，所述方法包括：
    在监控设备的摄像头采集到监控画面时，检测所述监控画面中是否存在发出声音的被监控对象；
    若所述监控画面中存在所述发出声音的被监控对象，则确定出符合预定条件的声音获取设备，所述预定条件为所述声音获取设备采集到的所述被监控对象的声音信号强度大于所述监控设备采集到的所述被监控对象的声音信号强度；
    控制所述声音获取设备采集所述被监控对象发出的声音。
  2. 根据权利要求1所述的方法，其特征在于，所述检测所述监控画面中是否存在发出声音的被监控对象，包括：
    检测所述监控画面中是否存在发出声音的图像变化元素，所述图像变化元素包括走入所述监控画面的被监控对象或口型发生变化的被监控对象；或，
    检测所述监控画面中的指定类型对象是否发出声音，所述指定类型对象包括门、窗和家用电器中的至少一种；或，
    根据其他监测设备上报的指定指标，检测所述监控画面中是否存在发出声音的被监控对象，所述监测设备是与所述监控设备绑定的用于监测所述指定指标的设备，所述指定指标为开关状态、空气质量参数、温度、热源变化参数或生理特征参数。
  3. 根据权利要求1所述的方法，其特征在于，所述确定出符合预定条件的声音获取设备，包括：
    检测所述监控设备采集到的所述监控画面所对应的声音是否小于预定声音阈值；
    若所述监控设备采集到的所述监控画面所对应的声音小于所述预定声音阈值，则确定出符合所述预定条件的声音获取设备。
  4. 根据权利要求3所述的方法，其特征在于，所述确定出符合预定条件的声音获取设备，包括：
    从与所述监控设备绑定的所有声音获取设备中获取与所述发出声音的被监控对象最近的声音获取设备，将获取到的所述声音获取设备确定为符合所述预定条件的声音获取设备；或，
    控制与所述监控设备绑定的所有声音获取设备采集发出声音的所述被监控对象所发出的声音，将采集到最强声音信号的声音获取设备确定为符合所述预定条件的声音获取设备；或，
    将与所述监控设备绑定的至少一个移动设备确定为符合所述预定条件的声音获取设备。
  5. 根据权利要求4所述的方法，其特征在于，所述从与所述监控设备绑定的所有声音获取设备中获取与所述发出声音的被监控对象最近的声音获取设备，包括：
    通过室内定位技术从与所述监控设备绑定的所有声音获取设备中确定出与所述发出声音的被监控对象最近的声音获取设备；或，
    通过图像识别技术确定出发出声音的所述被监控对象所在的位置，根据所述声音获取设备各自对应的监听区域范围，确定出用于监听发出声音的所述被监控对象的声音获取设备。
  6. 根据权利要求1至5中任一所述的方法，其特征在于，所述控制所述声音获取设备采集所述被监控对象发出的声音，包括：
    当符合所述预定条件的声音获取设备为与发出声音的被监控对象最近的所述声音获取设备时，控制所述声音获取设备采集声音；
    当符合所述预定条件的声音获取设备为所述采集到最强声音信号的声音获取设备时，控制所述声音获取设备继续采集声音；
    当符合所述预定条件的声音获取设备为与所述监控设备绑定的移动设备时，控制所述移动设备移动至所述监控画面中发出声音的被监控对象的位置处，并控制所述移动设备采集所述被监控对象所在位置处的声音。
  7. 一种监控画面声音采集装置，其特征在于，所述装置包括：
    检测模块，被配置为在监控设备的摄像头采集到监控画面时，检测所述监控画面中是否存在发出声音的被监控对象；
    确定模块，被配置为在所述检测模块检测到所述监控画面中存在所述发出声音的被监控对象时，确定出符合预定条件的声音获取设备，所述预定条件为所述声音获取设备采集到的所述被监控对象的声音信号强度大于所述监控设备采集到的所述被监控对象的声音信号强度；
    控制模块，被配置为控制所述确定模块确定出的所述声音获取设备采集所述被监控对象发出的声音。
  8. 根据权利要求7所述的装置，其特征在于，所述检测模块，包括：
    第一检测子模块，被配置为检测所述监控画面中是否存在发出声音的图像变化元素，所述图像变化元素包括走入所述监控画面的被监控对象或口型发生变化的被监控对象；或，
    第二检测子模块，被配置为检测所述监控画面中的指定类型对象是否发出声音，所述指定类型对象包括门、窗和家用电器中的至少一种；或，
    第三检测子模块，被配置为根据其他监测设备上报的指定指标，检测所述监控画面中是否存在发出声音的被监控对象，所述监测设备是与所述监控设备绑定的用于监测所述指定指标的设备，所述指定指标为开关状态、空气质量参数、温度、热源变化参数或生理特征参数。
  9. 根据权利要求7所述的装置，其特征在于，所述确定模块，包括：
    第四检测子模块，被配置为检测所述监控设备采集到的所述监控画面所对应的声音是否小于预定声音阈值；
    第一确定子模块，被配置为当所述第四检测子模块检测到所述监控设备采集到的所述监控画面所对应的声音小于所述预定声音阈值时，确定出符合所述预定条件的声音获取设备。
  10. 根据权利要求9所述的装置，其特征在于，所述第一确定子模块，包括：
    第一获取子模块，被配置为从与所述监控设备绑定的所有声音获取设备中获取与所述发出声音的被监控对象最近的声音获取设备，将获取到的所述声音获取设备确定为符合所述预定条件的声音获取设备；或，
    第二获取子模块，被配置为控制与所述监控设备绑定的所有声音获取设备采集发出声音的所述被监控对象所发出的声音，将采集到最强声音信号的声音获取设备确定为符合所述预定条件的声音获取设备；或，
    第二确定子模块，被配置为将与所述监控设备绑定的至少一个移动设备确定为符合所述预定条件的声音获取设备。
  11. 根据权利要求10所述的装置，其特征在于，所述第一获取子模块，包括：
    第三确定子模块，被配置为通过室内定位技术从与所述监控设备绑定的所有声音获取设备中确定出与所述发出声音的被监控对象最近的声音获取设备；或，
    第四确定子模块，被配置为通过图像识别技术确定出发出声音的所述被监控对象所在的位置，根据所述声音获取设备各自对应的监听区域范围，确定出用于监听发出声音的所述被监控对象的声音获取设备。
  12. 根据权利要求7至11中任一所述的装置，其特征在于，所述控制模块，包括：
    第一控制子模块，被配置为当符合所述预定条件的声音获取设备为与发出声音的被监控对象最近的所述声音获取设备时，控制所述声音获取设备采集声音；
    第二控制子模块，被配置为当符合所述预定条件的声音获取设备为所述采集到最强声音信号的声音获取设备时，控制所述声音获取设备继续采集声音；
    第三控制子模块，被配置为当符合所述预定条件的声音获取设备为与所述监控设备绑 定的移动设备时，控制所述移动设备移动至所述监控画面中发出声音的被监控对象的位置处，并控制所述移动设备采集所述被监控对象所在位置处的声音。
  13. 一种监控画面声音采集装置，其特征在于，所述装置包括：
    处理器；
    用于存储所述处理器可执行指令的存储器；
    其中，所述处理器被配置为：
    在监控设备的摄像头采集到监控画面时，检测所述监控画面中是否存在发出声音的被监控对象；
    若所述监控画面中存在所述发出声音的被监控对象，则确定出符合预定条件的声音获取设备，所述预定条件为所述声音获取设备采集到的所述被监控对象的声音信号强度大于所述监控设备采集到的所述被监控对象的声音信号强度；
    控制所述声音获取设备采集所述被监控对象发出的声音。
PCT/CN2015/098720 2015-07-31 2015-12-24 监控画面声音采集方法及装置 WO2017020507A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
MX2016004997A MX362891B (es) 2015-07-31 2015-12-24 Metodo y dispositivo para colectar sonidos correspondientes a imagenes de vigilancia.
JP2017531954A JP6386187B2 (ja) 2015-07-31 2015-12-24 監視画面サウンド採集方法、装置、プログラムおよび記録媒体
KR1020167004628A KR101770930B1 (ko) 2015-07-31 2015-12-24 모니터링 화면 소리 수집 방법, 장치, 프로그램 및 컴퓨터 판독가능한 기록매체
RU2016115037A RU2638763C2 (ru) 2015-07-31 2015-12-24 Способ и устройство для улавливания звуков, соответствующих изображениям наблюдения

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510462792.9 2015-07-31
CN201510462792.9A CN105049807B (zh) 2015-07-31 2015-07-31 监控画面声音采集方法及装置

Publications (1)

Publication Number Publication Date
WO2017020507A1 true WO2017020507A1 (zh) 2017-02-09

Family

ID=54455959

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/098720 WO2017020507A1 (zh) 2015-07-31 2015-12-24 监控画面声音采集方法及装置

Country Status (8)

Country Link
US (1) US10354678B2 (zh)
EP (1) EP3125152B1 (zh)
JP (1) JP6386187B2 (zh)
KR (1) KR101770930B1 (zh)
CN (1) CN105049807B (zh)
MX (1) MX362891B (zh)
RU (1) RU2638763C2 (zh)
WO (1) WO2017020507A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10354678B2 (en) 2015-07-31 2019-07-16 Xiaomi Inc. Method and device for collecting sounds corresponding to surveillance images

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017102085A (ja) * 2015-12-04 2017-06-08 キヤノン株式会社 情報処理装置、情報処理方法及びプログラム
CN105657362A (zh) * 2015-12-30 2016-06-08 广州励丰文化科技股份有限公司 地板受力与多麦克风场景下的监控方法及系统
CN105828038A (zh) * 2016-03-31 2016-08-03 顾佳捷 基于can总线的工业现场多媒体无线监控系统及方法
CN108319965A (zh) * 2018-03-28 2018-07-24 江苏珩图智能科技有限公司 一种利用图像获取声音的装置及方法
CN110933254B (zh) * 2019-12-11 2021-09-07 杭州叙简科技股份有限公司 一种基于图像分析的声音过滤系统及其声音过滤方法
CN113763657B (zh) * 2020-06-04 2023-04-21 浙江宇视科技有限公司 监控警报装置、监控警报控制方法及监控系统
CN115499568B (zh) * 2022-09-09 2024-03-05 深圳市云起光电有限公司 一种基于智能家具系统的安防摄像头

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102056053A (zh) * 2010-12-17 2011-05-11 中兴通讯股份有限公司 一种多话筒混音方法及装置
US20120002047A1 (en) * 2010-07-01 2012-01-05 Kwang Ho An Monitoring camera and method of tracing sound source
CN103595953A (zh) * 2013-11-14 2014-02-19 华为技术有限公司 一种控制视频拍摄的方法和装置
CN103841360A (zh) * 2013-12-11 2014-06-04 三亚中兴软件有限责任公司 分布式视频会议的实现方法及系统、终端、音视频一体化设备
CN105049807A (zh) * 2015-07-31 2015-11-11 小米科技有限责任公司 监控画面声音采集方法及装置

Family Cites Families (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0666542A3 (en) * 1994-02-04 1996-05-15 Fuji Facom Corp Multimedia system for monitoring and controlling processes.
JPH0981233A (ja) 1995-09-18 1997-03-28 Mitsubishi Electric Corp 監視制御支援装置
US6968905B2 (en) * 2003-03-18 2005-11-29 Schlumberger Technology Corporation Distributed control system
JP2005252660A (ja) * 2004-03-04 2005-09-15 Matsushita Electric Ind Co Ltd 撮影システム及び撮影制御方法
KR100681840B1 (ko) * 2005-04-15 2007-02-12 주식회사 에스원 로봇 감시 시스템 및 이를 이용하는 로봇 감시 방법
JP2006339741A (ja) * 2005-05-31 2006-12-14 Matsushita Electric Ind Co Ltd 監視装置および監視方法
JP2009105612A (ja) 2007-10-23 2009-05-14 Yamaha Corp 検知装置および監視カメラ
US10007758B2 (en) * 2009-03-04 2018-06-26 Masimo Corporation Medical monitoring system
JP5189536B2 (ja) * 2009-03-26 2013-04-24 池上通信機株式会社 監視装置
JP5204707B2 (ja) 2009-03-30 2013-06-05 セコム株式会社 画像監視装置
US20110087535A1 (en) * 2009-10-14 2011-04-14 Seiko Epson Corporation Information processing device, information processing system, control method for an information processing device, and a program
CN101786272A (zh) * 2010-01-05 2010-07-28 深圳先进技术研究院 一种用于家庭智能监控服务的多感知机器人
JP5489778B2 (ja) 2010-02-25 2014-05-14 キヤノン株式会社 情報処理装置およびその処理方法
JP5418327B2 (ja) 2010-03-16 2014-02-19 株式会社リコー ビデオ会議装置
US9195799B2 (en) * 2011-02-08 2015-11-24 Aulisa Medtech International, Inc. Wireless patient monitoring system
JP2013016929A (ja) * 2011-06-30 2013-01-24 Brother Ind Ltd 撮像装置、撮像方法およびプログラム
TWI429938B (zh) * 2011-09-16 2014-03-11 Vatics Inc 聲源監視系統及其方法
CN102385389B (zh) * 2011-11-01 2014-08-06 中国科学院深圳先进技术研究院 巡逻机器人、预警系统以及巡逻机器人的监控方法
JP2014143678A (ja) * 2012-12-27 2014-08-07 Panasonic Corp 音声処理システム及び音声処理方法
JP2014137767A (ja) 2013-01-18 2014-07-28 Hochiki Corp イベント監視システム
US9594163B2 (en) * 2013-04-15 2017-03-14 Electronics And Telecommunications Research Institute Security and surveillance system and method
KR20150075224A (ko) * 2013-12-24 2015-07-03 주식회사 케이티 관제 서비스 제공 시스템 및 방법
GB2526666B (en) * 2014-03-31 2016-12-07 Electronics & Telecommunications Res Inst Security monitoring apparatus and method using correlation coefficient variation pattern of sound field spectrum
US10262655B2 (en) * 2014-11-03 2019-04-16 Microsoft Technology Licensing, Llc Augmentation of key phrase user recognition
JP5866551B1 (ja) * 2014-11-20 2016-02-17 パナソニックＩｐマネジメント株式会社 監視システム及び監視システムにおける監視方法
CN104574745A (zh) * 2015-01-26 2015-04-29 成都美联微智科技有限公司 基于生理特征的安防监控系统
KR20150060626A (ko) 2015-04-24 2015-06-03 롯데건설 주식회사 능동형 무인 경비 시스템

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120002047A1 (en) * 2010-07-01 2012-01-05 Kwang Ho An Monitoring camera and method of tracing sound source
CN102056053A (zh) * 2010-12-17 2011-05-11 中兴通讯股份有限公司 一种多话筒混音方法及装置
CN103595953A (zh) * 2013-11-14 2014-02-19 华为技术有限公司 一种控制视频拍摄的方法和装置
CN103841360A (zh) * 2013-12-11 2014-06-04 三亚中兴软件有限责任公司 分布式视频会议的实现方法及系统、终端、音视频一体化设备
CN105049807A (zh) * 2015-07-31 2015-11-11 小米科技有限责任公司 监控画面声音采集方法及装置

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10354678B2 (en) 2015-07-31 2019-07-16 Xiaomi Inc. Method and device for collecting sounds corresponding to surveillance images

Also Published As

Publication number Publication date
US10354678B2 (en) 2019-07-16
KR101770930B1 (ko) 2017-08-23
JP6386187B2 (ja) 2018-09-05
MX2016004997A (es) 2017-05-04
CN105049807B (zh) 2018-05-18
EP3125152A1 (en) 2017-02-01
US20170032805A1 (en) 2017-02-02
RU2016115037A (ru) 2017-10-24
RU2638763C2 (ru) 2017-12-15
EP3125152B1 (en) 2021-09-15
JP2017537565A (ja) 2017-12-14
MX362891B (es) 2019-02-22
KR20170023753A (ko) 2017-03-06
CN105049807A (zh) 2015-11-11

Similar Documents

Publication Publication Date Title
WO2017020507A1 (zh) 监控画面声音采集方法及装置
JP6445173B2 (ja) デバイスの制御方法及び装置
CN104330996B (zh) 遥控方法及装置
CN105159112B (zh) 环境参数处理方法和装置、网络设备
WO2017008398A1 (zh) 智能设备控制方法和装置
WO2017071093A1 (zh) 电子设备控制方法及装置
WO2017101497A1 (zh) 设备控制方法及装置
WO2018068689A1 (zh) 音量调节方法及装置
CN105939236A (zh) 控制智能家居设备的方法及装置
KR101815229B1 (ko) 리마인드 방법, 장치, 프로그램 및 기록매체
CN104039040A (zh) 智能灯的控制方法及装置
WO2017092246A1 (zh) 亮度调整方法及装置
WO2015154360A1 (zh) 一种智能终端控制方法及装置
CN105392257A (zh) 控制智能灯的方法及装置
CN106603350B (zh) 信息展示方法及装置
EP3099017B1 (en) A method and a device for controlling a smart home power supply
CN105494286A (zh) 灭蚊方法及装置
WO2017063272A1 (zh) 一种发送警报通知消息的方法和装置
CN106406117A (zh) 设备控制方法及装置
CN105245809A (zh) 视频录制方法及装置
CN105094063A (zh) 智能家居的控制方法及装置
CN105301183A (zh) 空气质量检测方法和装置
CN105549572A (zh) 智能家居设备的控制方法、装置及设备
EP3023951A1 (en) Monitoring system
CN107969401A (zh) 灭虫器、灭虫方法及装置

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2017531954

Country of ref document: JP

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 20167004628

Country of ref document: KR

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: MX/A/2016/004997

Country of ref document: MX

ENP Entry into the national phase

Ref document number: 2016115037

Country of ref document: RU

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15900271

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15900271

Country of ref document: EP

Kind code of ref document: A1