CN110489076A - Ambient sound monitoring method, device and electronic equipment - Google Patents
Ambient sound monitoring method, device and electronic equipment Download PDFInfo
- Publication number
- CN110489076A CN110489076A CN201910783033.0A CN201910783033A CN110489076A CN 110489076 A CN110489076 A CN 110489076A CN 201910783033 A CN201910783033 A CN 201910783033A CN 110489076 A CN110489076 A CN 110489076A
- Authority
- CN
- China
- Prior art keywords
- sound
- monitoring
- instruction
- cacophonia
- ambient sound
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 126
- 238000000034 method Methods 0.000 title claims abstract description 28
- 238000012163 sequencing technique Methods 0.000 claims abstract description 11
- 230000002159 abnormal effect Effects 0.000 claims description 88
- 230000015654 memory Effects 0.000 claims description 21
- 230000004044 response Effects 0.000 claims description 18
- 230000035945 sensitivity Effects 0.000 claims description 15
- 238000004891 communication Methods 0.000 claims description 5
- 238000012806 monitoring device Methods 0.000 claims description 5
- 230000005540 biological transmission Effects 0.000 claims description 4
- 230000007613 environmental effect Effects 0.000 abstract description 6
- 206010011469 Crying Diseases 0.000 description 6
- 230000002547 anomalous effect Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000010009 beating Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 241001085205 Prenanthella exigua Species 0.000 description 1
- 230000005856 abnormality Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 239000007788 liquid Substances 0.000 description 1
- 230000001151 other effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 230000001755 vocal effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/72—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for transmitting results of analysis
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Abstract
This application discloses a kind of ambient sound monitoring method, device and electronic equipments, are related to sound monitoring field.Specific implementation are as follows: obtain the ambient sound monitoring result that cloud is sent, ambient sound monitoring result is to carry out exception monitoring to the received ambient sound of speech ciphering equipment to obtain；According to the time sequencing for carrying out exception monitoring to ambient sound, ambient sound monitoring result is divided into multiple cacophonia events；In ambient sound monitoring interface, show multiple cacophonia events.So that user can not only quickly have found the exception in environment, but also can check the multiple cacophonia events showed sequentially in time by client, the efficiency of environmental monitoring is improved.
Description
Technical field
This application involves environmental monitoring field more particularly to a kind of sound monitoring fields.
Background technique
Currently, be monitored to the monitoring of home environment often by installation monitor in a room, user can be with
In mobile client such as mobile phone equipment, camera is opened, is monitored by the picture of observation cabin within doors.But it takes the photograph
As head exist monitoring dead angle, if monitoring less than place cause danger, user can not directly send out from the video of mobile phone terminal
It is existing.So currently using camera to the monitoring effect of home environment and bad.
Summary of the invention
The embodiment of the present application provides a kind of ambient sound monitoring method, device and electronic equipment, to solve the prior art
In one or more technical problems.
In a first aspect, the embodiment of the present application provides a kind of ambient sound monitoring method, comprising:
The ambient sound monitoring result that cloud is sent is obtained, ambient sound monitoring result is to the received environment of speech ciphering equipment
Sound carries out what exception monitoring obtained；
According to the time sequencing for carrying out exception monitoring to ambient sound, ambient sound parsing result is divided into multiple sound
Anomalous event；
In ambient sound monitoring interface, show multiple cacophonia events.
In the present embodiment, by ambient sound carry out exception monitoring, and by ambient sound monitoring result according to when
Between be sequentially divided into multiple cacophonia events, and cacophonia event is presented in the ambient sound monitoring interface of client
In, so that user can not only quickly have found the exception in environment, but also can be checked sequentially in time by client
The multiple cacophonia events showed, improve the efficiency of environmental monitoring.
In one embodiment, cacophonia event includes the voice of abnormal sound, the type of abnormal sound, sensitivity etc.
Grade, abnormal sound duration show multiple cacophonia events in ambient sound monitoring interface, comprising:
In ambient sound monitoring interface, in response to abnormal sound play operation, play instruction is generated；
The voice of abnormal sound is played according to play instruction；
In response to cacophonia event display operation, display triggering command is generated；
It is shown in the duration of the type of abnormal sound, sensitive grade and abnormal sound extremely according to display triggering command
One item missing.
In the present embodiment, abnormal sound is stored, forms the voice of abnormal sound, so that user can be by broadcasting
The voice of the abnormal sound of period is let off more easily to understand the abnormal conditions in environment, it can also be by checking environment
The duration of the type of the abnormal sound shown in sound monitoring interface, sensitive grade and abnormal sound, faster more accurately
Judge the abnormal conditions in environment.
In one embodiment, further includes:
In the case where sensitive grade is greater than or equal to sensitivity threshold, alarm signal is issued.
In the present embodiment, carry out the division of sensitive grade to the abnormal sound that monitors, and by sensitive grade and
Sensitivity threshold is compared, and issues alarm in time, is sent out in the environment for reminding user to be monitored at current time in time and quickly
Abnormal conditions are given birth to.
In one embodiment, further includes:
It is opened in interface in monitoring, in response to monitoring opening operation, generates monitoring open command；
Monitoring open command is sent to cloud, to parse to monitoring open command, obtains the unlatching of speech ciphering equipment
Control instruction opens control instruction for controlling speech ciphering equipment unlatching.
In the present embodiment, user can be placed in monitoring environment by opening in the monitoring interface of client
Speech ciphering equipment remotely controls speech ciphering equipment, improves monitoring convenience.
In one embodiment, after showing multiple cacophonia events, further includes:
Feedback sound instruction is received, feedback sound instruction includes the sound fed back according to multiple cacophonia events；
Feedback sound instruction is sent to cloud, to be parsed to feedback sound instruction, feedback voice broadcasting is obtained and refers to
It enables, feedback voice play instruction plays feedback voice for controlling speech ciphering equipment.
In the present embodiment, the voice of user's uppick abnormal sound, or checked the type of abnormal sound, sensitivity
The duration of grade, abnormal sound, after judging to abnormal conditions, feedback information was sent in real time by cloud
Speech ciphering equipment in monitored environment, speech ciphering equipment play feedback sound, the people of the anomalous event in environment can be carried out and
When guidance.
Second aspect, the embodiment of the present application provide a kind of ambient sound monitoring device, comprising:
Sound monitoring result obtains module, for obtaining the ambient sound monitoring result of cloud transmission, ambient sound monitoring
The result is that carrying out what exception monitoring obtained to the received ambient sound of speech ciphering equipment；
Cacophonia event division module, for according to ambient sound carry out exception monitoring time sequencing, by environment
Sound parsing result is divided into multiple cacophonia events；
Cacophonia event display module, for showing multiple cacophonia events in ambient sound monitoring interface.
In one embodiment, cacophonia event includes the voice of abnormal sound, the type of abnormal sound, sensitivity etc.
The duration of grade, abnormal sound, cacophonia event display module include:
Play instruction generation unit, in response to abnormal sound play operation, generating in ambient sound monitoring interface
Play instruction；
Abnormal sound broadcast unit, for playing the voice of abnormal sound according to play instruction；
Triggering command generation unit is shown, for generating display triggering command in response to cacophonia event display operation；
Abnormal sound event display unit, for showing type, the sensitive grade of abnormal sound according to display triggering command
With at least one in the duration of abnormal sound.
In one embodiment, further includes:
Abnormal alarm module, for issuing alarm signal in the case where sensitive grade is greater than or equal to sensitivity threshold.
In one embodiment, further includes:
Open command generation module is monitored, for opening in interface in monitoring, in response to monitoring opening operation, generates monitoring
Open command；
Monitor open command sending module, be sent to cloud for that will monitor open command, with to monitor open command into
Row parsing, obtains the unlatching control instruction of speech ciphering equipment, opens control instruction for controlling speech ciphering equipment unlatching.
In one embodiment, further includes:
Feedback sound command reception module, for receiving feedback sound instruction, feedback sound instruction includes according to multiple sound
The sound that sound anomalous event is fed back；
Feedback sound instruction sending module, for by feedback sound instruction be sent to cloud, with to feedback sound instruct into
Row parsing, obtains feedback voice play instruction, and feedback voice play instruction plays feedback voice for controlling speech ciphering equipment.
One embodiment in above-mentioned application has the following advantages that or the utility model has the advantages that carries out abnormal prison using to ambient sound
It surveys, and ambient sound monitoring result is divided into multiple cacophonia events sequentially in time, and by cacophonia event exhibition
Technological means in the ambient sound monitoring interface of present client.Overcome when preceding camera to environmental monitoring not in time, effect
The technical problem of fruit difference, and then reach user and can not only quickly find exception in environment, but also client can be passed through
It checks the multiple cacophonia events showed sequentially in time, improves the technical effect of the efficiency of environmental monitoring.
Other effects possessed by above-mentioned optional way are illustrated hereinafter in conjunction with specific embodiment.
Detailed description of the invention
Attached drawing does not constitute the restriction to the application for more fully understanding this programme.Wherein:
Fig. 1 is the flow diagram according to a kind of ambient sound monitoring method of the application；
Fig. 2 is according to the ambient sound monitoring scene figure for realizing the embodiment of the present application one；
Fig. 3 is the flow diagram according to another ambient sound monitoring method of the application；
Fig. 4 is the structural block diagram according to a kind of ambient sound monitoring device of the application；
Fig. 5 is the structural block diagram according to another ambient sound monitoring device of the application；
Fig. 6 is the block diagram for the electronic equipment for realizing a kind of ambient sound monitoring method of the embodiment of the present application.
Specific embodiment
It explains below in conjunction with exemplary embodiment of the attached drawing to the application, including the various of the embodiment of the present application
Details should think them only exemplary to help understanding.Therefore, those of ordinary skill in the art should recognize
It arrives, it can be with various changes and modifications are made to the embodiments described herein, without departing from the scope and spirit of the present application.Together
Sample, for clarity and conciseness, descriptions of well-known functions and structures are omitted from the following description.
Embodiment one ...
In a specific embodiment, as shown in Figure 1, providing a kind of ambient sound monitoring method, comprising:
Step S10: the ambient sound monitoring result that cloud is sent is obtained, ambient sound monitoring result is connect to speech ciphering equipment
The ambient sound of receipts carries out what exception monitoring obtained；
Step S20: according to the time sequencing for carrying out exception monitoring to ambient sound, ambient sound monitoring result is divided into
Multiple cacophonia events；
Step S30: in ambient sound monitoring interface, show multiple cacophonia events.
In a kind of example, as shown in Fig. 2, user can place speech ciphering equipment in needing the environment monitored.It needs to supervise
Environment of control typically indoor environment, outdoor environment etc..Speech ciphering equipment can obtain the sound of environment, and can broadcast
Sound reproduction sound.Speech ciphering equipment may include intelligent sound box etc. can human-computer interaction intelligent sound equipment.Speech ciphering equipment can receive one
Determine the sound in range in environment, and the sound in environment is sent to cloud in real time.After cloud receives ambient sound, to environment
Abnormal sound in sound is identified and analyzed, and obtains ambient sound monitoring result.For example, cloud can identify ambient sound
There are the crying of child, the shout of emergency, the sound for beating article in sound, the sound of movement etc. of abnormal sound is realized to these exceptions
Sound is monitored in real time, determines the attribute informations such as type, the timing time of abnormal sound.
In beyond the clouds, according to the time sequencing of exception monitoring, the time sequencing of event generation can be.Ambient sound is supervised
It surveys result and is divided into multiple cacophonia events, each cacophonia event corresponds to a period.For example, first sound
Anomalous event occur in the morning 6 points to six thirty, monitor the crying of child；Second cacophonia event occurs at noon
It assigns at ten two: 10 at ten two points 12 minutes, monitors the sound etc. that plate is broken.Certainly, after cloud receives ambient sound, may be used also
Ambient sound to be stored.Likewise, the ambient sound in each period is stored according to the time sequencing of generation
Come, is listened in order to which user carries out selection according to the time.
Multiple cacophonia events can be sent in the clients such as mobile phone, IPAD by cloud, be answered in the mobile phone of client
With in the ambient sound monitoring interface of program, multiple cacophonia events can be showed sequentially in time.It is supervised in ambient sound
It controls in interface, shows a timeline, click any point on timeline, when timeline lower can show current
Between point, cacophonia event content, for example, the type of abnormal sound, sensitive grade, duration etc., are checked convenient for user.
In addition, also showing the control of " monitoring in real time " in interface, user can listen in real time current environment by clicking this control
Sound.The tip button of " a key alarm " is additionally provided in interface, it, can be certainly when cacophonia event occurs and exceeds threshold value
Dynamic alarm, such as issue alarm sound or hazard warning flasher etc..The control of " key alarm " is additionally provided in interface,
When user hears cacophonia event, the control of " key alarm " can be directly triggered, is dialed the police emergency number, carried out the external world and ask
It helps.
In one embodiment, cacophonia event includes the voice of abnormal sound, the type of abnormal sound, sensitivity etc.
The duration of grade, abnormal sound, as shown in figure 3, step S30 includes:
Step S301: in ambient sound monitoring interface, in response to abnormal sound play operation, play instruction is generated；
Step S302: the voice of abnormal sound is played according to play instruction；
Step S303: in response to cacophonia event display operation, display triggering command is generated；
Step S304: according to continuing for the type of display triggering command display abnormal sound, sensitive grade and abnormal sound
At least one of in time.
In a kind of example, as shown in Fig. 2, user clicks " prison in real time in the ambient sound monitoring interface of client
Listen ", play instruction is generated, client plays the voice of the abnormal sound of storage according to play instruction.Client can also basis
Play instruction plays the ambient sound in each period of storage.The display that user can also click anomalous event in interface is pressed
Key, for example, user clicks 9 points of time point 20 minutes on timeline, in the lower section at the current time of timeline, show abnormality sound
The type of sound be the crying of child, sensitive grade be the 2nd grade, the duration of abnormal sound is 1 minute, click " playing audio "
Control listens to 9: 20 ambient sounds for assigning to 9: 26/storage.
In the present embodiment, abnormal sound is stored, forms the voice of abnormal sound, so that user can be by broadcasting
The voice of the abnormal sound of period is let off more easily to understand the abnormal conditions in environment, it can also be by checking environment
The duration of the type of the abnormal sound shown in sound monitoring interface, sensitive grade and abnormal sound, faster more accurately
Judge the abnormal conditions in environment.
In one embodiment, as shown in Figure 3, further includes:
Step S40: in the case where sensitive grade is greater than or equal to sensitivity threshold, alarm signal is issued.
In a kind of example, the division of sensitive grade is carried out to the abnormal sound monitored.Different types of abnormal sound,
The division of sensitive grade is different.For example, if abnormal sound type is the crying of child, can according to the decibels of crying, cry
Whether sound determines sensitive grade extremely.5 grades can be divided into, sensitivity threshold is the 3rd grade, when sensitive grade exceeds the 3rd
When grade, alarm signal is issued, prompts user, as mother of child carries out corresponding measure.If abnormal sound type is article
Beat sound, then can according to the decibels for beating sound of article, fallen article sound type and determine sensitive grade.Again
Such as, 6 grades can be divided into, when sensitive grade exceeds 2 grade, issue alarm signal.The setting of sensitive grade is quick
Abnormal conditions have occurred in the environment for reminding user to be monitored at current time.
In one embodiment, as shown in Figure 3, further includes:
Step S11: opening in interface in monitoring, in response to monitoring opening operation, generates monitoring open command；
Step S12: monitoring open command is sent to cloud, to be parsed to monitoring open command, voice is obtained and sets
Standby unlatching control instruction opens control instruction for controlling speech ciphering equipment unlatching.
In the present embodiment, as shown in Fig. 2, user can be by opening " monitoring mould in the monitoring interface of client
Formula " control, after opening monitoring mode, intelligent sound box actively monitors the abnormal sound of movement in environment, by cloud by cacophonia thing
Part is sent to client.Storage and monitoring time segment can also be set, for example, 6:00 AM is monitored to 6 points at night.Due to can remotely open
The intelligent sound box being placed in monitoring environment is opened, monitoring convenience is improved.
In one embodiment, as shown in figure 3, after step S30, further includes:
Step S50: feedback sound instruction is received, feedback sound instruction includes being fed back according to multiple cacophonia events
Sound；
Step S60: feedback sound instruction is sent to cloud, to parse to feedback sound instruction, obtains backchannel
Sound play instruction, feedback voice play instruction play feedback voice for controlling speech ciphering equipment.
In the present embodiment, the voice of user's uppick abnormal sound, or checked the type of abnormal sound, sensitivity
The duration of grade, abnormal sound, abnormal conditions are judged.User will feed back voice by clients such as mobile phones and send
To cloud, after cloud parses feedback information, feedback information is obtained.Feedback information is sent in monitored environment by cloud
Speech ciphering equipment, speech ciphering equipment according to feedback information play feedback sound.For example, when user hears the crying for having child, it can
With by mobile phone transmission voice " baby don't cry, mother go home ", and control intelligent sound box and play this voice at once.Aforesaid way energy
It is enough that the people of anomalous event in environment is timely instructed.
Embodiment two
In another embodiment specific implementation mode, as shown in figure 4, providing a kind of ambient sound monitoring device 100, comprising:
Sound monitoring result obtains module 101, for obtaining the ambient sound monitoring result of cloud transmission, ambient sound prison
It surveys the result is that carrying out what exception monitoring obtained to the received ambient sound of speech ciphering equipment；
Cacophonia event division module 102, for according to ambient sound carry out exception monitoring time sequencing, by ring
Border sound parsing result is divided into multiple cacophonia events；
Cacophonia event display module 103, for showing multiple cacophonia things in ambient sound monitoring interface
Part.
In one embodiment, cacophonia event includes the voice of abnormal sound, the type of abnormal sound, sensitivity etc.
The duration of grade, abnormal sound, as shown in figure 5, cacophonia event display module 103 includes:
Play instruction generation unit 1031, in ambient sound monitoring interface, in response to abnormal sound play operation,
Generate play instruction；
Abnormal sound broadcast unit 1032, for playing the voice of abnormal sound according to play instruction；
Triggering command generation unit 1033 is shown, for generating display triggering in response to cacophonia event display operation
Instruction；
Abnormal sound event display unit 1034, for showing type, the sensitivity of abnormal sound according to display triggering command
At least one of in the duration of grade and abnormal sound.
In one embodiment, as shown in Figure 5, further includes:
Abnormal alarm module 104, for issuing alarm signal in the case where sensitive grade is greater than or equal to sensitivity threshold
Number.
In one embodiment, as shown in Figure 5, further includes:
Open command generation module 105 is monitored, for being opened in interface in monitoring, in response to monitoring opening operation, is generated
Monitor open command；
Open command sending module 106 is monitored, is sent to cloud for open command will to be monitored, to monitoring open command
It is parsed, obtains the unlatching control instruction of speech ciphering equipment, open control instruction for controlling speech ciphering equipment unlatching.
In one embodiment, as shown in Figure 5, further includes:
Feedback sound command reception module 107, for receiving feedback sound instruction, feedback sound instruction includes according to multiple
The sound that cacophonia event is fed back；
Feedback sound instruction sending module 108, for feedback sound instruction to be sent to cloud, to be instructed to feedback sound
It is parsed, obtains feedback voice play instruction, feedback voice play instruction plays feedback voice for controlling speech ciphering equipment.
According to an embodiment of the present application, present invention also provides a kind of electronic equipment and a kind of readable storage medium storing program for executing.
As shown in fig. 6, being the block diagram according to the electronic equipment of the ambient sound monitoring method of the embodiment of the present application.Electronics is set
Standby to be intended to indicate that various forms of digital computers, such as, laptop computer, desktop computer, workbench, individual digital help
Reason, server, blade server, mainframe computer and other suitable computer.Electronic equipment also may indicate that various shapes
The mobile device of formula, such as, personal digital assistant, cellular phone, smart phone, wearable device and other similar calculating dresses
It sets.Component, their connection and relationship shown in this article and their function are merely exemplary, and are not intended to limit
The realization of described herein and/or requirement the application.
As shown in fig. 6, the electronic equipment includes: one or more processors 601, memory 602, and each for connecting
The interface of component, including high-speed interface and low-speed interface.All parts are interconnected using different buses, and can be pacified
It installs in other ways on public mainboard or as needed.Processor can to the instruction executed in electronic equipment into
Row processing, including storage in memory or on memory (such as, to be coupled to interface in external input/output device
Display equipment) on show graphic user interface (Graphical User Interface, GUI) graphical information instruction.In
In other embodiment, if desired, can be by multiple processors and/or multiple bus and multiple memories and multiple memories one
It rises and uses.It is also possible to connect multiple electronic equipments, each equipment provides the necessary operation in part (for example, as server battle array
Column, one group of blade server or multicomputer system).In Fig. 6 by taking a processor 601 as an example.
Memory 602 is non-transitory computer-readable storage medium provided herein.Wherein, the memory is deposited
The instruction that can be executed by least one processor is contained, so that at least one described processor executes environment provided herein
Sound monitoring method.The non-transitory computer-readable storage medium of the application stores computer instruction, which is used for
Computer is set to execute ambient sound monitoring method provided herein.
Memory 602 is used as a kind of non-transitory computer-readable storage medium, can be used for storing non-instantaneous software program, non-
Instantaneous computer executable program and module, as the corresponding program of ambient sound monitoring method in the embodiment of the present application refers to
Order/module (for example, xx module X01, xx module x02 and xx module x03 shown in attached drawing X).Processor 601 passes through operation storage
Non-instantaneous software program, instruction and module in the memory 602, thereby executing the various function application and number of server
According to processing, i.e. ambient sound monitoring method in realization above method embodiment.
Memory 602 may include storing program area and storage data area, wherein storing program area can store operation system
Application program required for system, at least one function；Storage data area can store the electronic equipment monitored according to ambient sound
Use created data etc..In addition, memory 602 may include high-speed random access memory, it can also include non-instantaneous
Memory, for example, at least a disk memory, flush memory device or other non-instantaneous solid-state memories.In some implementations
In example, optional memory 602 includes the memory remotely located relative to processor 601, these remote memories can pass through
It is connected to the network the electronic equipment monitored to ambient sound.The example of above-mentioned network include but is not limited to internet, intranet,
Local area network, mobile radio communication and combinations thereof.
The electronic equipment of ambient sound monitoring method can also include: input unit 603 and output device 604.Processor
601, memory 602, input unit 603 and output device 604 can be connected by bus or other modes, with logical in Fig. 6
It crosses for bus connection.
Input unit 603 can receive the number or character information of input, and generates the electronics monitored with ambient sound and set
The related key signals input of standby user setting and function control, such as touch screen, keypad, mouse, track pad, touch
The input units such as plate, indicating arm, one or more mouse button, trace ball, control stick.Output device 604 may include showing
Show equipment, auxiliary lighting apparatus (for example, LED) and haptic feedback devices (for example, vibrating motor) etc..The display equipment can wrap
It includes but is not limited to, liquid crystal display (Liquid Cr6stal Displa6, LCD), light emitting diode (Light Emitting
Diode, LED) display and plasma scope.In some embodiments, display equipment can be touch screen.
The various embodiments of system and technology described herein can be in digital electronic circuitry, integrated circuit system
System, is consolidated specific integrated circuit (Application Specific Integrated Circuits, ASIC), computer hardware
It is realized in part, software, and/or their combination.These various embodiments may include: to implement in one or more calculating
In machine program, which can hold in programmable system containing at least one programmable processor
Row and/or explain, which can be dedicated or general purpose programmable processors, can from storage system, at least
One input unit and at least one output device receive data and instruction, and data and instruction is transmitted to the storage system
System, at least one input unit and at least one output device.
These calculation procedures (also referred to as program, software, software application or code) include the machine of programmable processor
Instruction, and can use programming language, and/or the compilation/machine language of level process and/or object-oriented to implement these
Calculation procedure.As used herein, term " machine readable media " and " computer-readable medium " are referred to for referring to machine
It enables and/or data is supplied to any computer program product, equipment, and/or the device of programmable processor (for example, disk, light
Disk, memory, programmable logic device (programmable logic device, PLD)), including, receiving can as machine
The machine readable media of the machine instruction of read signal.Term " machine-readable signal " is referred to for by machine instruction and/or number
According to any signal for being supplied to programmable processor.
In order to provide the interaction with user, system and technology described herein, the computer can be implemented on computers
Include for user show information display device (for example, CRT (Cathode Ra6 Tube, cathode-ray tube) or
LCD (liquid crystal display) monitor)；And keyboard and indicator device (for example, mouse or trace ball), user can be by this
Keyboard and the indicator device provide input to computer.The device of other types can be also used for providing the friendship with user
Mutually；For example, the feedback for being supplied to user may be any type of sensory feedback (for example, visual feedback, audio feedback or
Touch feedback)；And it can be received with any form (including vocal input, voice input or tactile input) from user
Input.
System described herein and technology can be implemented including the computing system of background component (for example, as data
Server) or the computing system (for example, application server) including middleware component or the calculating including front end component
System is (for example, the subscriber computer with graphic user interface or web browser, user can pass through graphical user circle
Face or the web browser to interact with the embodiment of system described herein and technology) or including this backstage portion
In any combination of computing system of part, middleware component or front end component.Any form or the number of medium can be passed through
Digital data communicates (for example, communication network) and is connected with each other the component of system.The example of communication network includes: local area network
(Local Area Network, LAN), wide area network (Wide Area Network.WAN) and internet.
Computer system may include client and server.Client and server is generally off-site from each other and usually logical
Communication network is crossed to interact.By being run on corresponding computer and each other with the meter of client-server relation
Calculation machine program generates the relationship of client and server.
According to the technical solution of the embodiment of the present application, by carrying out exception monitoring to ambient sound, and ambient sound is supervised
It surveys result and is divided into multiple cacophonia events sequentially in time, and cacophonia event is presented in the ambient sound of client
In sound monitoring interface so that user can not only quickly have found the exception in environment, but also can be checked by client by
According to multiple cacophonia events that time sequencing shows, the efficiency of environmental monitoring is improved.
It should be understood that various forms of processes illustrated above can be used, rearrangement increases or deletes step.Example
Such as, each step recorded in the application of this hair can be performed in parallel or be sequentially performed the order that can also be different and execute,
As long as it is desired as a result, being not limited herein to can be realized technical solution disclosed in the present application.
Above-mentioned specific embodiment does not constitute the limitation to the application protection scope.Those skilled in the art should be bright
White, according to design requirement and other factors, various modifications can be carried out, combination, sub-portfolio and substitution.It is any in the application
Spirit and principle within made modifications, equivalent substitutions and improvements etc., should be included within the application protection scope.
Claims (12)
1. a kind of ambient sound monitoring method characterized by comprising
The ambient sound monitoring result that cloud is sent is obtained, the ambient sound monitoring result is to the received environment of speech ciphering equipment
Sound carries out what exception monitoring obtained；
According to the time sequencing for carrying out exception monitoring to the ambient sound, the ambient sound monitoring result is divided into multiple
Cacophonia event；
In ambient sound monitoring interface, show the multiple cacophonia event.
2. the method according to claim 1, wherein the cacophonia event include abnormal sound voice,
The type of abnormal sound, sensitive grade, abnormal sound duration show the multiple in ambient sound monitoring interface
Cacophonia event, comprising:
In the ambient sound monitoring interface, in response to abnormal sound play operation, play instruction is generated；
The voice of the abnormal sound is played according to the play instruction；
In response to the cacophonia event display operation, display triggering command is generated；
Holding for the type of the abnormal sound, the sensitive grade and the abnormal sound is shown according to the display triggering command
At least one of in the continuous time.
3. according to the method described in claim 2, it is characterized by further comprising:
In the case where the sensitive grade is greater than or equal to sensitivity threshold, alarm signal is issued.
4. the method according to claim 1, wherein further include:
It is opened in interface in monitoring, in response to monitoring opening operation, generates monitoring open command；
The monitoring open command is sent to the cloud, to parse to the monitoring open command, obtains institute's predicate
The unlatching control instruction of sound equipment, the unlatching control instruction are opened for controlling the speech ciphering equipment.
5. the method according to claim 1, wherein after triggering the multiple cacophonia event, further includes:
Feedback sound instruction is received, the feedback sound instruction includes the sound fed back according to the multiple cacophonia event
Sound；
Feedback sound instruction is sent to the cloud, to parse to feedback sound instruction, obtains backchannel
Sound play instruction, the feedback voice play instruction play the feedback voice for controlling the speech ciphering equipment.
6. a kind of ambient sound monitoring device characterized by comprising
Sound monitoring result obtains module, for obtaining the ambient sound monitoring result of cloud transmission, the ambient sound monitoring
The result is that carrying out what exception monitoring obtained to the received ambient sound of speech ciphering equipment；
Cacophonia event division module will be described for according to the time sequencing for carrying out exception monitoring to the ambient sound
Ambient sound parsing result is divided into multiple cacophonia events；
Cacophonia event display module, for showing the multiple cacophonia event in ambient sound monitoring interface.
7. device according to claim 6, which is characterized in that the cacophonia event include abnormal sound voice,
The type of abnormal sound, sensitive grade, abnormal sound duration, the cacophonia event display module includes:
Play instruction generation unit, in response to abnormal sound play operation, generating in the ambient sound monitoring interface
Play instruction；
Abnormal sound broadcast unit, for playing the voice of the abnormal sound according to the play instruction；
Triggering command generation unit is shown, for generating display triggering command in response to the cacophonia event display operation；
Abnormal sound event display unit, for showing the type, described of the abnormal sound according to the display triggering command
At least one of in the duration of sensitive grade and the abnormal sound.
8. device according to claim 7, which is characterized in that further include:
Abnormal alarm module, for issuing alarm signal in the case where the sensitive grade is greater than or equal to sensitivity threshold.
9. device according to claim 6, which is characterized in that further include:
Open command generation module is monitored, for being opened in interface in monitoring, in response to monitoring opening operation, monitoring is generated and opens
Instruction；
Open command sending module is monitored, for the monitoring open command to be sent to the cloud, to open the monitoring
It opens instruction to be parsed, obtains the unlatching control instruction of the speech ciphering equipment, the unlatching control instruction is for controlling institute's predicate
Sound opening of device.
10. device according to claim 6, which is characterized in that further include:
Feedback sound command reception module, for receiving feedback sound instruction, the feedback sound instruction includes according to described more
The sound that a cacophonia event is fed back；
Feedback sound instruction sending module, for feedback sound instruction to be sent to the cloud, to the feedback sound
Sound instruction is parsed, and obtains feedback voice play instruction, the feedback voice play instruction is for controlling the speech ciphering equipment
Play the feedback voice.
11. a kind of electronic equipment characterized by comprising
At least one processor；And
The memory being connect at least one described processor communication；Wherein,
The memory is stored with the instruction that can be executed by least one described processor, and described instruction is by described at least one
It manages device to execute, so that at least one described processor is able to carry out method of any of claims 1-5.
12. a kind of non-transitory computer-readable storage medium for being stored with computer instruction, which is characterized in that the computer refers to
It enables for making the computer perform claim require method described in any one of 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910783033.0A CN110489076B (en) | 2019-08-22 | 2019-08-22 | Environment sound monitoring method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910783033.0A CN110489076B (en) | 2019-08-22 | 2019-08-22 | Environment sound monitoring method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110489076A true CN110489076A (en) | 2019-11-22 |
| CN110489076B CN110489076B (en) | 2024-03-01 |
Family
ID=68553203
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910783033.0A Active CN110489076B (en) | 2019-08-22 | 2019-08-22 | Environment sound monitoring method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110489076B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112991673A (en) * | 2019-12-13 | 2021-06-18 | 宇龙计算机通信科技(深圳)有限公司 | Household abnormity monitoring method and device, storage medium and electronic equipment |
| CN113838478A (en) * | 2020-06-08 | 2021-12-24 | 华为技术有限公司 | Abnormal event detection method and device and electronic equipment |
| CN114121050A (en) * | 2021-11-30 | 2022-03-01 | 云知声智能科技股份有限公司 | Audio playing method and device, electronic equipment and storage medium |
| CN115240302A (en) * | 2022-07-18 | 2022-10-25 | 珠海格力电器股份有限公司 | Method and device for monitoring indoor safety environment, electronic equipment and storage medium |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100142725A1 (en) * | 2008-09-11 | 2010-06-10 | Personics Holdings Inc. | Method and system for sound monitoring over a network |
| US20140317710A1 (en) * | 2013-04-23 | 2014-10-23 | Canary Connect, Inc. | Method for connecting devices to a network through an audio cable and a user device |
| CN104836857A (en) * | 2015-05-07 | 2015-08-12 | 广东欧珀移动通信有限公司 | Anti-theft method based on smart sound box, anti-theft device based on smart sound box, smart sound box and mobile terminal |
| CN105681062A (en) * | 2014-11-18 | 2016-06-15 | 小米科技有限责任公司 | Safety monitoring method and apparatus |
| JP2016118987A (en) * | 2014-12-22 | 2016-06-30 | パナソニックＩｐマネジメント株式会社 | Abnormality sound detection system |
| CN106683361A (en) * | 2017-01-24 | 2017-05-17 | 宇龙计算机通信科技(深圳)有限公司 | Sound monitoring method and device |
| CN106887122A (en) * | 2015-12-15 | 2017-06-23 | 美的集团股份有限公司 | Method, device and the audio amplifier alarmed by audio amplifier |
| US20180113577A1 (en) * | 2016-10-26 | 2018-04-26 | Google Inc. | Timeline-Video Relationship Presentation for Alert Events |
| KR20190028016A (en) * | 2017-09-08 | 2019-03-18 | 주식회사 케이티 | Apparatus for monitoring home, method and computer program |
| US10296194B2 (en) * | 2015-06-14 | 2019-05-21 | Google Llc | Methods and systems for presenting alert event indicators |
| CN109785581A (en) * | 2019-02-26 | 2019-05-21 | 珠海格力电器股份有限公司 | A kind of monitoring method, device, storage medium and equipment |
-
2019
- 2019-08-22 CN CN201910783033.0A patent/CN110489076B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100142725A1 (en) * | 2008-09-11 | 2010-06-10 | Personics Holdings Inc. | Method and system for sound monitoring over a network |
| US20140317710A1 (en) * | 2013-04-23 | 2014-10-23 | Canary Connect, Inc. | Method for connecting devices to a network through an audio cable and a user device |
| CN105681062A (en) * | 2014-11-18 | 2016-06-15 | 小米科技有限责任公司 | Safety monitoring method and apparatus |
| JP2016118987A (en) * | 2014-12-22 | 2016-06-30 | パナソニックＩｐマネジメント株式会社 | Abnormality sound detection system |
| CN104836857A (en) * | 2015-05-07 | 2015-08-12 | 广东欧珀移动通信有限公司 | Anti-theft method based on smart sound box, anti-theft device based on smart sound box, smart sound box and mobile terminal |
| US10296194B2 (en) * | 2015-06-14 | 2019-05-21 | Google Llc | Methods and systems for presenting alert event indicators |
| CN106887122A (en) * | 2015-12-15 | 2017-06-23 | 美的集团股份有限公司 | Method, device and the audio amplifier alarmed by audio amplifier |
| US20180113577A1 (en) * | 2016-10-26 | 2018-04-26 | Google Inc. | Timeline-Video Relationship Presentation for Alert Events |
| CN106683361A (en) * | 2017-01-24 | 2017-05-17 | 宇龙计算机通信科技(深圳)有限公司 | Sound monitoring method and device |
| KR20190028016A (en) * | 2017-09-08 | 2019-03-18 | 주식회사 케이티 | Apparatus for monitoring home, method and computer program |
| CN109785581A (en) * | 2019-02-26 | 2019-05-21 | 珠海格力电器股份有限公司 | A kind of monitoring method, device, storage medium and equipment |
Non-Patent Citations (2)
| Title |
|---|
| OSCAL T.-C. CHEN 等: ""Voice-Activity Home Care System"", 《IEEE》, 21 April 2016 (2016-04-21), pages 110 - 113 * |
| 马士乾: ""基于UBM和PLDA的异常声识别方法研究"", 《中国优秀硕士学位论文全文数据库(信息科技辑)》, no. 2019, 15 February 2019 (2019-02-15), pages 6 - 29 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112991673A (en) * | 2019-12-13 | 2021-06-18 | 宇龙计算机通信科技(深圳)有限公司 | Household abnormity monitoring method and device, storage medium and electronic equipment |
| CN113838478A (en) * | 2020-06-08 | 2021-12-24 | 华为技术有限公司 | Abnormal event detection method and device and electronic equipment |
| CN113838478B (en) * | 2020-06-08 | 2024-04-09 | 华为技术有限公司 | Abnormal event detection method and device and electronic equipment |
| CN114121050A (en) * | 2021-11-30 | 2022-03-01 | 云知声智能科技股份有限公司 | Audio playing method and device, electronic equipment and storage medium |
| CN115240302A (en) * | 2022-07-18 | 2022-10-25 | 珠海格力电器股份有限公司 | Method and device for monitoring indoor safety environment, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110489076B (en) | 2024-03-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110489076A (en) | Ambient sound monitoring method, device and electronic equipment | |
| US20210210091A1 (en) | Method, device, and storage medium for waking up via speech | |
| US20210092195A1 (en) | Information push method and device | |
| EP3796318A1 (en) | Video playing method and device, electronic device, and readable storage medium | |
| CN111192591A (en) | Awakening method and device of intelligent equipment, intelligent sound box and storage medium | |
| CN111343424B (en) | Monitoring system and method for online bid evaluation | |
| JPH05150855A (en) | Alarm timer for user of conversational-type system | |
| US20210218693A1 (en) | Method for transmitting live message, apparatus, electronic device and medium | |
| CN109783427B (en) | Method, server and system for realizing linked schedule reminding | |
| EP3796308A1 (en) | Speech recognition control method and apparatus, electronic device and readable storage medium | |
| CN110501918A (en) | Intelligent electrical appliance control, device, electronic equipment and storage medium | |
| KR102488582B1 (en) | Method and apparatus for verifying operation state of application | |
| CN109032732B (en) | Notification display method and device, storage medium and electronic equipment | |
| CN112230562A (en) | System and method for full-electronic interlocking simulation test of urban rail | |
| CN115987852A (en) | Interface service state detection method and device, computer equipment and storage medium | |
| CN109800124A (en) | CPU usage monitoring method, device, electronic equipment and storage medium | |
| CN112491858A (en) | Method, device, equipment and storage medium for detecting abnormal information | |
| CN112163174A (en) | Message display method and device, storage medium and computer equipment | |
| CN110535960A (en) | Method for early warning, device and electronic equipment | |
| CN106980535A (en) | The processing method and mobile terminal of a kind of event interrupt | |
| CN110477866A (en) | Detect method, apparatus, electronic equipment and the storage medium of sleep quality | |
| CN110738462A (en) | Plan management method, plan management device, electronic device, and storage medium | |
| CN114244952B (en) | Alarm clock processing method and device, electronic equipment and medium | |
| CN103824011A (en) | Information prompt method in security authentication process and electronic equipment | |
| CN109729410B (en) | Live broadcast room interactive event processing method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210513 Address after: 100085 Baidu Building, 10 Shangdi Tenth Street, Haidian District, Beijing Applicant after: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) Co.,Ltd. Applicant after: Shanghai Xiaodu Technology Co.,Ltd. Address before: 100085 Baidu Building, 10 Shangdi Tenth Street, Haidian District, Beijing Applicant before: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |