CN110489076A - Ambient sound monitoring method, device and electronic equipment - Google Patents
Ambient sound monitoring method, device and electronic equipment Download PDFInfo
- Publication number
- CN110489076A CN110489076A CN201910783033.0A CN201910783033A CN110489076A CN 110489076 A CN110489076 A CN 110489076A CN 201910783033 A CN201910783033 A CN 201910783033A CN 110489076 A CN110489076 A CN 110489076A
- Authority
- CN
- China
- Prior art keywords
- sound
- monitoring
- instruction
- abnormal
- voice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 148
- 238000000034 method Methods 0.000 title claims abstract description 39
- 230000007613 environmental effect Effects 0.000 claims abstract description 53
- 230000002159 abnormal effect Effects 0.000 claims description 148
- 230000035945 sensitivity Effects 0.000 claims description 41
- 230000015654 memory Effects 0.000 claims description 18
- 238000012545 processing Methods 0.000 claims description 4
- 238000012806 monitoring device Methods 0.000 claims description 3
- 238000012163 sequencing technique Methods 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 7
- 206010011469 Crying Diseases 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 238000004590 computer program Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000010009 beating Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 230000005856 abnormality Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001151 other effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/72—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for transmitting results of analysis
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computational Linguistics (AREA)
- Acoustics & Sound (AREA)
- Theoretical Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Emergency Alarm Devices (AREA)
Abstract
This application discloses a kind of ambient sound monitoring method, device and electronic equipments, are related to sound monitoring field.Specific implementation are as follows: obtain the ambient sound monitoring result that cloud is sent, ambient sound monitoring result is to carry out exception monitoring to the received ambient sound of speech ciphering equipment to obtain；According to the time sequencing for carrying out exception monitoring to ambient sound, ambient sound monitoring result is divided into multiple cacophonia events；In ambient sound monitoring interface, show multiple cacophonia events.So that user can not only quickly have found the exception in environment, but also can check the multiple cacophonia events showed sequentially in time by client, the efficiency of environmental monitoring is improved.
Description
Technical Field
The application relates to the field of environmental monitoring, in particular to the field of sound monitoring.
Background
At present, monitoring of a home environment is often performed by installing a monitor in a room, and a user can open a camera in a mobile client, such as a mobile phone, and perform monitoring by observing a picture in the room. However, the camera has a monitoring dead angle, and if danger occurs in a place which cannot be monitored, a user cannot directly find the danger from the video of the mobile phone end. Therefore, the monitoring effect of the current camera on the home environment is not good.
Disclosure of Invention
The embodiment of the application provides an environmental sound monitoring method and device and electronic equipment, so as to solve one or more technical problems in the prior art.
In a first aspect, an embodiment of the present application provides an environmental sound monitoring method, including:
acquiring an environmental sound monitoring result sent by a cloud end, wherein the environmental sound monitoring result is obtained by carrying out abnormal monitoring on environmental sound received by a voice device;
dividing an environmental sound analysis result into a plurality of sound abnormal events according to the time sequence of carrying out abnormal monitoring on the environmental sound;
in the environmental sound monitoring interface, a plurality of sound abnormal events are displayed.
In the embodiment, the environmental sound is subjected to anomaly monitoring, the environmental sound monitoring result is divided into the plurality of sound abnormal events according to the time sequence, and the sound abnormal events are displayed in the environmental sound monitoring interface of the client, so that a user can not only quickly find the anomaly in the environment, but also check the plurality of sound abnormal events displayed according to the time sequence through the client, and the efficiency of environmental monitoring is improved.
In one embodiment, the sound abnormal event comprises the voice of the abnormal sound, the type of the abnormal sound, the sensitivity level and the duration of the abnormal sound, and the plurality of sound abnormal events are presented in the environment sound monitoring interface and comprise:
in an environment sound monitoring interface, responding to abnormal sound playing operation, and generating a playing instruction;
playing the voice of the abnormal sound according to the playing instruction;
responding to the display operation of the sound abnormal event, and generating a display trigger instruction;
displaying at least one of a type, a sensitivity level, and a duration of the abnormal sound according to the display trigger instruction.
In the embodiment, the abnormal sound is stored to form the voice of the abnormal sound, so that a user can know the abnormal situation in the environment more conveniently by playing the voice of the abnormal sound in the past time period, and the abnormal situation in the environment can be judged more quickly and accurately by checking the type, the sensitivity level and the duration of the abnormal sound displayed in the environment sound monitoring interface.
In one embodiment, the method further comprises:
and sending out an alarm signal when the sensitivity level is greater than or equal to the sensitivity threshold.
In the embodiment, the monitored abnormal sound is classified into the sensitivity level, the sensitivity level is compared with the sensitivity threshold, an alarm is sent out in time, and a user is reminded of the abnormal situation in the monitored environment at the current moment in time and quickly.
In one embodiment, the method further comprises:
in a monitoring starting interface, responding to a monitoring starting operation to generate a monitoring starting instruction;
and sending the monitoring starting instruction to a cloud end to analyze the monitoring starting instruction to obtain a starting control instruction of the voice equipment, wherein the starting control instruction is used for controlling the voice equipment to be started.
In the embodiment, the user can start the voice equipment placed in the monitoring environment in the monitoring interface of the client to remotely control the voice equipment, so that the monitoring convenience is improved.
In one embodiment, after presenting the plurality of acoustic exception events, further comprising:
receiving a feedback sound instruction, wherein the feedback sound instruction comprises sound fed back according to a plurality of sound abnormal events;
and sending the feedback voice command to a cloud end to analyze the feedback voice command to obtain a feedback voice playing command, wherein the feedback voice playing command is used for controlling the voice equipment to play feedback voice.
In the embodiment, the user receives the voice of the abnormal sound, or checks the type, the sensitivity level and the duration of the abnormal sound, after the abnormal condition is judged, the feedback information is sent to the voice equipment in the monitored environment in real time through the cloud, and the voice equipment plays the feedback sound, so that the user can guide people of the abnormal event in the environment in time.
In a second aspect, an embodiment of the present application provides an ambient sound monitoring apparatus, including:
the voice monitoring result acquisition module is used for acquiring an environmental voice monitoring result sent by the cloud end, and the environmental voice monitoring result is obtained by carrying out abnormal monitoring on the environmental voice received by the voice equipment;
the sound abnormal event dividing module is used for dividing the analysis result of the environmental sound into a plurality of sound abnormal events according to the time sequence of carrying out abnormal monitoring on the environmental sound;
and the sound abnormal event display module is used for displaying a plurality of sound abnormal events in the environment sound monitoring interface.
In one embodiment, the sound abnormal event includes the voice of the abnormal sound, the type of the abnormal sound, the sensitivity level and the duration of the abnormal sound, and the sound abnormal event presentation module includes:
the playing instruction generating unit is used for responding to the abnormal sound playing operation in the environment sound monitoring interface and generating a playing instruction;
the abnormal sound playing unit is used for playing the voice of the abnormal sound according to the playing instruction;
the display trigger instruction generating unit is used for responding to the display operation of the sound abnormal event and generating a display trigger instruction;
and the abnormal sound event display unit is used for displaying at least one of the type, the sensitivity level and the duration of the abnormal sound according to the display triggering instruction.
In one embodiment, the method further comprises:
and the abnormity alarm module is used for sending out an alarm signal under the condition that the sensitivity level is greater than or equal to the sensitivity threshold value.
In one embodiment, the method further comprises:
the monitoring starting instruction generating module is used for responding to monitoring starting operation in a monitoring starting interface and generating a monitoring starting instruction;
and the monitoring starting instruction sending module is used for sending the monitoring starting instruction to the cloud end so as to analyze the monitoring starting instruction to obtain a starting control instruction of the voice equipment, and the starting control instruction is used for controlling the voice equipment to be started.
In one embodiment, the method further comprises:
the feedback sound instruction receiving module is used for receiving a feedback sound instruction, and the feedback sound instruction comprises sound fed back according to a plurality of sound abnormal events;
and the feedback voice instruction sending module is used for sending the feedback voice instruction to the cloud end so as to analyze the feedback voice instruction to obtain a feedback voice playing instruction, and the feedback voice playing instruction is used for controlling the voice equipment to play feedback voice.
One embodiment in the above application has the following advantages or benefits: the technical means that the environmental sound is monitored abnormally, the environmental sound monitoring result is divided into a plurality of sound abnormal events according to the time sequence, and the sound abnormal events are displayed in an environmental sound monitoring interface of the client side is utilized. The technical problems that the environment monitoring of the current camera is not timely and the effect is poor are solved, the user can quickly find the abnormality in the environment, a plurality of sound abnormal events displayed according to the time sequence can be checked through the client, and the technical effect of the environment monitoring efficiency is improved.
Other effects of the above-described alternative will be described below with reference to specific embodiments.
Drawings
The drawings are included to provide a better understanding of the present solution and are not intended to limit the present application. Wherein:
FIG. 1 is a schematic flow diagram of an ambient sound monitoring method according to the present application;
FIG. 2 is a diagram of an ambient sound monitoring scenario according to an embodiment of the present application;
FIG. 3 is a schematic flow diagram of another ambient sound monitoring method according to the present application;
FIG. 4 is a block diagram of an ambient sound monitoring device according to the present application;
FIG. 5 is a block diagram of another ambient sound monitoring device according to the present application;
fig. 6 is a block diagram of an electronic device for implementing an ambient sound monitoring method according to an embodiment of the present application.
Detailed Description
The following description of the exemplary embodiments of the present application, taken in conjunction with the accompanying drawings, includes various details of the embodiments of the application for the understanding of the same, which are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
Example one.
In one embodiment, as shown in fig. 1, there is provided an ambient sound monitoring method, including:
step S10: acquiring an environmental sound monitoring result sent by a cloud end, wherein the environmental sound monitoring result is obtained by carrying out abnormal monitoring on environmental sound received by a voice device;
step S20: dividing an environment sound monitoring result into a plurality of sound abnormal events according to the time sequence of carrying out abnormal monitoring on the environment sound;
step S30: in the environmental sound monitoring interface, a plurality of sound abnormal events are displayed.
In one example, as shown in FIG. 2, a user may place a voice device in an environment that needs to be monitored. The environment to be monitored may typically be an indoor environment, an outdoor environment, or the like. The voice device can acquire sound around the environment and can play the sound. The voice device can comprise a smart voice device such as a smart speaker and the like which can be interacted with by a human-computer. The voice device can receive sound in an environment within a certain range and send the sound in the environment to the cloud in real time. And after receiving the environmental sound, the cloud identifies and analyzes abnormal sound in the environmental sound to obtain an environmental sound monitoring result. For example, the cloud can identify that there are crying of children, calling out for help, the sound of beating objects, the ringing of abnormal sounds and the like in the environmental sound, so that the abnormal sounds can be monitored in real time, and the attribute information such as the types and the time sequence of the abnormal sounds can be determined.
In the cloud, according to the time sequence of the anomaly monitoring, the time sequence of the occurrence of the events can be used. The environmental sound monitoring result is divided into a plurality of sound abnormal events, and each sound abnormal event corresponds to a time period. For example, a first sound anomaly event occurs in the six to six and a half morning, and the child is monitored for crying; the second sound abnormal event occurs at twelve to twelve tenths at noon, and the sound of the plate breaking is monitored. Certainly, after the cloud receives the environmental sound, the environmental sound can be stored. Similarly, the ambient sounds in each time period are stored in chronological order of occurrence to facilitate selective listening by the user according to time.
The cloud end can send the sound abnormal events to the mobile phone, the IPAD and other clients, and the sound abnormal events can be displayed according to a time sequence in an environment sound monitoring interface of a mobile phone application program of the client. In the environmental sound monitoring interface, a timeline is displayed, any point on the timeline is clicked, and the current time point and the content of the sound abnormal event, such as the type, the sensitivity level and the duration of the abnormal sound, can be displayed below the timeline, so that the user can conveniently view the abnormal sound. In addition, a real-time monitoring control is displayed in the interface, and a user can listen to the current environmental sound in real time by clicking the real-time monitoring control. A prompt key of 'one-key alarm' is also arranged in the interface, and when a sound abnormal event occurs and exceeds a threshold value, an alarm can be automatically given, for example, an alarm sound is given, or an alarm flash lamp and the like are provided. A one-key alarm control is also arranged in the interface, and when a user hears a sound abnormal event, the one-key alarm control can be directly triggered to make an alarm call to ask for help from the outside.
In one embodiment, the sound abnormal event includes a voice of the abnormal sound, a type of the abnormal sound, a sensitivity level, and a duration of the abnormal sound, as shown in fig. 3, step S30 includes:
step S301: in an environment sound monitoring interface, responding to abnormal sound playing operation, and generating a playing instruction;
step S302: playing the voice of the abnormal sound according to the playing instruction;
step S303: responding to the display operation of the sound abnormal event, and generating a display trigger instruction;
step S304: displaying at least one of a type, a sensitivity level, and a duration of the abnormal sound according to the display trigger instruction.
In one example, as shown in fig. 2, in an ambient sound monitoring interface of a client, a user clicks "real-time monitoring" to generate a play instruction, and the client plays a stored voice of an abnormal sound according to the play instruction. The client can also play the stored ambient sound in each time period according to the playing instruction. The user may also click a display button of an abnormal event in the interface, for example, the user clicks a time point 9 and 20 minutes on the timeline, and below the current time point of the timeline, the type of the abnormal sound displayed is crying of a child, the sensitivity level is level 2, the duration of the abnormal sound is 1 minute, clicks a "play audio" control, and listens to the environmental sound stored between 9 and 20 minutes and 9 and 26 minutes.
In the embodiment, the abnormal sound is stored to form the voice of the abnormal sound, so that a user can know the abnormal situation in the environment more conveniently by playing the voice of the abnormal sound in the past time period, and the abnormal situation in the environment can be judged more quickly and accurately by checking the type, the sensitivity level and the duration of the abnormal sound displayed in the environment sound monitoring interface.
In one embodiment, as shown in fig. 3, the method further includes:
step S40: and sending out an alarm signal when the sensitivity level is greater than or equal to the sensitivity threshold.
In one example, the monitored abnormal sound is classified into a sensitivity level. Different types of abnormal sounds are classified into different sensitivity levels. For example, if the abnormal sound type is a crying sound of a child, the sensitivity level may be determined according to the decibel number of the crying sound and whether the crying sound is abnormal. The grade can be divided into 5 grades, the sensitivity threshold is grade 3, and when the sensitivity grade exceeds grade 3, an alarm signal is sent out to prompt a user, such as a mother of a child, to take corresponding measures. If the abnormal sound type is the article's beating sound, the sensitivity level can be determined according to the decibel of the article's beating sound and the type of the article's sound being thrown. As another example, the system may be divided into 6 levels and an alarm signal may be issued when the sensitivity level exceeds level 2. The setting of the sensitivity level can quickly remind the user that an abnormal condition occurs in the monitored environment at the current moment.
In one embodiment, as shown in fig. 3, the method further includes:
step S11: in a monitoring starting interface, responding to a monitoring starting operation to generate a monitoring starting instruction;
step S12: and sending the monitoring starting instruction to a cloud end to analyze the monitoring starting instruction to obtain a starting control instruction of the voice equipment, wherein the starting control instruction is used for controlling the voice equipment to be started.
In this embodiment, as shown in fig. 2, a user can start a "monitoring mode" control in a monitoring interface of a client, and after the monitoring mode is started, the smart sound box actively monitors abnormal sounds in the environment, and sends sound abnormal events to the client through the cloud. A monitoring period may also be set, for example, monitoring from 6 am to 6 pm. Because the intelligent sound box placed in the monitoring environment can be remotely opened, the monitoring convenience is improved.
In one embodiment, as shown in fig. 3, after step S30, the method further includes:
step S50: receiving a feedback sound instruction, wherein the feedback sound instruction comprises sound fed back according to a plurality of sound abnormal events;
step S60: and sending the feedback voice command to a cloud end to analyze the feedback voice command to obtain a feedback voice playing command, wherein the feedback voice playing command is used for controlling the voice equipment to play feedback voice.
In the present embodiment, the user listens to the abnormal sound, or checks the type, sensitivity level, and duration of the abnormal sound, and determines the abnormal situation. The user sends the feedback voice to the cloud end through the mobile phone and other clients, and the cloud end analyzes the feedback information to obtain the feedback information. The cloud sends the feedback information to the voice equipment in the monitored environment, and the voice equipment plays feedback sound according to the feedback information. For example, when the user hears the cry of a child, the user can send a voice "baby cries while mom goes home" through the mobile phone, and control the smart sound box to play the voice. The method can guide people of abnormal events in the environment in time.
Example two
In another embodiment, as shown in fig. 4, there is provided an ambient sound monitoring apparatus 100 including:
the voice monitoring result acquiring module 101 is configured to acquire an ambient voice monitoring result sent by a cloud, where the ambient voice monitoring result is obtained by performing abnormal monitoring on an ambient voice received by a voice device;
the sound abnormal event dividing module 102 is configured to divide an environmental sound analysis result into a plurality of sound abnormal events according to a time sequence of performing abnormality monitoring on the environmental sound;
the sound abnormal event presentation module 103 is configured to present a plurality of sound abnormal events in the environmental sound monitoring interface.
In one embodiment, the sound abnormal event includes the voice of the abnormal sound, the type of the abnormal sound, the sensitivity level, and the duration of the abnormal sound, and as shown in fig. 5, the sound abnormal event presenting module 103 includes:
a playing instruction generating unit 1031, configured to generate a playing instruction in response to an abnormal sound playing operation in the environmental sound monitoring interface;
an abnormal sound playing unit 1032 for playing the voice of the abnormal sound according to the playing instruction;
a display trigger instruction generating unit 1033 configured to generate a display trigger instruction in response to the sound abnormal event display operation;
the abnormal sound event display unit 1034 displays at least one of the type, sensitivity level, and duration of the abnormal sound according to the display trigger instruction.
In one embodiment, as shown in fig. 5, the method further includes:
and the abnormity alarm module 104 is used for sending out an alarm signal when the sensitivity level is greater than or equal to the sensitivity threshold.
In one embodiment, as shown in fig. 5, the method further includes:
a monitoring start instruction generating module 105, configured to generate a monitoring start instruction in response to a monitoring start operation in a monitoring start interface;
and the monitoring starting instruction sending module 106 is configured to send the monitoring starting instruction to the cloud, so as to analyze the monitoring starting instruction to obtain a starting control instruction of the voice device, where the starting control instruction is used to control the voice device to start.
In one embodiment, as shown in fig. 5, the method further includes:
a feedback sound instruction receiving module 107, configured to receive a feedback sound instruction, where the feedback sound instruction includes a sound fed back according to a plurality of sound abnormal events;
and the feedback voice instruction sending module 108 is configured to send the feedback voice instruction to the cloud end to analyze the feedback voice instruction to obtain a feedback voice playing instruction, where the feedback voice playing instruction is used to control the voice device to play feedback voice.
According to an embodiment of the present application, an electronic device and a readable storage medium are also provided.
Fig. 6 is a block diagram of an electronic device according to an embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.
As shown in fig. 6, the electronic apparatus includes: one or more processors 601, memory 602, and interfaces for connecting the various components, including a high-speed interface and a low-speed interface. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the electronic device, including instructions stored in or on the memory to display Graphical information for a Graphical User Interface (GUI) on an external input/output device, such as a display device coupled to the Interface. In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple electronic devices may be connected, with each device providing portions of the necessary operations (e.g., as a server array, a group of blade servers, or a multi-processor system). In fig. 6, one processor 601 is taken as an example.
The memory 602 is a non-transitory computer readable storage medium as provided herein. The memory stores instructions executable by at least one processor to cause the at least one processor to perform the ambient sound monitoring method provided herein. The non-transitory computer-readable storage medium of the present application stores computer instructions for causing a computer to execute the ambient sound monitoring method provided by the present application.
The memory 602, as a non-transitory computer readable storage medium, may be used to store non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules corresponding to the ambient sound monitoring method in the embodiment of the present application (for example, xx module X01, xx module X02, and xx module X03 shown in fig. X). The processor 601 executes various functional applications of the server and data processing by running non-transitory software programs, instructions and modules stored in the memory 602, that is, implements the ambient sound monitoring method in the above method embodiment.
The memory 602 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the electronic device monitored for the environmental sound, and the like. Further, the memory 602 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 602 optionally includes memory located remotely from the processor 601, and these remote memories may be connected over a network to an electronic device for ambient sound monitoring. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device of the ambient sound monitoring method may further include: an input device 603 and an output device 604. The processor 601, the memory 602, the input device 603 and the output device 604 may be connected by a bus or other means, and fig. 6 illustrates the connection by a bus as an example.
The input device 603 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic equipment for ambient sound monitoring, such as a touch screen, keypad, mouse, track pad, touch pad, pointer stick, one or more mouse buttons, track ball, joystick, or other input device. The output devices 604 may include a display device, auxiliary lighting devices (e.g., LEDs), and tactile feedback devices (e.g., vibrating motors), among others. The display device may include, but is not limited to, a Liquid Crystal Display (LCD) such as a Cr6 star display 6, a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device can be a touch screen.
Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, Integrated circuitry, Application Specific Integrated Circuits (ASICs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
These computer programs (also known as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (Cathode ray Tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area networks (wans), and the internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
According to the technical scheme of the embodiment of the application, the environment sound is subjected to abnormity monitoring, the environment sound monitoring result is divided into the sound abnormal events according to the time sequence, and the sound abnormal events are displayed in the environment sound monitoring interface of the client, so that a user can not only quickly find the abnormity in the environment, but also check the sound abnormal events displayed according to the time sequence through the client, and the environment monitoring efficiency is improved.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present application may be executed in parallel, sequentially, or in different orders, and the present invention is not limited thereto as long as the desired results of the technical solutions disclosed in the present application can be achieved.
The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (12)
1. An environmental sound monitoring method, comprising:
acquiring an environmental sound monitoring result sent by a cloud, wherein the environmental sound monitoring result is obtained by carrying out abnormal monitoring on environmental sound received by a voice device;
dividing the environmental sound monitoring result into a plurality of sound abnormal events according to the time sequence of carrying out abnormal monitoring on the environmental sound;
and displaying the plurality of sound abnormal events in an environment sound monitoring interface.
2. The method of claim 1, wherein the acoustic exception event comprises a voice of an exception sound, a type of the exception sound, a sensitivity level, a duration of the exception sound, and wherein presenting the plurality of acoustic exception events in an ambient sound monitoring interface comprises:
in the environment sound monitoring interface, responding to abnormal sound playing operation and generating a playing instruction;
playing the voice of the abnormal sound according to the playing instruction;
responding to the sound abnormal event display operation, and generating a display trigger instruction;
displaying at least one of the type of the abnormal sound, the sensitivity level, and the duration of the abnormal sound according to the display trigger instruction.
3. The method of claim 2, further comprising:
and sending out an alarm signal when the sensitivity level is greater than or equal to a sensitivity threshold value.
4. The method of claim 1, further comprising:
in a monitoring starting interface, responding to a monitoring starting operation to generate a monitoring starting instruction;
and sending the monitoring starting instruction to the cloud end so as to analyze the monitoring starting instruction to obtain a starting control instruction of the voice equipment, wherein the starting control instruction is used for controlling the voice equipment to be started.
5. The method of claim 1, wherein after triggering the plurality of acoustic exception events, further comprising:
receiving a feedback sound instruction, wherein the feedback sound instruction comprises sound fed back according to the sound abnormal events;
and sending the feedback voice instruction to the cloud end to analyze the feedback voice instruction to obtain a feedback voice playing instruction, wherein the feedback voice playing instruction is used for controlling the voice equipment to play the feedback voice.
6. An ambient sound monitoring device, comprising:
the voice monitoring system comprises a voice monitoring result acquisition module, a voice processing module and a voice processing module, wherein the voice monitoring result acquisition module is used for acquiring an environmental voice monitoring result sent by a cloud end, and the environmental voice monitoring result is obtained by carrying out abnormal monitoring on environmental voice received by voice equipment;
the sound abnormal event dividing module is used for dividing the environmental sound analysis result into a plurality of sound abnormal events according to the time sequence of carrying out abnormal monitoring on the environmental sound;
and the sound abnormal event display module is used for displaying the plurality of sound abnormal events in the environment sound monitoring interface.
7. The apparatus of claim 6, wherein the sound abnormal event comprises a voice of an abnormal sound, a type of the abnormal sound, a sensitivity level, and a duration of the abnormal sound, and the sound abnormal event presentation module comprises:
the playing instruction generating unit is used for responding to abnormal sound playing operation in the environment sound monitoring interface and generating a playing instruction;
the abnormal sound playing unit is used for playing the voice of the abnormal sound according to the playing instruction;
the display trigger instruction generating unit is used for responding to the sound abnormal event display operation and generating a display trigger instruction;
and the abnormal sound event display unit is used for displaying at least one of the type of the abnormal sound, the sensitivity level and the duration of the abnormal sound according to the display triggering instruction.
8. The apparatus of claim 7, further comprising:
and the abnormity alarm module is used for sending out an alarm signal under the condition that the sensitivity level is greater than or equal to the sensitivity threshold value.
9. The apparatus of claim 6, further comprising:
the monitoring starting instruction generating module is used for responding to monitoring starting operation in a monitoring starting interface and generating a monitoring starting instruction;
and the monitoring starting instruction sending module is used for sending the monitoring starting instruction to the cloud end so as to analyze the monitoring starting instruction to obtain a starting control instruction of the voice equipment, and the starting control instruction is used for controlling the voice equipment to be started.
10. The apparatus of claim 6, further comprising:
a feedback sound instruction receiving module, configured to receive a feedback sound instruction, where the feedback sound instruction includes sound fed back according to the multiple sound abnormal events;
and the feedback voice instruction sending module is used for sending the feedback voice instruction to the cloud end so as to analyze the feedback voice instruction to obtain a feedback voice playing instruction, and the feedback voice playing instruction is used for controlling the voice equipment to play the feedback voice.
11. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-5.
12. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910783033.0A CN110489076B (en) | 2019-08-22 | 2019-08-22 | Environment sound monitoring method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910783033.0A CN110489076B (en) | 2019-08-22 | 2019-08-22 | Environment sound monitoring method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110489076A true CN110489076A (en) | 2019-11-22 |
| CN110489076B CN110489076B (en) | 2024-03-01 |
Family
ID=68553203
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910783033.0A Active CN110489076B (en) | 2019-08-22 | 2019-08-22 | Environment sound monitoring method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110489076B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112991673A (en) * | 2019-12-13 | 2021-06-18 | 宇龙计算机通信科技(深圳)有限公司 | Household abnormity monitoring method and device, storage medium and electronic equipment |
| CN113838478A (en) * | 2020-06-08 | 2021-12-24 | 华为技术有限公司 | Abnormal event detection method and device and electronic equipment |
| CN113921036A (en) * | 2021-10-12 | 2022-01-11 | 深圳Tcl数字技术有限公司 | Monitoring method, monitoring device and storage medium |
| CN114067828A (en) * | 2020-08-03 | 2022-02-18 | 阿里巴巴集团控股有限公司 | Acoustic event detection method, device, equipment and storage medium |
| CN114121050A (en) * | 2021-11-30 | 2022-03-01 | 云知声智能科技股份有限公司 | Audio playing method and device, electronic equipment and storage medium |
| CN115240302A (en) * | 2022-07-18 | 2022-10-25 | 珠海格力电器股份有限公司 | Method and device for monitoring indoor safety environment, electronic equipment and storage medium |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100142725A1 (en) * | 2008-09-11 | 2010-06-10 | Personics Holdings Inc. | Method and system for sound monitoring over a network |
| US20140317710A1 (en) * | 2013-04-23 | 2014-10-23 | Canary Connect, Inc. | Method for connecting devices to a network through an audio cable and a user device |
| CN104836857A (en) * | 2015-05-07 | 2015-08-12 | 广东欧珀移动通信有限公司 | Anti-theft method based on smart sound box, anti-theft device based on smart sound box, smart sound box and mobile terminal |
| CN105681062A (en) * | 2014-11-18 | 2016-06-15 | 小米科技有限责任公司 | Safety monitoring method and apparatus |
| JP2016118987A (en) * | 2014-12-22 | 2016-06-30 | パナソニックＩｐマネジメント株式会社 | Abnormality sound detection system |
| CN106683361A (en) * | 2017-01-24 | 2017-05-17 | 宇龙计算机通信科技(深圳)有限公司 | Sound monitoring method and device |
| CN106887122A (en) * | 2015-12-15 | 2017-06-23 | 美的集团股份有限公司 | Method, device and the audio amplifier alarmed by audio amplifier |
| US20180113577A1 (en) * | 2016-10-26 | 2018-04-26 | Google Inc. | Timeline-Video Relationship Presentation for Alert Events |
| KR20190028016A (en) * | 2017-09-08 | 2019-03-18 | 주식회사 케이티 | Apparatus for monitoring home, method and computer program |
| US10296194B2 (en) * | 2015-06-14 | 2019-05-21 | Google Llc | Methods and systems for presenting alert event indicators |
| CN109785581A (en) * | 2019-02-26 | 2019-05-21 | 珠海格力电器股份有限公司 | Monitoring method, monitoring device, storage medium and equipment |
-
2019
- 2019-08-22 CN CN201910783033.0A patent/CN110489076B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100142725A1 (en) * | 2008-09-11 | 2010-06-10 | Personics Holdings Inc. | Method and system for sound monitoring over a network |
| US20140317710A1 (en) * | 2013-04-23 | 2014-10-23 | Canary Connect, Inc. | Method for connecting devices to a network through an audio cable and a user device |
| CN105681062A (en) * | 2014-11-18 | 2016-06-15 | 小米科技有限责任公司 | Safety monitoring method and apparatus |
| JP2016118987A (en) * | 2014-12-22 | 2016-06-30 | パナソニックＩｐマネジメント株式会社 | Abnormality sound detection system |
| CN104836857A (en) * | 2015-05-07 | 2015-08-12 | 广东欧珀移动通信有限公司 | Anti-theft method based on smart sound box, anti-theft device based on smart sound box, smart sound box and mobile terminal |
| US10296194B2 (en) * | 2015-06-14 | 2019-05-21 | Google Llc | Methods and systems for presenting alert event indicators |
| CN106887122A (en) * | 2015-12-15 | 2017-06-23 | 美的集团股份有限公司 | Method, device and the audio amplifier alarmed by audio amplifier |
| US20180113577A1 (en) * | 2016-10-26 | 2018-04-26 | Google Inc. | Timeline-Video Relationship Presentation for Alert Events |
| CN106683361A (en) * | 2017-01-24 | 2017-05-17 | 宇龙计算机通信科技(深圳)有限公司 | Sound monitoring method and device |
| KR20190028016A (en) * | 2017-09-08 | 2019-03-18 | 주식회사 케이티 | Apparatus for monitoring home, method and computer program |
| CN109785581A (en) * | 2019-02-26 | 2019-05-21 | 珠海格力电器股份有限公司 | Monitoring method, monitoring device, storage medium and equipment |
Non-Patent Citations (2)
| Title |
|---|
| OSCAL T.-C. CHEN 等: ""Voice-Activity Home Care System"", 《IEEE》, 21 April 2016 (2016-04-21), pages 110 - 113 * |
| 马士乾: ""基于UBM和PLDA的异常声识别方法研究"", 《中国优秀硕士学位论文全文数据库(信息科技辑)》, no. 2019, 15 February 2019 (2019-02-15), pages 6 - 29 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112991673A (en) * | 2019-12-13 | 2021-06-18 | 宇龙计算机通信科技(深圳)有限公司 | Household abnormity monitoring method and device, storage medium and electronic equipment |
| CN113838478A (en) * | 2020-06-08 | 2021-12-24 | 华为技术有限公司 | Abnormal event detection method and device and electronic equipment |
| CN113838478B (en) * | 2020-06-08 | 2024-04-09 | 华为技术有限公司 | Abnormal event detection method and device and electronic equipment |
| CN114067828A (en) * | 2020-08-03 | 2022-02-18 | 阿里巴巴集团控股有限公司 | Acoustic event detection method, device, equipment and storage medium |
| CN113921036A (en) * | 2021-10-12 | 2022-01-11 | 深圳Tcl数字技术有限公司 | Monitoring method, monitoring device and storage medium |
| CN114121050A (en) * | 2021-11-30 | 2022-03-01 | 云知声智能科技股份有限公司 | Audio playing method and device, electronic equipment and storage medium |
| CN115240302A (en) * | 2022-07-18 | 2022-10-25 | 珠海格力电器股份有限公司 | Method and device for monitoring indoor safety environment, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110489076B (en) | 2024-03-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110489076B (en) | Environment sound monitoring method and device and electronic equipment | |
| US20210092195A1 (en) | Information push method and device | |
| CN112416284B (en) | Method, apparatus, device and storage medium for sharing screen | |
| CN111669438B (en) | Live broadcast message transmission method and device, electronic equipment and medium | |
| CN112533041A (en) | Video playing method and device, electronic equipment and readable storage medium | |
| CN111782433A (en) | Exception troubleshooting method, device, electronic equipment and storage medium | |
| US10380867B2 (en) | Alert management within a network based virtual collaborative space | |
| KR102488582B1 (en) | Method and apparatus for verifying operation state of application | |
| EP3796308A1 (en) | Speech recognition control method and apparatus, electronic device and readable storage medium | |
| CN110768877B (en) | Voice control instruction processing method and device, electronic equipment and readable storage medium | |
| CN107025143A (en) | Notifier processes method, device and the communication terminal of a kind of application message | |
| CN112003778B (en) | Message processing method, device, equipment and computer storage medium | |
| CN112491858B (en) | Method, device, equipment and storage medium for detecting abnormal information | |
| CN110933227A (en) | Assistance method, device, equipment and medium for intelligent terminal | |
| CN110535960A (en) | Method for early warning, device and electronic equipment | |
| US11126260B2 (en) | Control method and apparatus of intelligent device, and storage medium | |
| CN110477866B (en) | Method and device for detecting sleep quality, electronic equipment and storage medium | |
| US9922532B2 (en) | Wearable computing system with temporal feedback during a presentation | |
| CN113591515A (en) | Concentration processing method, device and storage medium | |
| CN110738462A (en) | Plan management method, plan management device, electronic device, and storage medium | |
| US20170272705A1 (en) | Multimedia playing system for automatically notifying abnormal situations and information processing method of the same | |
| CN104199632B (en) | Method and device for determining sound effect setting | |
| CN111767170A (en) | Operation restoration method and device for equipment, equipment and storage medium | |
| CN112817686A (en) | Method, device and equipment for detecting exception of virtual machine and computer storage medium | |
| CN113495976A (en) | Content display method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210513 Address after: 100085 Baidu Building, 10 Shangdi Tenth Street, Haidian District, Beijing Applicant after: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) Co.,Ltd. Applicant after: Shanghai Xiaodu Technology Co.,Ltd. Address before: 100085 Baidu Building, 10 Shangdi Tenth Street, Haidian District, Beijing Applicant before: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |