CN110489076B - Environment sound monitoring method and device and electronic equipment - Google Patents
Environment sound monitoring method and device and electronic equipment Download PDFInfo
- Publication number
- CN110489076B CN110489076B CN201910783033.0A CN201910783033A CN110489076B CN 110489076 B CN110489076 B CN 110489076B CN 201910783033 A CN201910783033 A CN 201910783033A CN 110489076 B CN110489076 B CN 110489076B
- Authority
- CN
- China
- Prior art keywords
- sound
- monitoring
- abnormal
- instruction
- voice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 136
- 238000000034 method Methods 0.000 title claims abstract description 36
- 230000002159 abnormal effect Effects 0.000 claims abstract description 123
- 230000007613 environmental effect Effects 0.000 claims abstract description 61
- 230000005856 abnormality Effects 0.000 claims abstract description 33
- 238000012806 monitoring device Methods 0.000 claims abstract description 6
- 230000035945 sensitivity Effects 0.000 claims description 44
- 230000015654 memory Effects 0.000 claims description 17
- 206010011469 Crying Diseases 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000004590 computer program Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000010009 beating Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001151 other effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000004549 pulsed laser deposition Methods 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/72—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for transmitting results of analysis
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Abstract
The application discloses an environmental sound monitoring method, an environmental sound monitoring device and electronic equipment, and relates to the field of sound monitoring. The specific implementation scheme is as follows: the method comprises the steps of obtaining an environmental sound monitoring result sent by a cloud, wherein the environmental sound monitoring result is obtained by carrying out abnormal monitoring on environmental sound received by voice equipment; dividing the environmental sound monitoring result into a plurality of sound abnormal events according to the time sequence of carrying out abnormal monitoring on the environmental sound; in the ambient sound monitoring interface, a plurality of sound anomalies are presented. The user can not only quickly find the abnormality in the environment, but also can check a plurality of sound abnormal events displayed according to the time sequence through the client, and the efficiency of environment monitoring is improved.
Description
Technical Field
The application relates to the field of environmental monitoring, in particular to the field of sound monitoring.
Background
At present, the home environment is monitored by installing a monitor in a room, and a user can turn on a camera in a mobile client such as a mobile phone and the like to monitor by observing pictures in the room. However, the camera has a monitoring dead angle, and if a danger occurs in a place which cannot be monitored, a user cannot directly find the danger from the video of the mobile phone end. Therefore, the monitoring effect of the camera on the home environment is not good at present.
Disclosure of Invention
The embodiment of the application provides an environmental sound monitoring method, an environmental sound monitoring device and electronic equipment, which are used for solving one or more technical problems in the prior art.
In a first aspect, an embodiment of the present application provides an environmental sound monitoring method, including:
the method comprises the steps of obtaining an environmental sound monitoring result sent by a cloud, wherein the environmental sound monitoring result is obtained by carrying out abnormal monitoring on environmental sound received by voice equipment;
dividing the analysis result of the environmental sound into a plurality of sound abnormal events according to the time sequence of monitoring the abnormality of the environmental sound;
in the ambient sound monitoring interface, a plurality of sound anomalies are presented.
In the embodiment, the environment sound is monitored abnormally, the environment sound monitoring result is divided into a plurality of sound abnormal events according to the time sequence, and the sound abnormal events are displayed in the environment sound monitoring interface of the client, so that a user can not only quickly find out the abnormality in the environment, but also can view the plurality of sound abnormal events displayed according to the time sequence through the client, and the efficiency of environment monitoring is improved.
In one embodiment, the sound anomaly event includes a voice of an anomaly sound, a type of the anomaly sound, a sensitivity level, a duration of the anomaly sound, and presenting a plurality of sound anomaly events in an ambient sound monitoring interface, including:
in the environment sound monitoring interface, responding to abnormal sound playing operation, and generating a playing instruction;
playing the voice of the abnormal sound according to the playing instruction;
responding to the sound abnormal event display operation, and generating a display trigger instruction;
at least one of the type, the sensitivity level, and the duration of the abnormal sound is displayed according to the display trigger instruction.
In this embodiment, the abnormal sound is stored to form the voice of the abnormal sound, so that the user can more conveniently and quickly understand the abnormal situation in the environment by playing the voice of the abnormal sound in the past time period, and can also more quickly and accurately determine the abnormal situation in the environment by checking the type, the sensitivity level and the duration of the abnormal sound displayed in the environment sound monitoring interface.
In one embodiment, the method further comprises:
and sending out an alarm signal under the condition that the sensitivity level is greater than or equal to the sensitivity threshold.
In this embodiment, the monitored abnormal sound is classified into a sensitivity level, the sensitivity level is compared with a sensitivity threshold, and an alarm is timely sent out to timely and rapidly remind the user that an abnormal condition occurs in the monitored environment at the current moment.
In one embodiment, the method further comprises:
in the monitoring opening interface, responding to the monitoring opening operation, and generating a monitoring opening instruction;
and sending the monitoring start instruction to the cloud to analyze the monitoring start instruction to obtain a start control instruction of the voice equipment, wherein the start control instruction is used for controlling the voice equipment to start.
In the embodiment, the user can remotely control the voice equipment by starting the voice equipment placed in the monitoring environment in the monitoring interface of the client, so that the monitoring convenience is improved.
In one embodiment, after presenting the plurality of sound abnormality events, further comprising:
receiving a feedback sound instruction, wherein the feedback sound instruction comprises sound fed back according to a plurality of sound abnormal events;
and sending the feedback voice command to the cloud end so as to analyze the feedback voice command to obtain a feedback voice playing command, wherein the feedback voice playing command is used for controlling the voice equipment to play the feedback voice.
In this embodiment, the user receives the voice of the abnormal sound, or checks the type, the sensitivity level and the duration of the abnormal sound, and after judging the abnormal situation, sends the feedback information to the voice device in the monitored environment in real time through the cloud, and the voice device plays the feedback sound, so that the user of the abnormal event in the environment can be guided in time.
In a second aspect, an embodiment of the present application provides an environmental sound monitoring apparatus, including:
the sound monitoring result acquisition module is used for acquiring an environmental sound monitoring result sent by the cloud, wherein the environmental sound monitoring result is obtained by carrying out abnormal monitoring on environmental sound received by the voice equipment;
the sound abnormal event dividing module is used for dividing the analysis result of the environmental sound into a plurality of sound abnormal events according to the time sequence of abnormal monitoring of the environmental sound;
the sound abnormal event display module is used for displaying a plurality of sound abnormal events in the environment sound monitoring interface.
In one embodiment, the sound abnormality event includes a voice of an abnormality sound, a type of the abnormality sound, a sensitivity level, a duration of the abnormality sound, and the sound abnormality event presentation module includes:
the playing instruction generating unit is used for responding to the abnormal sound playing operation in the environment sound monitoring interface to generate a playing instruction;
the abnormal sound playing unit is used for playing the voice of the abnormal sound according to the playing instruction;
a display trigger instruction generation unit configured to generate a display trigger instruction in response to a sound abnormality event display operation;
and an abnormal sound event display unit for displaying at least one of a type, a sensitivity level, and a duration of the abnormal sound according to the display trigger instruction.
In one embodiment, the method further comprises:
and the abnormal alarm module is used for sending an alarm signal under the condition that the sensitivity level is greater than or equal to the sensitivity threshold.
In one embodiment, the method further comprises:
the monitoring opening instruction generation module is used for responding to the monitoring opening operation in the monitoring opening interface to generate a monitoring opening instruction;
the monitoring opening instruction sending module is used for sending the monitoring opening instruction to the cloud end so as to analyze the monitoring opening instruction and obtain an opening control instruction of the voice equipment, and the opening control instruction is used for controlling the voice equipment to be opened.
In one embodiment, the method further comprises:
the feedback sound instruction receiving module is used for receiving a feedback sound instruction, wherein the feedback sound instruction comprises sound fed back according to a plurality of sound abnormal events;
the feedback voice command sending module is used for sending the feedback voice command to the cloud end so as to analyze the feedback voice command to obtain a feedback voice playing command, and the feedback voice playing command is used for controlling the voice equipment to play the feedback voice.
One embodiment of the above application has the following advantages or benefits: the method comprises the following steps of performing anomaly monitoring on environmental sound, dividing an environmental sound monitoring result into a plurality of sound anomaly events according to a time sequence, and displaying the sound anomaly events in an environmental sound monitoring interface of a client. The technical problems that the current camera is not timely for environment monitoring and has poor effect are solved, and therefore a user can quickly find out the abnormality in the environment, and can check a plurality of abnormal sound events displayed according to time sequence through the client, so that the technical effect of the efficiency of environment monitoring is improved.
Other effects of the above alternative will be described below in connection with specific embodiments.
Drawings
The drawings are for better understanding of the present solution and do not constitute a limitation of the present application. Wherein:
FIG. 1 is a flow chart of an ambient sound monitoring method according to the present application;
FIG. 2 is an ambient sound monitoring scenario diagram according to an implementation of one embodiment of the present application;
FIG. 3 is a flow chart of another ambient sound monitoring method according to the present application;
FIG. 4 is a block diagram of an ambient sound monitoring device according to the present application;
FIG. 5 is a block diagram of another environmental sound monitoring device according to the present application;
fig. 6 is a block diagram of an electronic device for implementing an ambient sound monitoring method according to an embodiment of the present application.
Detailed Description
Exemplary embodiments of the present application are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present application to facilitate understanding, and should be considered as merely exemplary. Accordingly, one of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
Example one.
In one embodiment, as shown in fig. 1, there is provided an environmental sound monitoring method, including:
step S10: the method comprises the steps of obtaining an environmental sound monitoring result sent by a cloud, wherein the environmental sound monitoring result is obtained by carrying out abnormal monitoring on environmental sound received by voice equipment;
step S20: dividing the environmental sound monitoring result into a plurality of sound abnormal events according to the time sequence of carrying out abnormal monitoring on the environmental sound;
step S30: in the ambient sound monitoring interface, a plurality of sound anomalies are presented.
In one example, as shown in FIG. 2, a user may place a voice device in an environment that needs to be monitored. The environment to be monitored may be an indoor environment, an outdoor environment, etc. The voice device is capable of capturing sounds surrounding the environment and playing the sounds. The voice device may include a smart voice device such as a smart speaker that is capable of human-machine interaction. The voice equipment can receive sounds in the environment within a certain range and send the sounds in the environment to the cloud in real time. After the cloud receives the environmental sound, the abnormal sound in the environmental sound is identified and analyzed, and an environmental sound monitoring result is obtained. For example, the cloud can recognize that the environment sound has crying sounds of children, crying sounds of help, sounds of articles being beaten, abnormal sounds and the like, so that the abnormal sounds can be monitored in real time, and attribute information such as types and time sequence time of the abnormal sounds can be determined.
In the cloud, according to the time sequence of anomaly monitoring, the time sequence of occurrence of the event may be mentioned. The environmental sound monitoring result is divided into a plurality of sound abnormal events, and each sound abnormal event corresponds to a time period. For example, the first sound anomaly event occurs six to six and a half in the morning, monitoring the child for crying; the second sound abnormality occurs in twelve ten minutes to twelve minutes in noon, the sound of a broken dish is monitored, etc. Of course, after the cloud receives the environmental sound, the cloud may store the environmental sound. Likewise, the ambient sounds within each time period are stored in chronological order to facilitate user selection of listening based on time.
The cloud can send the plurality of sound abnormal events to the mobile phone, the IPAD and other clients, and the plurality of sound abnormal events can be displayed in time sequence in an environment sound monitoring interface of a mobile phone application program of the client. In the environment sound monitoring interface, a time line is displayed, any point on the time line is clicked, and the current time point and the content of the sound abnormal event, such as the type, the sensitivity level, the duration time and the like of the abnormal sound, can be displayed below the time line, so that the user can conveniently view the abnormal sound. In addition, a control for 'real-time monitoring' is displayed in the interface, and a user can listen to the current environmental sound in real time by clicking the control. The interface is also provided with a prompt key of 'one-key alarm', and when an abnormal sound event occurs and exceeds a threshold value, the interface can automatically alarm, for example, an alarm sound is sent out, or an alarm flash lamp and the like are used. The interface is also provided with a control of one-key alarming, when a user hears an abnormal sound event, the control of one-key alarming can be directly triggered, an alarming telephone is dialed, and external help seeking is performed.
In one embodiment, the sound abnormality event includes a voice of the abnormality sound, a type of the abnormality sound, a sensitivity level, a duration of the abnormality sound, as shown in fig. 3, step S30 includes:
step S301: in the environment sound monitoring interface, responding to abnormal sound playing operation, and generating a playing instruction;
step S302: playing the voice of the abnormal sound according to the playing instruction;
step S303: responding to the sound abnormal event display operation, and generating a display trigger instruction;
step S304: at least one of the type, the sensitivity level, and the duration of the abnormal sound is displayed according to the display trigger instruction.
In one example, as shown in fig. 2, in the environmental sound monitoring interface of the client, the user clicks "real-time monitoring" to generate a play command, and the client plays the voice of the stored abnormal sound according to the play command. The client can also play the stored environmental sounds in each time period according to the play instruction. The user may also click on a display button of the abnormal event in the interface, for example, the user clicks on the time point 9 to 20 minutes on the timeline, below the current time of the timeline, the type of abnormal sound is displayed as a child crying, the sensitivity level is level 2, the duration of the abnormal sound is 1 minute, clicks on the "play audio" control, and listens to the ambient sound stored between 9 to 20 minutes and 9 to 26 minutes.
In this embodiment, the abnormal sound is stored to form the voice of the abnormal sound, so that the user can more conveniently and quickly understand the abnormal situation in the environment by playing the voice of the abnormal sound in the past time period, and can also more quickly and accurately determine the abnormal situation in the environment by checking the type, the sensitivity level and the duration of the abnormal sound displayed in the environment sound monitoring interface.
In one embodiment, as shown in fig. 3, further comprising:
step S40: and sending out an alarm signal under the condition that the sensitivity level is greater than or equal to the sensitivity threshold.
In one example, the sensitivity level of the detected abnormal sound is classified. Different types of abnormal sounds, different classes of sensitivity are classified. For example, if the type of abnormal sound is a child's cry, the sensitivity level may be determined based on the decibel number of the cry, whether the cry is abnormal or not. The method can be divided into 5 grades, the sensitivity threshold is grade 3, and when the sensitivity grade exceeds grade 3, an alarm signal is sent to prompt a user, such as a mother of a child, to take corresponding measures. If the abnormal sound type is the beating sound of the article, the sensitivity level can be determined according to the decibel number of the beating sound of the article and the sound type of the article to be beaten. For another example, the sensitivity level can be classified into 6 levels, and when the sensitivity level exceeds the level 2, an alarm signal is sent. The setting of the sensitivity level rapidly reminds the user that an abnormal condition occurs in the monitored environment at the current moment.
In one embodiment, as shown in fig. 3, further comprising:
step S11: in the monitoring opening interface, responding to the monitoring opening operation, and generating a monitoring opening instruction;
step S12: and sending the monitoring start instruction to the cloud to analyze the monitoring start instruction to obtain a start control instruction of the voice equipment, wherein the start control instruction is used for controlling the voice equipment to start.
In this embodiment, as shown in fig. 2, a user may start a "monitoring mode" control in a monitoring interface of a client, and after the monitoring mode is started, the intelligent sound box actively monitors abnormal sounds in the environment and sends a sound abnormal event to the client through the cloud. A monitoring period may also be set, for example, 6 am to 6 pm monitoring. The intelligent sound box placed in the monitoring environment can be remotely opened, so that the monitoring convenience is improved.
In one embodiment, as shown in fig. 3, after step S30, the method further includes:
step S50: receiving a feedback sound instruction, wherein the feedback sound instruction comprises sound fed back according to a plurality of sound abnormal events;
step S60: and sending the feedback voice command to the cloud end so as to analyze the feedback voice command to obtain a feedback voice playing command, wherein the feedback voice playing command is used for controlling the voice equipment to play the feedback voice.
In this embodiment, the user hears the voice of the abnormal sound, or checks the type, sensitivity level, and duration of the abnormal sound, and makes a judgment on the abnormal situation. The user sends the feedback voice to the cloud end through the client end such as the mobile phone, and the cloud end analyzes the feedback information to obtain the feedback information. And the cloud sends the feedback information to voice equipment in the monitored environment, and the voice equipment plays feedback sound according to the feedback information. For example, when a user hears a crying sound of a child, the user can send a voice of 'baby cry, mother immediately returns home', and control the intelligent sound box to play the voice. The method can guide people in the environment in time in case of abnormal events.
Example two
In another embodiment, as shown in fig. 4, there is provided an ambient sound monitoring device 100, comprising:
the sound monitoring result obtaining module 101 is configured to obtain an environmental sound monitoring result sent by the cloud, where the environmental sound monitoring result is obtained by performing anomaly monitoring on environmental sound received by the voice device;
the sound abnormal event dividing module 102 is configured to divide the analysis result of the environmental sound into a plurality of sound abnormal events according to the time sequence of performing abnormal monitoring on the environmental sound;
the sound abnormal event presenting module 103 is configured to present a plurality of sound abnormal events in the environmental sound monitoring interface.
In one embodiment, the sound abnormality event includes a voice of an abnormality sound, a type of the abnormality sound, a sensitivity level, a duration of the abnormality sound, as shown in fig. 5, the sound abnormality event presentation module 103 includes:
a play instruction generation unit 1031 for generating a play instruction in response to an abnormal sound play operation in the environmental sound monitoring interface;
an abnormal sound playing unit 1032 for playing the voice of the abnormal sound according to the playing instruction;
a display trigger generation unit 1033 for generating a display trigger in response to a sound abnormality event display operation;
an abnormal sound event display unit 1034 for displaying at least one of the type, the sensitivity level, and the duration of the abnormal sound according to the display trigger instruction.
In one embodiment, as shown in fig. 5, further comprising:
the anomaly alarm module 104 is configured to send an alarm signal when the sensitivity level is greater than or equal to the sensitivity threshold.
In one embodiment, as shown in fig. 5, further comprising:
a monitor start instruction generation module 105, configured to generate a monitor start instruction in response to a monitor start operation in a monitor start interface;
the monitoring start command sending module 106 is configured to send the monitoring start command to the cloud end, so as to parse the monitoring start command, obtain a start control command of the voice device, where the start control command is used to control the start of the voice device.
In one embodiment, as shown in fig. 5, further comprising:
a feedback sound instruction receiving module 107, configured to receive a feedback sound instruction, where the feedback sound instruction includes sounds that are fed back according to a plurality of sound abnormal events;
the feedback voice command sending module 108 is configured to send the feedback voice command to the cloud end, so as to parse the feedback voice command to obtain a feedback voice playing command, where the feedback voice playing command is used to control the voice device to play the feedback voice.
According to embodiments of the present application, an electronic device and a readable storage medium are also provided.
As shown in fig. 6, a block diagram of an electronic device according to an ambient sound monitoring method according to an embodiment of the present application is shown. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the application described and/or claimed herein.
As shown in fig. 6, the electronic device includes: one or more processors 601, memory 602, and interfaces for connecting the components, including high-speed interfaces and low-speed interfaces. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions executing within the electronic device, including instructions stored in or on memory to display graphical information of a graphical user interface (Graphical User Interface, GUI) on an external input/output device, such as a display device coupled to the interface. In other embodiments, multiple processors and/or multiple buses may be used, if desired, along with multiple memories and multiple memories. Also, multiple electronic devices may be connected, each providing a portion of the necessary operations (e.g., as a server array, a set of blade servers, or a multiprocessor system). One processor 601 is illustrated in fig. 6.
Memory 602 is a non-transitory computer-readable storage medium provided herein. Wherein the memory stores instructions executable by the at least one processor to cause the at least one processor to perform the ambient sound monitoring method provided herein. The non-transitory computer readable storage medium of the present application stores computer instructions for causing a computer to execute the ambient sound monitoring method provided by the present application.
The memory 602 is used as a non-transitory computer readable storage medium, and may be used to store non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules (e.g., xx module X01, xx module X02, and xx module X03 shown in fig. X) corresponding to the environmental sound monitoring method in the embodiments of the present application. The processor 601 executes various functional applications of the server and data processing, i.e., implements the ambient sound monitoring method in the above-described method embodiments, by running non-transitory software programs, instructions, and modules stored in the memory 602.
The memory 602 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, at least one application program required for a function; the storage data area may store data created from the use of the electronic device for ambient sound monitoring, and the like. In addition, the memory 602 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid-state storage device. In some embodiments, memory 602 may optionally include memory remotely located relative to processor 601, which may be connected to ambient sound monitoring electronics via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device of the environmental sound monitoring method may further include: an input device 603 and an output device 604. The processor 601, memory 602, input device 603 and output device 604 may be connected by a bus or otherwise, for example in fig. 6.
The input device 603 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the ambient sound monitored electronic device, such as a touch screen, keypad, mouse, trackpad, touchpad, pointer stick, one or more mouse buttons, track ball, joystick, and like input devices. The output means 604 may include a display device, auxiliary lighting means (e.g., LEDs), tactile feedback means (e.g., vibration motors), and the like. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a light emitting diode (Light Emitting Diode, LED) display, and a plasma display. In some implementations, the display device may be a touch screen.
Various implementations of the systems and techniques described here can be implemented in digital electronic circuitry, integrated circuitry, application specific integrated circuits (Application Specific Integrated Circuits, ASIC), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
These computing programs (also referred to as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented in a high-level procedural and/or object-oriented programming language, and/or in assembly/machine language. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, programmable logic devices (programmable logic device, PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., CRT (Cathode ray Tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area network (Local Area Network, LAN), wide Area network (wan), and the internet.
The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
According to the technical scheme, the environment sound is monitored abnormally, the environment sound monitoring result is divided into the plurality of sound abnormal events according to the time sequence, and the sound abnormal events are displayed in the environment sound monitoring interface of the client, so that a user can not only quickly find out the abnormality in the environment, but also can view the plurality of sound abnormal events displayed according to the time sequence through the client, and the efficiency of environment monitoring is improved.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present application may be performed in parallel, sequentially, or in a different order, provided that the desired results of the technical solutions disclosed in the present application can be achieved, and are not limited herein.
The above embodiments do not limit the scope of the application. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present application are intended to be included within the scope of the present application.
Claims (4)
1. An ambient sound monitoring method, comprising:
acquiring an environmental sound monitoring result sent by a cloud, wherein the environmental sound monitoring result is obtained by carrying out abnormal monitoring on environmental sound received by voice equipment;
dividing the environmental sound monitoring result into a plurality of sound abnormal events according to the time sequence of carrying out abnormal monitoring on the environmental sound; wherein each sound abnormality event corresponds to a time period, and the sound abnormality event includes a voice of an abnormality sound, a type of the abnormality sound, a sensitivity level, and a duration of the abnormality sound; different types of abnormal sounds have different sensitivity levels;
in the environment sound monitoring interface, responding to abnormal sound playing operation, and generating a playing instruction;
playing the voice of the abnormal sound according to the playing instruction;
responding to the sound abnormal event display operation, and generating a display trigger instruction;
displaying at least one of the type of the abnormal sound, the sensitivity level, and the duration of the abnormal sound according to the display trigger instruction;
receiving a feedback voice command, wherein the feedback voice command comprises a voice fed back according to the plurality of voice abnormal events;
the feedback voice command is sent to the cloud end so as to analyze the feedback voice command to obtain a feedback voice playing command, wherein the feedback voice playing command is used for controlling the voice equipment to play the feedback voice;
sending out an alarm signal under the condition that the sensitivity level is greater than or equal to a sensitivity threshold; wherein, the alarm signal comprises alarm sound and an alarm flash lamp;
receiving an alarm instruction, and calling an alarm phone to make an external help based on the alarm instruction;
in the monitoring opening interface, responding to the monitoring opening operation, and generating a monitoring opening instruction;
and sending the monitoring start instruction to the cloud to analyze the monitoring start instruction to obtain a start control instruction of the voice equipment, wherein the start control instruction is used for controlling the voice equipment to start.
2. An environmental sound monitoring device, comprising:
the sound monitoring result acquisition module is used for acquiring an environmental sound monitoring result sent by the cloud, wherein the environmental sound monitoring result is obtained by carrying out abnormal monitoring on environmental sound received by the voice equipment;
the sound abnormal event dividing module is used for dividing the analysis result of the environmental sound into a plurality of sound abnormal events according to the time sequence of carrying out abnormal monitoring on the environmental sound; wherein each sound abnormality event corresponds to a time period, and the sound abnormality event includes a voice of an abnormality sound, a type of the abnormality sound, a sensitivity level, and a duration of the abnormality sound; different types of abnormal sounds have different sensitivity levels;
a sound anomaly event presentation module comprising: the device comprises a play instruction generating unit, an abnormal sound playing unit, a display trigger instruction generating unit and an abnormal sound event display unit;
the play instruction generating unit is used for responding to the abnormal sound play operation in the environment sound monitoring interface to generate a play instruction;
the abnormal sound playing unit is used for playing the voice of the abnormal sound according to the playing instruction;
the display trigger instruction generating unit is used for responding to the sound abnormal event display operation and generating a display trigger instruction;
the abnormal sound event display unit is used for displaying at least one of the type of the abnormal sound, the sensitivity level and the duration time of the abnormal sound according to the display trigger instruction;
the feedback sound instruction receiving module is used for receiving a feedback sound instruction, and the feedback sound instruction comprises sound which is fed back according to the sound abnormal events;
the feedback voice command sending module is used for sending the feedback voice command to the cloud end so as to analyze the feedback voice command to obtain a feedback voice playing command, wherein the feedback voice playing command is used for controlling the voice equipment to play the feedback voice;
the abnormal alarm module is used for sending an alarm signal under the condition that the sensitivity level is greater than or equal to a sensitivity threshold value; wherein, the alarm signal comprises alarm sound and an alarm flash lamp; receiving an alarm instruction, and calling an alarm phone to make an external help based on the alarm instruction;
the monitoring opening instruction generation module is used for responding to the monitoring opening operation in the monitoring opening interface to generate a monitoring opening instruction;
the monitoring opening instruction sending module is used for sending the monitoring opening instruction to the cloud end so as to analyze the monitoring opening instruction to obtain an opening control instruction of the voice equipment, and the opening control instruction is used for controlling the voice equipment to be opened.
3. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of claim 1.
4. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of claim 1.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910783033.0A CN110489076B (en) | 2019-08-22 | 2019-08-22 | Environment sound monitoring method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910783033.0A CN110489076B (en) | 2019-08-22 | 2019-08-22 | Environment sound monitoring method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110489076A CN110489076A (en) | 2019-11-22 |
| CN110489076B true CN110489076B (en) | 2024-03-01 |
Family
ID=68553203
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910783033.0A Active CN110489076B (en) | 2019-08-22 | 2019-08-22 | Environment sound monitoring method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110489076B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112991673A (en) * | 2019-12-13 | 2021-06-18 | 宇龙计算机通信科技(深圳)有限公司 | Household abnormity monitoring method and device, storage medium and electronic equipment |
| CN113838478B (en) * | 2020-06-08 | 2024-04-09 | 华为技术有限公司 | Abnormal event detection method and device and electronic equipment |
| CN114121050A (en) * | 2021-11-30 | 2022-03-01 | 云知声智能科技股份有限公司 | Audio playing method and device, electronic equipment and storage medium |
| CN115240302A (en) * | 2022-07-18 | 2022-10-25 | 珠海格力电器股份有限公司 | Method and device for monitoring indoor safety environment, electronic equipment and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104836857A (en) * | 2015-05-07 | 2015-08-12 | 广东欧珀移动通信有限公司 | Anti-theft method based on smart sound box, anti-theft device based on smart sound box, smart sound box and mobile terminal |
| CN105681062A (en) * | 2014-11-18 | 2016-06-15 | 小米科技有限责任公司 | Safety monitoring method and apparatus |
| JP2016118987A (en) * | 2014-12-22 | 2016-06-30 | パナソニックＩｐマネジメント株式会社 | Abnormality sound detection system |
| CN106683361A (en) * | 2017-01-24 | 2017-05-17 | 宇龙计算机通信科技(深圳)有限公司 | Sound monitoring method and device |
| CN106887122A (en) * | 2015-12-15 | 2017-06-23 | 美的集团股份有限公司 | Method, device and the audio amplifier alarmed by audio amplifier |
| KR20190028016A (en) * | 2017-09-08 | 2019-03-18 | 주식회사 케이티 | Apparatus for monitoring home, method and computer program |
| CN109785581A (en) * | 2019-02-26 | 2019-05-21 | 珠海格力电器股份有限公司 | A kind of monitoring method, device, storage medium and equipment |
| US10296194B2 (en) * | 2015-06-14 | 2019-05-21 | Google Llc | Methods and systems for presenting alert event indicators |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8488799B2 (en) * | 2008-09-11 | 2013-07-16 | Personics Holdings Inc. | Method and system for sound monitoring over a network |
| AU2014257036A1 (en) * | 2013-04-23 | 2015-11-12 | Canary Connect, Inc. | Security and/or monitoring devices and systems |
| US10386999B2 (en) * | 2016-10-26 | 2019-08-20 | Google Llc | Timeline-video relationship presentation for alert events |
-
2019
- 2019-08-22 CN CN201910783033.0A patent/CN110489076B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105681062A (en) * | 2014-11-18 | 2016-06-15 | 小米科技有限责任公司 | Safety monitoring method and apparatus |
| JP2016118987A (en) * | 2014-12-22 | 2016-06-30 | パナソニックＩｐマネジメント株式会社 | Abnormality sound detection system |
| CN104836857A (en) * | 2015-05-07 | 2015-08-12 | 广东欧珀移动通信有限公司 | Anti-theft method based on smart sound box, anti-theft device based on smart sound box, smart sound box and mobile terminal |
| US10296194B2 (en) * | 2015-06-14 | 2019-05-21 | Google Llc | Methods and systems for presenting alert event indicators |
| CN106887122A (en) * | 2015-12-15 | 2017-06-23 | 美的集团股份有限公司 | Method, device and the audio amplifier alarmed by audio amplifier |
| CN106683361A (en) * | 2017-01-24 | 2017-05-17 | 宇龙计算机通信科技(深圳)有限公司 | Sound monitoring method and device |
| KR20190028016A (en) * | 2017-09-08 | 2019-03-18 | 주식회사 케이티 | Apparatus for monitoring home, method and computer program |
| CN109785581A (en) * | 2019-02-26 | 2019-05-21 | 珠海格力电器股份有限公司 | A kind of monitoring method, device, storage medium and equipment |
Non-Patent Citations (2)
| Title |
|---|
| "Voice-Activity Home Care System";Oscal T.-C. Chen 等;《IEEE》;20160421;第110-113页 * |
| "基于UBM和PLDA的异常声识别方法研究";马士乾;《中国优秀硕士学位论文全文数据库(信息科技辑)》;20190215(第2019年第02期);正文第6-29页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110489076A (en) | 2019-11-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110489076B (en) | Environment sound monitoring method and device and electronic equipment | |
| US20210210091A1 (en) | Method, device, and storage medium for waking up via speech | |
| US20210092195A1 (en) | Information push method and device | |
| US11435824B2 (en) | Prompt method and apparatus for eye-protection mode, electronic device and storage medium | |
| EP3836484B1 (en) | Method for transmitting live message, apparatus, electronic device, medium and computer program product | |
| KR102488582B1 (en) | Method and apparatus for verifying operation state of application | |
| EP3796308A1 (en) | Speech recognition control method and apparatus, electronic device and readable storage medium | |
| CN110768877B (en) | Voice control instruction processing method and device, electronic equipment and readable storage medium | |
| CN111782433A (en) | Exception troubleshooting method, device, electronic equipment and storage medium | |
| US20160321906A1 (en) | Alert management within a network based virtual collaborative space | |
| CN110501918A (en) | Intelligent electrical appliance control, device, electronic equipment and storage medium | |
| US10872002B2 (en) | Hybrid computing landscape event characterization | |
| CN112003778B (en) | Message processing method, device, equipment and computer storage medium | |
| CN112491858B (en) | Method, device, equipment and storage medium for detecting abnormal information | |
| EP4348429A1 (en) | Detecting datacenter mass outage with near real-time/offline data using ml models | |
| CN110933227A (en) | Assistance method, device, equipment and medium for intelligent terminal | |
| CN113395251A (en) | Machine learning safety scene detection method and device | |
| CN110738462A (en) | Plan management method, plan management device, electronic device, and storage medium | |
| CN112735601B (en) | Test method, device and equipment for determining infectious disease close-contact population by using Bluetooth | |
| CN115589432A (en) | Message push management method, device, medium and equipment | |
| CN112752323B (en) | Method and device for changing hot spot access state | |
| CN110609671B (en) | Sound signal enhancement method, device, electronic equipment and storage medium | |
| CN109086116B (en) | Communication tool speech real-time monitoring method and device based on auxiliary function service | |
| CN110535960A (en) | Method for early warning, device and electronic equipment | |
| CN111986682A (en) | Voice interaction method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210513 Address after: 100085 Baidu Building, 10 Shangdi Tenth Street, Haidian District, Beijing Applicant after: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) Co.,Ltd. Applicant after: Shanghai Xiaodu Technology Co.,Ltd. Address before: 100085 Baidu Building, 10 Shangdi Tenth Street, Haidian District, Beijing Applicant before: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |